-- Logs begin at Thu 2022-06-23 18:45:28 UTC, end at Thu 2022-06-23 20:14:44 UTC. -- Jun 23 19:37:23.914966 dv-cinder-847274-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 23 19:37:23.923345 dv-cinder-847274-2-smb devstack@keystone.service[91953]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 23 19:37:23.926809 dv-cinder-847274-2-smb devstack@keystone.service[91953]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 19:37:23 2022] *** Jun 23 19:37:23.926809 dv-cinder-847274-2-smb devstack@keystone.service[91953]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 19:37:23.926809 dv-cinder-847274-2-smb devstack@keystone.service[91953]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 19:37:23.926809 dv-cinder-847274-2-smb devstack@keystone.service[91953]: nodename: dv-cinder-847274-2-smb Jun 23 19:37:23.926809 dv-cinder-847274-2-smb devstack@keystone.service[91953]: machine: x86_64 Jun 23 19:37:23.926809 dv-cinder-847274-2-smb devstack@keystone.service[91953]: clock source: unix Jun 23 19:37:23.926809 dv-cinder-847274-2-smb devstack@keystone.service[91953]: pcre jit disabled Jun 23 19:37:23.926809 dv-cinder-847274-2-smb devstack@keystone.service[91953]: detected number of CPU cores: 4 Jun 23 19:37:23.926809 dv-cinder-847274-2-smb devstack@keystone.service[91953]: current working directory: / Jun 23 19:37:23.926809 dv-cinder-847274-2-smb devstack@keystone.service[91953]: detected binary path: /usr/bin/uwsgi-core Jun 23 19:37:23.926809 dv-cinder-847274-2-smb devstack@keystone.service[91953]: your processes number limit is 47680 Jun 23 19:37:23.926809 dv-cinder-847274-2-smb devstack@keystone.service[91953]: your memory page size is 4096 bytes Jun 23 19:37:23.926809 dv-cinder-847274-2-smb devstack@keystone.service[91953]: detected max file descriptor number: 2048 Jun 23 19:37:23.926809 dv-cinder-847274-2-smb devstack@keystone.service[91953]: lock engine: pthread robust mutexes Jun 23 19:37:23.926809 dv-cinder-847274-2-smb devstack@keystone.service[91953]: thunder lock: enabled Jun 23 19:37:23.926809 dv-cinder-847274-2-smb devstack@keystone.service[91953]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 23 19:37:23.926809 dv-cinder-847274-2-smb devstack@keystone.service[91953]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 19:37:23.970659 dv-cinder-847274-2-smb devstack@keystone.service[91953]: Python main interpreter initialized at 0x55cb9119d9c0 Jun 23 19:37:23.970659 dv-cinder-847274-2-smb devstack@keystone.service[91953]: python threads support enabled Jun 23 19:37:23.970659 dv-cinder-847274-2-smb devstack@keystone.service[91953]: your server socket listen backlog is limited to 100 connections Jun 23 19:37:23.970659 dv-cinder-847274-2-smb devstack@keystone.service[91953]: your mercy for graceful operations on workers is 90 seconds Jun 23 19:37:23.970997 dv-cinder-847274-2-smb devstack@keystone.service[91953]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 19:37:23.971071 dv-cinder-847274-2-smb devstack@keystone.service[91953]: *** Operational MODE: preforking *** Jun 23 19:37:23.971336 dv-cinder-847274-2-smb devstack@keystone.service[91953]: *** uWSGI is running in multiple interpreter mode *** Jun 23 19:37:23.971336 dv-cinder-847274-2-smb devstack@keystone.service[91953]: spawned uWSGI master process (pid: 91953) Jun 23 19:37:23.971539 dv-cinder-847274-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 23 19:37:23.976730 dv-cinder-847274-2-smb devstack@keystone.service[91953]: spawned uWSGI worker 1 (pid: 91965, cores: 1) Jun 23 19:37:23.976730 dv-cinder-847274-2-smb devstack@keystone.service[91953]: spawned uWSGI worker 2 (pid: 91966, cores: 1) Jun 23 19:37:23.976730 dv-cinder-847274-2-smb devstack@keystone.service[91953]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 19:37:29.480546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 19:37:29.480546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: from cryptography.utils import int_from_bytes Jun 23 19:37:29.481366 dv-cinder-847274-2-smb devstack@keystone.service[91965]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 19:37:29.481366 dv-cinder-847274-2-smb devstack@keystone.service[91965]: from cryptography.utils import int_from_bytes Jun 23 19:37:29.481472 dv-cinder-847274-2-smb devstack@keystone.service[91966]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 19:37:29.481472 dv-cinder-847274-2-smb devstack@keystone.service[91966]: from cryptography.utils import int_from_bytes Jun 23 19:37:29.481878 dv-cinder-847274-2-smb devstack@keystone.service[91966]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 19:37:29.481878 dv-cinder-847274-2-smb devstack@keystone.service[91966]: from cryptography.utils import int_from_bytes Jun 23 19:37:29.539873 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 19:37:29.540055 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 19:37:29.540144 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 19:37:29.540236 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 19:37:29.540321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] command line args: [] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 19:37:29.540398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] command line args: [] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 19:37:29.540571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 19:37:29.540658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 19:37:29.540735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ================================================================================ {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 19:37:29.540811 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ================================================================================ {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 19:37:29.540990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] admin_token = **** {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.541070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] admin_token = **** {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.541259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] config_dir = [] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.541355 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] config_dir = [] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.541453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.541533 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.541641 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] config_source = [] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.541725 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] config_source = [] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.541820 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] debug = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.541898 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] debug = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.542017 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.542326 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.542457 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.542555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.542656 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.542762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.542870 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.542981 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.543078 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.543180 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.543282 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] list_limit = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.543377 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] list_limit = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.543488 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] log_config_append = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.543590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] log_config_append = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.543686 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.543786 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.543894 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] log_dir = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.543997 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] log_dir = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.544105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] log_file = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.544208 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] log_file = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.544332 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.544407 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.544530 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.544605 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.544728 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.544803 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.544923 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.545007 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.545133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.545259 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.545335 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.545453 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.545535 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.545658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.545740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.545820 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.545943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.546018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.546138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.546212 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.546326 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.546411 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.546482 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.546597 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.546730 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.546821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.546973 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.547058 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.547245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.547329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.547736 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.547869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.547946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] publish_errors = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.548067 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] publish_errors = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.548195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.548274 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.548350 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.548467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.548589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.548670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.548794 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.548884 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.549012 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.549132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.549254 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] standard_threads = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.549418 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] standard_threads = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.549501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.549571 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.549718 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.549803 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.549883 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.549960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.550058 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] use_journal = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.550136 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] use_journal = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.550233 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] use_json = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.550309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] use_json = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.550406 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] use_stderr = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.550490 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] use_stderr = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.550568 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] use_syslog = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.550637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] use_syslog = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.550796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.550874 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:37:29.551049 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.551205 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.551284 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.551360 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.551533 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.551616 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.551772 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.551857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.552019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.552102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.552256 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.552338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.552501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.552588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.552736 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.552822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.552981 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.553058 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.553255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.553348 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.553504 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.553581 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.553737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.553813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.553980 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.554066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.554215 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.554291 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.554459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.554546 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.554737 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.554872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.554994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.555097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.555212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.555296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.555464 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.555543 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.555709 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.555787 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.555944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.556028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.556194 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.556273 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.556453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.556530 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.556704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.556788 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.556935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.557009 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.557188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.557298 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.557422 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.557516 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.557655 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.557734 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.557887 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.557971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.558134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.558213 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.558380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.558459 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.558608 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.558685 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.558839 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.558922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.559080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.559159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.559324 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.559402 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.559558 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.559635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.559801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.559880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.560031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.560108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.560265 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.560342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.560497 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.560576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.560814 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.560903 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.560997 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.561069 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.561182 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.561265 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.561416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.561491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.561653 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.561797 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.561908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.562026 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.562118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.562185 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.562344 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.562519 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.562611 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.562686 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.562830 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.563004 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.563004 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.563193 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.563276 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.563358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.563477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.563611 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.563715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.563795 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.563949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.564042 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.564200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.564302 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.564422 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.564517 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.564644 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.564761 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.564870 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.564949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.565117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.565262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.565396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.565545 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.565622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.565737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.565856 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.565987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.566117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.566204 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.566350 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.566681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.566838 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.566920 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.567072 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.567161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.567305 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.567383 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.567572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.567651 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.567810 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.567902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.568055 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.568139 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.568299 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.568389 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.568536 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.568695 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.568777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.568848 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.568987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.569066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.569258 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.569355 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.569495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.569581 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.569729 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.569807 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.569970 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.570061 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.570206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.570286 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.570464 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.570542 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.570698 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.570777 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.570932 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.571012 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.571166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.571341 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.571420 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.571617 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.571707 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.571865 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.571951 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.572103 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.572181 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.572340 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.572425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.572573 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.572651 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.572806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.572885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.573039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.573130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.573292 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.573372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.573524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.573602 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.573752 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.573885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.574057 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.574141 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.574214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.574283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.574429 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.574516 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.574661 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.574740 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.574898 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.574976 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.575130 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.575216 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.575374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.575451 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.575628 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.575706 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.575867 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.575954 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.576097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] auth.external = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.576176 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.576327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.576405 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] auth.external = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.576562 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.576648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.576842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.576933 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.577073 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] auth.password = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.577171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.577325 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] auth.token = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.577404 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] auth.password = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.577563 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] auth.token = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.577654 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.577794 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.577872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.578031 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.578117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.578258 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.578345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.578519 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.578600 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.578748 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.578828 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.578979 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.579069 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.579212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] credential.caching = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.579292 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.579449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] credential.caching = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.579527 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.579694 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.579781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.579940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.580020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.580174 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.580254 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.580415 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.580494 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.580645 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.580723 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.580886 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.580964 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.581145 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.581286 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.581398 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.581478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.581651 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.581732 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.581910 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.581991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.582160 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.582240 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.582418 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.582498 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.582645 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.582720 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.582899 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.582978 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.583134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] federation.caching = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.583213 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.583369 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.583449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] federation.caching = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.583604 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.583745 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.583850 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.583968 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.584091 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.584172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.584323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.584401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.584567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.584644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.584804 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.584883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.585043 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.585122 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.585311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.585391 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.585548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.585628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.585791 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.585877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.586538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] identity.caching = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.586619 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.586787 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.587005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] identity.caching = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.587084 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.587259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.587336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.587493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.587588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.587739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.587818 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.587969 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.588048 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.588205 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.588282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.588444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.588553 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.588683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.588766 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.588911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.589002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.589140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.589267 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.589390 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.589476 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.589629 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.589725 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.589862 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.589941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.590107 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.590186 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.590353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.590442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.590598 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.590679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.590856 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.590937 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.591092 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.591188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.591325 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.591405 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.591553 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.591633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.591786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.591868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.592015 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.592095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.592252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.592332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.592482 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.592562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.592717 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.592796 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.592958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.593037 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.593203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.593287 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.593452 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.593533 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.593686 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.593766 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.593917 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.593998 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.594161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.594241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.594406 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.594485 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.594633 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.594719 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.594867 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.594959 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.595096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.595223 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.595331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.595413 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.595560 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.595639 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.595796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.595876 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.596030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.596127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.596263 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.596350 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.596500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.596580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.596738 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.596829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.596966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.597045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.597229 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.597352 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.597477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.597572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.597713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.597793 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.597953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.598032 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.598188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.598270 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.598421 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.598507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.598652 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.user = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.598732 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.598887 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.598968 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.599120 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.user = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.599201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.599361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.599441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.599607 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.599689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.599840 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.599919 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.600084 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.600164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.600317 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.600399 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.600545 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.600625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.600779 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.600874 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.601007 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.601089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.601261 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.601446 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.601527 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.602243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.602344 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.602420 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.602575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.602656 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.602828 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.602907 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.603079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.603160 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.603323 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.603402 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.603555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.603635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.603798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.603880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.604029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.604115 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.604261 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.604354 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.604495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.604575 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.604730 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.604810 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.604963 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.605051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.605221 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.605307 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.605459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.605539 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.605709 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.605801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.605938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.606017 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.606178 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.606258 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.606412 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.606570 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.606648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.606719 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.606862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.606942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.607105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.607198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.607346 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.607426 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.607577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.607657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.607810 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.607898 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.608047 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] resource.caching = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.608126 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.608283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.608361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.608526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] resource.caching = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.608629 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.608757 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.608838 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.609003 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.609083 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.609275 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.609367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.609510 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.609590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.609757 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.609837 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.609991 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.610082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.610228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.610307 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.610462 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] role.caching = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.610542 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.610699 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.610787 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] role.driver = sql {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.610927 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.611006 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] role.caching = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.611173 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.611252 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] role.driver = sql {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.611401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.611489 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.611651 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.611731 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.611894 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.611974 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.612139 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.612228 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.612386 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.612466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.612631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.612712 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.612877 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.612965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.613107 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.613211 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.613374 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.613456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.613610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.613701 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.613852 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.613932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.614096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.614177 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.614342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.614488 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.614591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.614724 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.614973 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.615052 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.615213 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.615294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.615457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.615538 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.615703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.615783 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.615934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.616016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.616181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.616261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.616422 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.616500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.616656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.616736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.616886 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.616965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.617117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.617218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.617445 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.617528 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.617753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.617853 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.617990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.618071 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.618245 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.618332 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.618481 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.618561 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.618715 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.618795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.618946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.619027 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.619179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] token.caching = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.619258 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.619410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.619488 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.619650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] token.caching = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.619731 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.619880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.619959 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.620127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.620226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.620365 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.620447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.620598 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.620676 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.620838 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.620918 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.621076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.621229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.621345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.621470 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.621579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.621659 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.621815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.621899 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.622048 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.622129 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.622285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.622364 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.622522 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.622603 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.622748 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.622828 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.622990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.623071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.623222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.623307 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.623466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.623546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] database.connection = **** {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.623758 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.623848 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.624004 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.624092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] database.connection = **** {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.624242 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.624332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.624488 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.624568 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.624721 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.624801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.624957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.625038 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.625211 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.625297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.625448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.625527 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.625681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.625757 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.625908 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.625988 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.626146 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.626225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.626380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.626462 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.626621 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.626700 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.626853 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.626932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.627094 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.627176 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.627324 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.627405 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.627563 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.627643 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.627794 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.627875 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.627947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 19:37:29.628040 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.628276 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:37:29.628447 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 19:37:29.658394 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.658616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.658846 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.658992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.659228 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.659454 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.667880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.668602 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.695856 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.695856 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.696524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.696759 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.838682 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.838861 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.887658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.887891 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.888009 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.888197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.952592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.952740 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.952848 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.952930 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.953006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.953124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.953265 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.953356 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.953457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.953556 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.953673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.953769 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.978826 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.979062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.979156 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.979290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.979376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.979511 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.979606 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.979726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.979811 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.979939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.980022 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.980150 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.980233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.980406 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.991088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:29.991558 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:30.004348 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:30.004581 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:30.004770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:30.004856 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:30.005005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:30.005089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:30.005241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:30.005326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:30.005454 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:30.005538 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:30.005663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91965) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:30.005756 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:30.005880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:30.006097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91966) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 19:37:30.022723 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.022933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 19:37:30.023196 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.023294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.023427 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 19:37:30.023511 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 19:37:30.023763 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.023913 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.024043 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 19:37:30.024218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.024302 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.024475 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.024559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.024728 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.024819 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.024979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.035537 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.035804 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.035891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.036064 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.036147 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.036333 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.036416 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.036613 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.045189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91965) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.045503 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91966) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.048457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91965) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.048733 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.048816 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91966) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.049008 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.049105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.049309 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.049393 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.049584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.049668 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.049846 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.049985 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.050107 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.050191 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.050372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.050464 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.050634 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.050716 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.050898 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.050980 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.051156 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.051251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.051420 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.078749 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.078950 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.080355 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91965) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.080567 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91966) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.080651 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.080853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.085899 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91965) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.086176 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91966) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.086471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.086556 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.086811 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.086904 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.094173 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91965) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.094269 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91966) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.094407 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.094490 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.098888 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91965) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.098974 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91966) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.099172 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.099270 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.099451 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.099542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.099729 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.099812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.100000 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.100084 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.100266 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.100349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.100531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.100614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.100793 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.100877 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.120812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.121083 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.121187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.121389 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.125908 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91966) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.126278 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91965) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.129579 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.129907 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.130076 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.130302 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.135052 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91966) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.135548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91965) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.138697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91966) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.139178 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91965) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.142382 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.142682 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.142873 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.142957 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.143169 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.143254 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.143451 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.143535 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.143731 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.143824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.144005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.144279 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.162978 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91966) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.163263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.163531 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.163614 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91965) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.163809 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.163893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.164589 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.165053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.172535 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.173140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.174261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.174548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.174849 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.175120 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.177842 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91966) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.178244 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.178328 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91965) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.178561 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.178659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.178850 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.178935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.179122 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.179206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.179406 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.193271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91966) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.193553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.193697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91965) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.193850 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.193971 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.194353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.194447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.194524 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.195709 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.196093 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.196180 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.196387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.196471 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.196676 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.215102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91966) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.215218 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91965) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.218424 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91966) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.218513 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91965) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.221753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.221874 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.223474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.223563 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.225096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91965) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.225199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91966) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.225393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.225491 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.225671 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.225753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.233716 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.233928 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.235312 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91965) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.235544 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91966) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.238572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.238817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.238900 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.239116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.239212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.239479 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.239561 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.239765 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.248756 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91965) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.249028 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.249112 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91966) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.249324 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.249407 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.249613 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.257184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91965) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.257460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.257543 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91966) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 19:37:30.257737 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.257852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.258113 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.258449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.258525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.258598 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.258598 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.258741 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.258941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.259033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.259208 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.259290 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.259477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.259567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.259748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.259830 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.260015 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.260094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.260275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.260355 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.260544 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.260624 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.260810 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91965) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.260898 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.261073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91966) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 19:37:30.299405 dv-cinder-847274-2-smb devstack@keystone.service[91965]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55cb9119d9c0 pid: 91965 (default app) Jun 23 19:37:30.299902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55cb9119d9c0 pid: 91966 (default app) Jun 23 19:37:30.302753 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16df87-5631-4513-b396-e9ef67db141f None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:30.303046 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16df87-5631-4513-b396-e9ef67db141f None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:30.303324 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16df87-5631-4513-b396-e9ef67db141f None None] PATH_INFO: `/v3` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:30.307597 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Thu Jun 23 19:37:30 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:37:39.119435 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b524c8-2a17-4266-b7b2-77f7000968ff None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:39.119990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b524c8-2a17-4266-b7b2-77f7000968ff None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:39.119990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b524c8-2a17-4266-b7b2-77f7000968ff None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:39.124323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:37:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:37:39.129865 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b07d2a-9e4e-4249-bfa7-4b2c31a97686 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:39.130245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b07d2a-9e4e-4249-bfa7-4b2c31a97686 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:39.130440 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b07d2a-9e4e-4249-bfa7-4b2c31a97686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:39.202755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: INFO dbcounter [None req-62b07d2a-9e4e-4249-bfa7-4b2c31a97686 None None] Registered counter for database keystone Jun 23 19:37:39.224392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG oslo_db.sqlalchemy.engines [None req-62b07d2a-9e4e-4249-bfa7-4b2c31a97686 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91965) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 19:37:39.231161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writer thread running {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 19:37:39.408296 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG passlib.handlers.bcrypt [None req-62b07d2a-9e4e-4249-bfa7-4b2c31a97686 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91965) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 19:37:39.408715 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG passlib.handlers.bcrypt [None req-62b07d2a-9e4e-4249-bfa7-4b2c31a97686 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91965) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 19:37:39.464527 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-62b07d2a-9e4e-4249-bfa7-4b2c31a97686 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:37:39.466103 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-62b07d2a-9e4e-4249-bfa7-4b2c31a97686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:37:39.588131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:37:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 19:37:39.736561 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b524c8-2a17-4266-b7b2-77f7000968ff None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:39.806551 dv-cinder-847274-2-smb devstack@keystone.service[91966]: INFO dbcounter [None req-27b524c8-2a17-4266-b7b2-77f7000968ff None None] Registered counter for database keystone Jun 23 19:37:39.826089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG oslo_db.sqlalchemy.engines [None req-27b524c8-2a17-4266-b7b2-77f7000968ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91966) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 19:37:39.832168 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writer thread running {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 19:37:39.951553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b524c8-2a17-4266-b7b2-77f7000968ff None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:39.955815 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a4814-b916-4bb7-95d0-b757ba10a8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:39.956479 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a4814-b916-4bb7-95d0-b757ba10a8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:39.956768 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a4814-b916-4bb7-95d0-b757ba10a8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:39.957053 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a4814-b916-4bb7-95d0-b757ba10a8a5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:39.965270 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a4814-b916-4bb7-95d0-b757ba10a8a5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:40.016341 dv-cinder-847274-2-smb devstack@keystone.service[91966]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cf5a4814-b916-4bb7-95d0-b757ba10a8a5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 19:37:40.016635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a4814-b916-4bb7-95d0-b757ba10a8a5 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:40.026838 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Thu Jun 23 19:37:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 19:37:40.032732 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b07d2a-9e4e-4249-bfa7-4b2c31a97686 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:40.047952 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b07d2a-9e4e-4249-bfa7-4b2c31a97686 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:40.052275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510b45b-6905-445c-bf1f-3fd280af60a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:40.053401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510b45b-6905-445c-bf1f-3fd280af60a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:40.053688 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510b45b-6905-445c-bf1f-3fd280af60a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:40.053961 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510b45b-6905-445c-bf1f-3fd280af60a9 admin admin] PATH_INFO: `/v3/projects/50703062c6ac410a8cc7e1c87c4ecbac` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:40.058742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510b45b-6905-445c-bf1f-3fd280af60a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=50703062c6ac410a8cc7e1c87c4ecbac)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:40.110721 dv-cinder-847274-2-smb devstack@keystone.service[91965]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d510b45b-6905-445c-bf1f-3fd280af60a9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 19:37:40.111063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510b45b-6905-445c-bf1f-3fd280af60a9 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:40.115608 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Thu Jun 23 19:37:40 2022] GET /identity/v3/projects/50703062c6ac410a8cc7e1c87c4ecbac => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:37:42.146688 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aea47d-ec6e-4a46-9661-48a13e358d72 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:42.147252 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aea47d-ec6e-4a46-9661-48a13e358d72 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:42.147252 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aea47d-ec6e-4a46-9661-48a13e358d72 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:42.152040 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:37:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:37:42.157380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cf29a-bd81-4a46-b65b-5b0780bcf3a3 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:42.157798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cf29a-bd81-4a46-b65b-5b0780bcf3a3 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:42.158027 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cf29a-bd81-4a46-b65b-5b0780bcf3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:42.176502 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-348cf29a-bd81-4a46-b65b-5b0780bcf3a3 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:37:42.178037 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-348cf29a-bd81-4a46-b65b-5b0780bcf3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:37:42.185969 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:37:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 19:37:42.208601 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aea47d-ec6e-4a46-9661-48a13e358d72 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:42.221529 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aea47d-ec6e-4a46-9661-48a13e358d72 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:42.225624 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6974cd-8e72-4a7d-82cb-5eebfe5878a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:42.226245 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6974cd-8e72-4a7d-82cb-5eebfe5878a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:42.227014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6974cd-8e72-4a7d-82cb-5eebfe5878a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:42.227309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6974cd-8e72-4a7d-82cb-5eebfe5878a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:42.234887 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6974cd-8e72-4a7d-82cb-5eebfe5878a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:42.236647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6974cd-8e72-4a7d-82cb-5eebfe5878a6 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:42.246377 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Thu Jun 23 19:37:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 19:37:42.251587 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cf29a-bd81-4a46-b65b-5b0780bcf3a3 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:42.261164 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cf29a-bd81-4a46-b65b-5b0780bcf3a3 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:42.265433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821aac12-391d-46a8-90c5-c29667043a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:42.266281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aac12-391d-46a8-90c5-c29667043a44 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:42.266565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aac12-391d-46a8-90c5-c29667043a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:42.266843 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aac12-391d-46a8-90c5-c29667043a44 admin admin] PATH_INFO: `/v3/users/d83e81b5c7054c4491fc17ac780d3cea` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:42.268247 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821aac12-391d-46a8-90c5-c29667043a44 admin admin] RBAC: Authorizing `identity:get_user(user_id=d83e81b5c7054c4491fc17ac780d3cea)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:42.270104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821aac12-391d-46a8-90c5-c29667043a44 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:42.271631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Thu Jun 23 19:37:42 2022] GET /identity/v3/users/d83e81b5c7054c4491fc17ac780d3cea => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:37:44.366745 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09e362-a04e-469e-ac39-13d7fb6a7c04 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:44.367283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09e362-a04e-469e-ac39-13d7fb6a7c04 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:44.367283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09e362-a04e-469e-ac39-13d7fb6a7c04 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:44.368650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:37:44.373886 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999c514-6979-48eb-837f-b9821d07fca4 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:44.374288 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999c514-6979-48eb-837f-b9821d07fca4 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:44.374455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999c514-6979-48eb-837f-b9821d07fca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:44.388780 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d7ea0-e3a4-4f74-bf2f-68cc287bfd5a None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:44.389068 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d7ea0-e3a4-4f74-bf2f-68cc287bfd5a None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:44.389391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d7ea0-e3a4-4f74-bf2f-68cc287bfd5a None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:44.390718 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:37:44.391204 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-5999c514-6979-48eb-837f-b9821d07fca4 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:37:44.392419 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-5999c514-6979-48eb-837f-b9821d07fca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:37:44.395610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755e2c4-2172-4cdf-bfa9-4956eb8546d0 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:44.395898 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755e2c4-2172-4cdf-bfa9-4956eb8546d0 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:44.396180 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755e2c4-2172-4cdf-bfa9-4956eb8546d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:44.435274 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG passlib.handlers.bcrypt [None req-c755e2c4-2172-4cdf-bfa9-4956eb8546d0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91966) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 19:37:44.435712 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG passlib.handlers.bcrypt [None req-c755e2c4-2172-4cdf-bfa9-4956eb8546d0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91966) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 19:37:44.473990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:37:44.481974 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-c755e2c4-2172-4cdf-bfa9-4956eb8546d0 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:37:44.483583 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-c755e2c4-2172-4cdf-bfa9-4956eb8546d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:37:44.497970 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999c514-6979-48eb-837f-b9821d07fca4 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:44.521524 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:44.583903 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:37:44.603844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999c514-6979-48eb-837f-b9821d07fca4 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:44.606260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755e2c4-2172-4cdf-bfa9-4956eb8546d0 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:44.639937 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bd022-3849-45ee-ac9e-0fc35c35bc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:44.640755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bd022-3849-45ee-ac9e-0fc35c35bc59 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:44.641045 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bd022-3849-45ee-ac9e-0fc35c35bc59 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:44.641359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bd022-3849-45ee-ac9e-0fc35c35bc59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:44.652764 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bd022-3849-45ee-ac9e-0fc35c35bc59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:37:44.663911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-6d5bd022-3849-45ee-ac9e-0fc35c35bc59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:37:44.663911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:37:44.663911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:37:44.663911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:37:44.663911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:37:44.663911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:37:44.663911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:37:44.663911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:37:44.663911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:37:44.663911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:37:44.663911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:37:44.663911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:37:44.663911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:37:44.663911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:37:44.663911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:37:44.663911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:37:44.664957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:37:44.664957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:37:44.664957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:37:44.664957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:37:44.664957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:37:44.664957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:37:44.664957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:37:44.664957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:37:44.664957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:37:44.664957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:37:44.664957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:37:44.664957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:37:44.664957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:37:44.664957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:37:44.664957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:37:44.664957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:37:44.666108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:37:44.666108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:37:44.666108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:37:44.666108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:37:44.666108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:37:44.666108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:37:44.666108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:37:44.666108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:37:44.666108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:37:44.666108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:37:44.666108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:37:44.666108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:37:44.666108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:37:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:37:44.670743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bd022-3849-45ee-ac9e-0fc35c35bc59 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:44.708550 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755e2c4-2172-4cdf-bfa9-4956eb8546d0 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:44.711303 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:44.744696 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba8bd0-ad1e-4968-a201-c05a7c78e273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:44.745605 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba8bd0-ad1e-4968-a201-c05a7c78e273 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:44.745904 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba8bd0-ad1e-4968-a201-c05a7c78e273 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:44.746180 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba8bd0-ad1e-4968-a201-c05a7c78e273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:44.754331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:44.773316 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bd022-3849-45ee-ac9e-0fc35c35bc59 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:44.807535 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99f959-d6eb-4f84-ad5d-36748445f42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:44.808200 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99f959-d6eb-4f84-ad5d-36748445f42e None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:44.808485 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99f959-d6eb-4f84-ad5d-36748445f42e None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:44.808763 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99f959-d6eb-4f84-ad5d-36748445f42e None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:44.809542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99f959-d6eb-4f84-ad5d-36748445f42e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:37:44.809849 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99f959-d6eb-4f84-ad5d-36748445f42e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:44.811246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99f959-d6eb-4f84-ad5d-36748445f42e None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:44.815656 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba8bd0-ad1e-4968-a201-c05a7c78e273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:44.817451 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba8bd0-ad1e-4968-a201-c05a7c78e273 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:44.823810 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 8/15] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:37:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:37:44.829339 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99f959-d6eb-4f84-ad5d-36748445f42e None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:44.919736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 8/16] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:37:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 19:37:44.925323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba8bd0-ad1e-4968-a201-c05a7c78e273 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:44.927984 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:44.929060 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99f959-d6eb-4f84-ad5d-36748445f42e None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:44.963798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9326f-1a24-42c5-9cdd-12c9a491351a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:44.964701 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9326f-1a24-42c5-9cdd-12c9a491351a None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:44.964987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9326f-1a24-42c5-9cdd-12c9a491351a None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:44.965301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9326f-1a24-42c5-9cdd-12c9a491351a None admin] PATH_INFO: `/v3/users/d83e81b5c7054c4491fc17ac780d3cea` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:44.966528 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9326f-1a24-42c5-9cdd-12c9a491351a None admin] RBAC: Authorizing `identity:get_user(user_id=d83e81b5c7054c4491fc17ac780d3cea)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:44.968002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9326f-1a24-42c5-9cdd-12c9a491351a None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:44.969678 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:37:44 2022] GET /identity/v3/users/d83e81b5c7054c4491fc17ac780d3cea => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:37:44.974939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9326f-1a24-42c5-9cdd-12c9a491351a None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:44.989401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:45.022837 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba8bd0-ad1e-4968-a201-c05a7c78e273 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:45.056266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa446f-26e3-43e1-a589-2d74924d68ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:45.057064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa446f-26e3-43e1-a589-2d74924d68ad None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:45.057384 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa446f-26e3-43e1-a589-2d74924d68ad None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:45.057668 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa446f-26e3-43e1-a589-2d74924d68ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:45.074260 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9326f-1a24-42c5-9cdd-12c9a491351a None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:45.077855 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa446f-26e3-43e1-a589-2d74924d68ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:45.079360 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa446f-26e3-43e1-a589-2d74924d68ad None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:45.099821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-a1aa446f-26e3-43e1-a589-2d74924d68ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:37:45.099821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:37:45.099821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:37:45.099821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:37:45.099821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:37:45.099821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:37:45.099821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:37:45.099821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:37:45.099821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:37:45.099821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:37:45.099821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:37:45.099821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:37:45.099821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:37:45.099821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:37:45.099821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:37:45.100713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:37:45.100713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:37:45.100713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:37:45.100713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:37:45.100713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:37:45.100713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:37:45.100713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:37:45.100713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:37:45.100713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:37:45.100713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:37:45.100713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:37:45.100713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:37:45.100713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:37:45.100713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:37:45.100713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:37:45.100713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:37:45.100713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:37:45.102067 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:37:45.102067 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:37:45.102067 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:37:45.102067 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:37:45.102067 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 9/18] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:37:45.107445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa446f-26e3-43e1-a589-2d74924d68ad None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:45.113260 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488f439-4e0e-4d99-9b8d-301650972776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:45.114070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488f439-4e0e-4d99-9b8d-301650972776 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:45.114361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488f439-4e0e-4d99-9b8d-301650972776 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:45.114698 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488f439-4e0e-4d99-9b8d-301650972776 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:45.115897 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488f439-4e0e-4d99-9b8d-301650972776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:45.118040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488f439-4e0e-4d99-9b8d-301650972776 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:45.119668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 10/19] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:37:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:37:45.125403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488f439-4e0e-4d99-9b8d-301650972776 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:45.165387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:45.213181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:45.217286 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa446f-26e3-43e1-a589-2d74924d68ad None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:45.243070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488f439-4e0e-4d99-9b8d-301650972776 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:45.255875 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ba9ee-a131-4193-96a9-aa1bb8d82e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:45.256550 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ba9ee-a131-4193-96a9-aa1bb8d82e53 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:45.256843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ba9ee-a131-4193-96a9-aa1bb8d82e53 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:45.257129 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ba9ee-a131-4193-96a9-aa1bb8d82e53 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:45.258498 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ba9ee-a131-4193-96a9-aa1bb8d82e53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:37:45.259130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ba9ee-a131-4193-96a9-aa1bb8d82e53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:45.260302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ba9ee-a131-4193-96a9-aa1bb8d82e53 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:45.277831 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 10/20] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:37:45.283607 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4713d-dc70-4918-93fe-18eb14af3d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:45.284290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4713d-dc70-4918-93fe-18eb14af3d2d None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:45.284577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4713d-dc70-4918-93fe-18eb14af3d2d None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:45.284858 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4713d-dc70-4918-93fe-18eb14af3d2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:45.285750 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4713d-dc70-4918-93fe-18eb14af3d2d None admin] RBAC: Adding query filter params (role.id=76bd0cf7bf094e4fa3db121b96215004, scope.domain.id=default, user.id=d83e81b5c7054c4491fc17ac780d3cea) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:37:45.286066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4713d-dc70-4918-93fe-18eb14af3d2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:45.287576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4713d-dc70-4918-93fe-18eb14af3d2d None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:45.295526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 11/21] 10.222.0.13 () {56 vars in 1322 bytes} [Thu Jun 23 19:37:45 2022] GET /identity/v3/role_assignments?user.id=d83e81b5c7054c4491fc17ac780d3cea&scope.domain.id=default&role.id=76bd0cf7bf094e4fa3db121b96215004 => generated 233 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:37:47.648470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195d4ab-cd69-4f1e-917f-89ee3e796727 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:47.649038 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195d4ab-cd69-4f1e-917f-89ee3e796727 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:47.649114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195d4ab-cd69-4f1e-917f-89ee3e796727 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:47.650620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 11/22] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:37:47.656166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075469d0-9473-480e-93ee-5ec8066deb69 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:47.657003 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075469d0-9473-480e-93ee-5ec8066deb69 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:47.657548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075469d0-9473-480e-93ee-5ec8066deb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:47.682428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-075469d0-9473-480e-93ee-5ec8066deb69 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:37:47.684059 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-075469d0-9473-480e-93ee-5ec8066deb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:37:47.780135 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 12/23] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:37:47.815631 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195d4ab-cd69-4f1e-917f-89ee3e796727 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:47.965900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195d4ab-cd69-4f1e-917f-89ee3e796727 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:47.986541 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:48.009270 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e517e4-2d30-4121-abae-623b90adda8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:48.010077 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e517e4-2d30-4121-abae-623b90adda8c None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:48.010415 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e517e4-2d30-4121-abae-623b90adda8c None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:48.010703 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e517e4-2d30-4121-abae-623b90adda8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:48.029693 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e517e4-2d30-4121-abae-623b90adda8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:37:48.038708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-67e517e4-2d30-4121-abae-623b90adda8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:37:48.038708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:37:48.038708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:37:48.038708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:37:48.038708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:37:48.038708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:37:48.038708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:37:48.038708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:37:48.038708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:37:48.038708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:37:48.038708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:37:48.038708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:37:48.038708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:37:48.038708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:37:48.038708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:37:48.038708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:37:48.040175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:37:48.040175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:37:48.040175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:37:48.040175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:37:48.040175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:37:48.040175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:37:48.040175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:37:48.040175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:37:48.040175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:37:48.040175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:37:48.040175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:37:48.040175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:37:48.040175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:37:48.040175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:37:48.040175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:37:48.040175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:37:48.040936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:37:48.040936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:37:48.040936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:37:48.040936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:37:48.040936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:37:48.040936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:37:48.040936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:37:48.040936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:37:48.040936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:37:48.040936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:37:48.040936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:37:48.040936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:37:48.040936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 12/24] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:37:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:37:48.047025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075469d0-9473-480e-93ee-5ec8066deb69 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:48.143495 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4fd59-adec-4852-a98b-b2b583aed331 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:48.143782 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4fd59-adec-4852-a98b-b2b583aed331 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:48.144069 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4fd59-adec-4852-a98b-b2b583aed331 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:48.145958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 13/25] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:37:48.150843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c552da-923d-4e38-bf65-7c11558a47c5 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:48.151372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c552da-923d-4e38-bf65-7c11558a47c5 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:48.151897 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c552da-923d-4e38-bf65-7c11558a47c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:48.170502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-d0c552da-923d-4e38-bf65-7c11558a47c5 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:37:48.172141 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d0c552da-923d-4e38-bf65-7c11558a47c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:37:48.187089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:48.245545 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075469d0-9473-480e-93ee-5ec8066deb69 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:48.253993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 14/26] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:37:48.255610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9a8d9-d18f-4560-a82a-d53680dc94c7 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:48.256100 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9a8d9-d18f-4560-a82a-d53680dc94c7 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:48.256596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9a8d9-d18f-4560-a82a-d53680dc94c7 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:48.262340 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 15/27] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:37:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:37:48.267674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ea918-9765-45de-ab9a-01f7fff50034 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:48.268190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ea918-9765-45de-ab9a-01f7fff50034 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:48.268686 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ea918-9765-45de-ab9a-01f7fff50034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:48.292438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-f82ea918-9765-45de-ab9a-01f7fff50034 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:37:48.294097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f82ea918-9765-45de-ab9a-01f7fff50034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:37:48.310551 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ad5c7-e0c0-4ca4-a8b8-1d44c6e468ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:48.311261 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ad5c7-e0c0-4ca4-a8b8-1d44c6e468ee None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:48.311835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ad5c7-e0c0-4ca4-a8b8-1d44c6e468ee None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:48.311961 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ad5c7-e0c0-4ca4-a8b8-1d44c6e468ee None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:48.312658 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ad5c7-e0c0-4ca4-a8b8-1d44c6e468ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:37:48.312976 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ad5c7-e0c0-4ca4-a8b8-1d44c6e468ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:48.314398 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ad5c7-e0c0-4ca4-a8b8-1d44c6e468ee None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:48.326336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 13/28] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:37:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:37:48.327760 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9e7f9-0218-45cc-ad09-86424015ed8f None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:48.328039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9e7f9-0218-45cc-ad09-86424015ed8f None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:48.328383 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9e7f9-0218-45cc-ad09-86424015ed8f None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:48.329744 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 14/29] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:37:48.330435 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9e7f9-0218-45cc-ad09-86424015ed8f None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:48.371657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 16/30] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:37:48.372828 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ea918-9765-45de-ab9a-01f7fff50034 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:48.411421 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:48.464576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9e7f9-0218-45cc-ad09-86424015ed8f None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:48.483473 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ea918-9765-45de-ab9a-01f7fff50034 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:48.503020 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d82ee8-d076-4ecb-b18f-05b73d26a5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:48.503992 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d82ee8-d076-4ecb-b18f-05b73d26a5a4 None admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:48.504459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d82ee8-d076-4ecb-b18f-05b73d26a5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:48.504970 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d82ee8-d076-4ecb-b18f-05b73d26a5a4 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:48.506052 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d82ee8-d076-4ecb-b18f-05b73d26a5a4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:48.508205 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d82ee8-d076-4ecb-b18f-05b73d26a5a4 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:48.514150 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:48.524205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88375c83-a081-43ae-b1ba-528ddb28b45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:48.525082 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88375c83-a081-43ae-b1ba-528ddb28b45c None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:48.525400 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88375c83-a081-43ae-b1ba-528ddb28b45c None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:48.525680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88375c83-a081-43ae-b1ba-528ddb28b45c None admin] PATH_INFO: `/v3/users/d83e81b5c7054c4491fc17ac780d3cea` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:48.527218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88375c83-a081-43ae-b1ba-528ddb28b45c None admin] RBAC: Authorizing `identity:get_user(user_id=d83e81b5c7054c4491fc17ac780d3cea)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:48.528679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88375c83-a081-43ae-b1ba-528ddb28b45c None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:48.530647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 17/31] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:37:48 2022] GET /identity/v3/users/d83e81b5c7054c4491fc17ac780d3cea => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:37:48.533220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715a7b-49f8-42e8-a500-bacd16983217 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:48.533220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715a7b-49f8-42e8-a500-bacd16983217 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:48.533220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715a7b-49f8-42e8-a500-bacd16983217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:48.550553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-d6715a7b-49f8-42e8-a500-bacd16983217 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:37:48.551905 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d6715a7b-49f8-42e8-a500-bacd16983217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:37:48.629282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 18/32] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:37:48.629282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6715a7b-49f8-42e8-a500-bacd16983217 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:48.676619 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:48.746811 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 15/33] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Jun 23 19:37:48 2022] POST /identity/v3/roles => generated 225 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:37:48.748397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d82ee8-d076-4ecb-b18f-05b73d26a5a4 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:48.749227 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6715a7b-49f8-42e8-a500-bacd16983217 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:48.792723 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80820a-08fb-4045-97ab-5b9c03eb68ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:48.793719 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80820a-08fb-4045-97ab-5b9c03eb68ba None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:48.794479 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80820a-08fb-4045-97ab-5b9c03eb68ba None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:48.794479 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80820a-08fb-4045-97ab-5b9c03eb68ba None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:48.795440 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80820a-08fb-4045-97ab-5b9c03eb68ba None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:48.797082 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80820a-08fb-4045-97ab-5b9c03eb68ba None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:48.870028 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d82ee8-d076-4ecb-b18f-05b73d26a5a4 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:48.917799 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d1839-9f94-4723-bb7f-9b16e9793d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:48.919152 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d1839-9f94-4723-bb7f-9b16e9793d54 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:48.919665 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d1839-9f94-4723-bb7f-9b16e9793d54 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:48.920167 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d1839-9f94-4723-bb7f-9b16e9793d54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:48.921850 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d1839-9f94-4723-bb7f-9b16e9793d54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:48.923735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d1839-9f94-4723-bb7f-9b16e9793d54 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:48.925765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 16/34] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:37:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:37:48.926894 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d1839-9f94-4723-bb7f-9b16e9793d54 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:49.009800 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:49.010756 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 19/35] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Jun 23 19:37:48 2022] POST /identity/v3/roles => generated 219 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:37:49.012150 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723324b9-abdc-4c8a-b2e6-b167fda34aac None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:49.012446 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723324b9-abdc-4c8a-b2e6-b167fda34aac None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:49.012728 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723324b9-abdc-4c8a-b2e6-b167fda34aac None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:49.018733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 20/36] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:37:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:37:49.024215 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723324b9-abdc-4c8a-b2e6-b167fda34aac None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:49.067454 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d1839-9f94-4723-bb7f-9b16e9793d54 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:49.107642 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d9c15-38be-4f1a-a1d0-0c7cdb095d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:49.108466 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d9c15-38be-4f1a-a1d0-0c7cdb095d7e None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:49.108758 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d9c15-38be-4f1a-a1d0-0c7cdb095d7e None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:49.109045 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d9c15-38be-4f1a-a1d0-0c7cdb095d7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:49.122313 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d9c15-38be-4f1a-a1d0-0c7cdb095d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:49.123970 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d9c15-38be-4f1a-a1d0-0c7cdb095d7e None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:49.144906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-694d9c15-38be-4f1a-a1d0-0c7cdb095d7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:37:49.144906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:37:49.144906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:37:49.144906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:37:49.144906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:37:49.144906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:37:49.144906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:37:49.144906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:37:49.144906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:37:49.144906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:37:49.144906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:37:49.144906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:37:49.144906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:37:49.144906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:37:49.144906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:37:49.146076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:37:49.146076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:37:49.146076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:37:49.146076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:37:49.146076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:37:49.146076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:37:49.146076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:37:49.146076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:37:49.146076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:37:49.146076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:37:49.146076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:37:49.146076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:37:49.146076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:37:49.146076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:37:49.146076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:37:49.146076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:37:49.146076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:37:49.146950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:37:49.146950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:37:49.146950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:37:49.146950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:37:49.152566 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 17/37] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:37:49.153770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:49.155538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d5ca5-bc34-41ad-9c48-957415e1659a None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:49.155990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d5ca5-bc34-41ad-9c48-957415e1659a None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:49.156443 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d5ca5-bc34-41ad-9c48-957415e1659a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:49.162084 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723324b9-abdc-4c8a-b2e6-b167fda34aac None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:49.175418 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-212d5ca5-bc34-41ad-9c48-957415e1659a None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:37:49.177066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-212d5ca5-bc34-41ad-9c48-957415e1659a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:37:49.201540 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3de3c-7b72-46b3-8913-3dc80ef2ddf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:49.202494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3de3c-7b72-46b3-8913-3dc80ef2ddf2 None admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:49.202809 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3de3c-7b72-46b3-8913-3dc80ef2ddf2 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:49.203092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3de3c-7b72-46b3-8913-3dc80ef2ddf2 None admin] PATH_INFO: `/v3/domains/default/users/d83e81b5c7054c4491fc17ac780d3cea/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:49.205622 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3de3c-7b72-46b3-8913-3dc80ef2ddf2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d83e81b5c7054c4491fc17ac780d3cea, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:49.207421 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3de3c-7b72-46b3-8913-3dc80ef2ddf2 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:49.258836 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 18/38] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:37:49.259788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d5ca5-bc34-41ad-9c48-957415e1659a None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:49.295087 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 21/39] 10.222.0.13 () {58 vars in 1361 bytes} [Thu Jun 23 19:37:49 2022] PUT /identity/v3/domains/default/users/d83e81b5c7054c4491fc17ac780d3cea/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:37:49.296023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3de3c-7b72-46b3-8913-3dc80ef2ddf2 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:49.312043 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:49.372784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d5ca5-bc34-41ad-9c48-957415e1659a None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:49.410553 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77fde6-731e-4dcb-b500-7b9de9258446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:49.411235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77fde6-731e-4dcb-b500-7b9de9258446 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:49.411521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77fde6-731e-4dcb-b500-7b9de9258446 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:49.411801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77fde6-731e-4dcb-b500-7b9de9258446 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:49.412549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77fde6-731e-4dcb-b500-7b9de9258446 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:37:49.412859 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77fde6-731e-4dcb-b500-7b9de9258446 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:49.414878 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77fde6-731e-4dcb-b500-7b9de9258446 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:49.423533 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3de3c-7b72-46b3-8913-3dc80ef2ddf2 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:49.433893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 19/40] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:37:49.435170 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0c945-f3e5-422f-a273-31025bcedd15 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:49.435462 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0c945-f3e5-422f-a273-31025bcedd15 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:49.435745 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0c945-f3e5-422f-a273-31025bcedd15 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:49.437259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 20/41] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:37:49.441242 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0c945-f3e5-422f-a273-31025bcedd15 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:49.467969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32c2d4-bd22-4922-9c70-786df2f3f4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:49.469022 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32c2d4-bd22-4922-9c70-786df2f3f4d4 None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:49.469343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32c2d4-bd22-4922-9c70-786df2f3f4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:49.469626 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32c2d4-bd22-4922-9c70-786df2f3f4d4 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:49.470995 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32c2d4-bd22-4922-9c70-786df2f3f4d4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:49.471775 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32c2d4-bd22-4922-9c70-786df2f3f4d4 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:49.528033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Jun 23 19:37:49 2022] POST /identity/v3/roles => generated 223 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:37:49.529721 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c0207-e95a-450d-a785-e3f29747058a None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:49.530899 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c0207-e95a-450d-a785-e3f29747058a None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:49.531393 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c0207-e95a-450d-a785-e3f29747058a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:49.560786 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-ca4c0207-e95a-450d-a785-e3f29747058a None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:37:49.562197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0c945-f3e5-422f-a273-31025bcedd15 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:49.562916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ca4c0207-e95a-450d-a785-e3f29747058a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:37:49.573063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:49.582695 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:49.605338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048b01f-d2f6-4698-a4e0-291c2187f827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:49.606179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048b01f-d2f6-4698-a4e0-291c2187f827 None admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:49.606544 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048b01f-d2f6-4698-a4e0-291c2187f827 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:49.606832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048b01f-d2f6-4698-a4e0-291c2187f827 None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:49.607757 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048b01f-d2f6-4698-a4e0-291c2187f827 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:49.609412 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048b01f-d2f6-4698-a4e0-291c2187f827 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:49.667127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 23/43] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:37:49.692510 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c0207-e95a-450d-a785-e3f29747058a None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:49.809384 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c0207-e95a-450d-a785-e3f29747058a None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:49.843345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98821b8-a115-4a46-82cd-a01e9d7f8834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:49.844138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98821b8-a115-4a46-82cd-a01e9d7f8834 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:49.844428 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98821b8-a115-4a46-82cd-a01e9d7f8834 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:49.844711 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98821b8-a115-4a46-82cd-a01e9d7f8834 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:49.845948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98821b8-a115-4a46-82cd-a01e9d7f8834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:49.847398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98821b8-a115-4a46-82cd-a01e9d7f8834 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:49.849786 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 24/44] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:37:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:37:49.854731 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98821b8-a115-4a46-82cd-a01e9d7f8834 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:49.869813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:49.886449 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 21/45] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 19:37:49 2022] POST /identity/v3/projects => generated 301 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:37:49.975633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98821b8-a115-4a46-82cd-a01e9d7f8834 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:50.014227 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ebe7f-8105-48a7-a012-cc94a7d5e42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:50.015223 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ebe7f-8105-48a7-a012-cc94a7d5e42e None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:50.015690 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ebe7f-8105-48a7-a012-cc94a7d5e42e None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:50.016152 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ebe7f-8105-48a7-a012-cc94a7d5e42e None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:50.017064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ebe7f-8105-48a7-a012-cc94a7d5e42e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:50.018737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ebe7f-8105-48a7-a012-cc94a7d5e42e None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:50.110447 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 25/46] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 19:37:49 2022] POST /identity/v3/projects => generated 312 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:37:51.394755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4a656-fb90-4c86-b2ec-3a1658dac955 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:51.395255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4a656-fb90-4c86-b2ec-3a1658dac955 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:51.395358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4a656-fb90-4c86-b2ec-3a1658dac955 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:51.396704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 22/47] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:37:51.402006 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44763c4d-6b8b-4b36-a4fe-14a5bccfbf2e None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:51.402420 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44763c4d-6b8b-4b36-a4fe-14a5bccfbf2e None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:51.402585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44763c4d-6b8b-4b36-a4fe-14a5bccfbf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:51.419177 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-44763c4d-6b8b-4b36-a4fe-14a5bccfbf2e None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:37:51.420367 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-44763c4d-6b8b-4b36-a4fe-14a5bccfbf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:37:51.479142 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:51.487157 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 26/48] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:37:51.518657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4a656-fb90-4c86-b2ec-3a1658dac955 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:51.620366 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4a656-fb90-4c86-b2ec-3a1658dac955 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:51.652958 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb5367-edcc-435c-8f39-ddd8a74c27dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:51.653713 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb5367-edcc-435c-8f39-ddd8a74c27dd None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:51.654006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb5367-edcc-435c-8f39-ddd8a74c27dd None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:51.654289 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb5367-edcc-435c-8f39-ddd8a74c27dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:51.664692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb5367-edcc-435c-8f39-ddd8a74c27dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:37:51.672334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-3adb5367-edcc-435c-8f39-ddd8a74c27dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:37:51.672334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:37:51.672334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:37:51.672334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:37:51.672334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:37:51.672334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:37:51.672334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:37:51.672334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:37:51.672334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:37:51.672334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:37:51.672334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:37:51.672334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:37:51.672334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:37:51.672334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:37:51.672334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:37:51.672334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:37:51.673360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:37:51.673360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:37:51.673360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:37:51.673360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:37:51.673360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:37:51.673360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:37:51.673360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:37:51.673360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:37:51.673360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:37:51.673360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:37:51.673360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:37:51.673360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:37:51.673360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:37:51.673360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:37:51.673360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:37:51.673360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:37:51.674365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:37:51.674365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:37:51.674365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:37:51.674365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:37:51.674365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:37:51.674365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:37:51.674365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:37:51.674365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:37:51.674365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:37:51.674365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:37:51.674365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:37:51.674365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:37:51.674365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 23/49] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:37:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:37:51.681609 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44763c4d-6b8b-4b36-a4fe-14a5bccfbf2e None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:51.779224 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44763c4d-6b8b-4b36-a4fe-14a5bccfbf2e None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:51.812633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf1606-e2e8-4152-baa0-b2e313e04c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:51.813342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf1606-e2e8-4152-baa0-b2e313e04c09 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:51.813636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf1606-e2e8-4152-baa0-b2e313e04c09 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:51.813921 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf1606-e2e8-4152-baa0-b2e313e04c09 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:51.814685 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf1606-e2e8-4152-baa0-b2e313e04c09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:37:51.817109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf1606-e2e8-4152-baa0-b2e313e04c09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:51.817109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf1606-e2e8-4152-baa0-b2e313e04c09 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:51.829577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 27/50] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:37:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:37:51.834881 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb5367-edcc-435c-8f39-ddd8a74c27dd None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:51.855919 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:51.946439 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb5367-edcc-435c-8f39-ddd8a74c27dd None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:51.979509 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb3449-d460-4c89-b752-aa65f4276734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:51.980383 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb3449-d460-4c89-b752-aa65f4276734 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:51.980669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb3449-d460-4c89-b752-aa65f4276734 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:51.980950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb3449-d460-4c89-b752-aa65f4276734 None admin] PATH_INFO: `/v3/users/d83e81b5c7054c4491fc17ac780d3cea` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:51.982165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb3449-d460-4c89-b752-aa65f4276734 None admin] RBAC: Authorizing `identity:get_user(user_id=d83e81b5c7054c4491fc17ac780d3cea)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:51.983617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb3449-d460-4c89-b752-aa65f4276734 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:51.985262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 24/51] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:37:51 2022] GET /identity/v3/users/d83e81b5c7054c4491fc17ac780d3cea => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:37:51.990585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf1606-e2e8-4152-baa0-b2e313e04c09 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:52.046332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:52.089665 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf1606-e2e8-4152-baa0-b2e313e04c09 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:52.153681 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a3e8f-35b7-4692-ad77-f525ca203ef5 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:52.154077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a3e8f-35b7-4692-ad77-f525ca203ef5 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:52.154364 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a3e8f-35b7-4692-ad77-f525ca203ef5 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:52.155939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 25/52] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:37:52.161510 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac8c57-01fd-4cd7-9dbb-a5e7c0b92276 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:52.161801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac8c57-01fd-4cd7-9dbb-a5e7c0b92276 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:52.162086 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac8c57-01fd-4cd7-9dbb-a5e7c0b92276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:52.181710 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-a2ac8c57-01fd-4cd7-9dbb-a5e7c0b92276 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:37:52.182957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-a2ac8c57-01fd-4cd7-9dbb-a5e7c0b92276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:37:52.235219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65518f9-885c-407b-bd44-fff605d8ab4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:52.235918 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65518f9-885c-407b-bd44-fff605d8ab4b None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:52.236202 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65518f9-885c-407b-bd44-fff605d8ab4b None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:52.236478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65518f9-885c-407b-bd44-fff605d8ab4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:52.237688 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65518f9-885c-407b-bd44-fff605d8ab4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:52.239128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65518f9-885c-407b-bd44-fff605d8ab4b None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:52.240743 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 28/53] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:37:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:37:52.246800 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65518f9-885c-407b-bd44-fff605d8ab4b None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:52.259975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 26/54] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:37:52.282956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac8c57-01fd-4cd7-9dbb-a5e7c0b92276 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:52.299724 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:52.347065 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65518f9-885c-407b-bd44-fff605d8ab4b None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:52.370389 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:52.381032 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778e8ba-b7f8-4869-a6f3-7b7ff5478598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:52.381728 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778e8ba-b7f8-4869-a6f3-7b7ff5478598 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:52.382015 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778e8ba-b7f8-4869-a6f3-7b7ff5478598 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:52.382296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778e8ba-b7f8-4869-a6f3-7b7ff5478598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:52.383236 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac8c57-01fd-4cd7-9dbb-a5e7c0b92276 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:52.383663 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778e8ba-b7f8-4869-a6f3-7b7ff5478598 None admin] RBAC: Adding query filter params (role.id=76bd0cf7bf094e4fa3db121b96215004, scope.domain.id=default, user.id=d83e81b5c7054c4491fc17ac780d3cea) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:37:52.383984 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778e8ba-b7f8-4869-a6f3-7b7ff5478598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:52.385446 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778e8ba-b7f8-4869-a6f3-7b7ff5478598 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:52.393642 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 29/55] 10.222.0.13 () {56 vars in 1322 bytes} [Thu Jun 23 19:37:52 2022] GET /identity/v3/role_assignments?user.id=d83e81b5c7054c4491fc17ac780d3cea&scope.domain.id=default&role.id=76bd0cf7bf094e4fa3db121b96215004 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:37:52.419463 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7406e-71b9-48a3-8110-b458264439fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:52.420288 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7406e-71b9-48a3-8110-b458264439fd None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:52.420575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7406e-71b9-48a3-8110-b458264439fd None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:52.420854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7406e-71b9-48a3-8110-b458264439fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:52.422158 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7406e-71b9-48a3-8110-b458264439fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:52.423673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7406e-71b9-48a3-8110-b458264439fd None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:52.425416 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 27/56] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:37:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:37:52.432096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778e8ba-b7f8-4869-a6f3-7b7ff5478598 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:52.536548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778e8ba-b7f8-4869-a6f3-7b7ff5478598 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:52.573123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca4340-2bf7-485d-b1cd-e35ba3c325da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:52.573823 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca4340-2bf7-485d-b1cd-e35ba3c325da None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:52.574104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca4340-2bf7-485d-b1cd-e35ba3c325da None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:52.574394 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca4340-2bf7-485d-b1cd-e35ba3c325da None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:52.575121 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca4340-2bf7-485d-b1cd-e35ba3c325da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:52.576618 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca4340-2bf7-485d-b1cd-e35ba3c325da None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:52.681592 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 30/57] 10.222.0.13 () {60 vars in 1140 bytes} [Thu Jun 23 19:37:52 2022] POST /identity/v3/projects => generated 298 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:37:54.715031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543cdc1-a2a8-4351-add1-48ae4b50c07a None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:54.715572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543cdc1-a2a8-4351-add1-48ae4b50c07a None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:54.715572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543cdc1-a2a8-4351-add1-48ae4b50c07a None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:54.716988 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 28/58] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:37:54.722064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedd679-283d-4c73-addc-151ce27cb461 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:54.722463 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedd679-283d-4c73-addc-151ce27cb461 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:54.722641 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedd679-283d-4c73-addc-151ce27cb461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:54.738979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-3cedd679-283d-4c73-addc-151ce27cb461 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:37:54.740184 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-3cedd679-283d-4c73-addc-151ce27cb461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:37:54.773035 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:54.804434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 31/59] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:37:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:37:54.829342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543cdc1-a2a8-4351-add1-48ae4b50c07a None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:54.916113 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:54.932371 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543cdc1-a2a8-4351-add1-48ae4b50c07a None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:54.967622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23809886-8a79-4c61-bdfe-ff1c140851eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:54.968311 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23809886-8a79-4c61-bdfe-ff1c140851eb None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:54.968596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23809886-8a79-4c61-bdfe-ff1c140851eb None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:54.968870 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23809886-8a79-4c61-bdfe-ff1c140851eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:54.970068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23809886-8a79-4c61-bdfe-ff1c140851eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:54.971516 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23809886-8a79-4c61-bdfe-ff1c140851eb None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:54.973104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 29/60] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:37:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:37:54.978986 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedd679-283d-4c73-addc-151ce27cb461 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:55.075103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedd679-283d-4c73-addc-151ce27cb461 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:55.108402 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293979aa-6800-4793-ab4e-d32ed78cf1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:55.109072 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293979aa-6800-4793-ab4e-d32ed78cf1bf None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:55.109393 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293979aa-6800-4793-ab4e-d32ed78cf1bf None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:55.109679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293979aa-6800-4793-ab4e-d32ed78cf1bf None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:55.110403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293979aa-6800-4793-ab4e-d32ed78cf1bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:55.111863 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293979aa-6800-4793-ab4e-d32ed78cf1bf None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:55.193924 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 32/61] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 19:37:54 2022] POST /identity/v3/users => generated 275 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:37:58.307008 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3ef13-e8f7-496e-a565-377234a68541 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:58.307008 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3ef13-e8f7-496e-a565-377234a68541 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:58.307008 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3ef13-e8f7-496e-a565-377234a68541 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:58.307008 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 30/62] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:37:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:37:58.312123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1f4da-e069-40da-b8a2-093d7703e7fd None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:58.312864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1f4da-e069-40da-b8a2-093d7703e7fd None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:58.313337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1f4da-e069-40da-b8a2-093d7703e7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:58.332021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f42604-90ea-4b11-8784-1a29a5a76213 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:58.332308 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-98e1f4da-e069-40da-b8a2-093d7703e7fd None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:37:58.332805 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f42604-90ea-4b11-8784-1a29a5a76213 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:58.333319 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f42604-90ea-4b11-8784-1a29a5a76213 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:58.333509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-98e1f4da-e069-40da-b8a2-093d7703e7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:37:58.335051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:37:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:37:58.340672 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e8533-70b8-4cc3-b8ff-587afbd61af5 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:58.341256 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e8533-70b8-4cc3-b8ff-587afbd61af5 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:58.341756 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e8533-70b8-4cc3-b8ff-587afbd61af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:58.355395 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:58.360216 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-d06e8533-70b8-4cc3-b8ff-587afbd61af5 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:37:58.361662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d06e8533-70b8-4cc3-b8ff-587afbd61af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:37:58.437577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 32/64] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:37:58.465059 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e8533-70b8-4cc3-b8ff-587afbd61af5 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:58.487505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 33/65] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:37:58.520695 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1f4da-e069-40da-b8a2-093d7703e7fd None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:58.561619 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:58.582773 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e8533-70b8-4cc3-b8ff-587afbd61af5 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:58.620589 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755403d6-dd46-4aa8-bbce-13b996611871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:58.621840 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755403d6-dd46-4aa8-bbce-13b996611871 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:58.623231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755403d6-dd46-4aa8-bbce-13b996611871 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:58.623700 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755403d6-dd46-4aa8-bbce-13b996611871 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:58.635386 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755403d6-dd46-4aa8-bbce-13b996611871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:37:58.646403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-755403d6-dd46-4aa8-bbce-13b996611871 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:37:58.646403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:37:58.646403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:37:58.646403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:37:58.646403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:37:58.646403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:37:58.646403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:37:58.646403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:37:58.646403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:37:58.646403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:37:58.646403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:37:58.646403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:37:58.646403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:37:58.646403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:37:58.646403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:37:58.646403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:37:58.647219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:37:58.647219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:37:58.647219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:37:58.647219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:37:58.647219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:37:58.647219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:37:58.647219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:37:58.647219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:37:58.647219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:37:58.647219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:37:58.647219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:37:58.647219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:37:58.647219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:37:58.647219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:37:58.647219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:37:58.647219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:37:58.647993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:37:58.647993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:37:58.647993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:37:58.647993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:37:58.647993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:37:58.647993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:37:58.647993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:37:58.647993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:37:58.647993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:37:58.647993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:37:58.647993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:37:58.647993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:37:58.650688 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 33/66] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:37:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:37:58.655476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7203e-338c-4210-a2b7-de49bd94c4b4 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:58.655476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7203e-338c-4210-a2b7-de49bd94c4b4 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:58.655476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7203e-338c-4210-a2b7-de49bd94c4b4 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:58.655476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 34/67] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:37:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:37:58.659514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7203e-338c-4210-a2b7-de49bd94c4b4 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:58.709468 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1f4da-e069-40da-b8a2-093d7703e7fd None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:58.752413 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed520b-fdc9-49ed-83c3-29efda771c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:58.753257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed520b-fdc9-49ed-83c3-29efda771c00 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:58.753545 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed520b-fdc9-49ed-83c3-29efda771c00 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:58.753827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed520b-fdc9-49ed-83c3-29efda771c00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:58.768059 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed520b-fdc9-49ed-83c3-29efda771c00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:37:58.778467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-09ed520b-fdc9-49ed-83c3-29efda771c00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:37:58.778467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:37:58.778467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:37:58.778467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:37:58.778467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:37:58.778467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:37:58.778467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:37:58.778467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:37:58.778467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:37:58.778467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:37:58.778467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:37:58.778467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:37:58.778467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:37:58.778467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:37:58.778467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:37:58.778467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:37:58.779338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:37:58.779338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:37:58.779338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:37:58.779338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:37:58.779338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:37:58.779338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:37:58.779338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:37:58.779338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:37:58.779338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:37:58.779338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:37:58.779338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:37:58.779338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:37:58.779338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:37:58.779338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:37:58.779338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:37:58.779338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:37:58.780119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:37:58.780119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:37:58.780119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:37:58.780119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:37:58.780119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:37:58.780119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:37:58.780119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:37:58.780119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:37:58.780119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:37:58.780119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:37:58.780119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:37:58.780119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:37:58.780687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 34/68] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:37:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:37:58.782057 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88c50b-b541-4222-955f-249fa10f3a03 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:58.783972 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88c50b-b541-4222-955f-249fa10f3a03 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:58.783972 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88c50b-b541-4222-955f-249fa10f3a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:58.788310 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7203e-338c-4210-a2b7-de49bd94c4b4 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:58.802308 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-5e88c50b-b541-4222-955f-249fa10f3a03 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:37:58.803625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-5e88c50b-b541-4222-955f-249fa10f3a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:37:58.818533 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:58.833239 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3145dbb-0e41-4841-9cc9-60238d47b478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:58.833999 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3145dbb-0e41-4841-9cc9-60238d47b478 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:58.834441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3145dbb-0e41-4841-9cc9-60238d47b478 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:58.834739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3145dbb-0e41-4841-9cc9-60238d47b478 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:58.835874 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3145dbb-0e41-4841-9cc9-60238d47b478 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:37:58.836467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3145dbb-0e41-4841-9cc9-60238d47b478 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:58.838133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3145dbb-0e41-4841-9cc9-60238d47b478 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:58.850166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 35/69] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:37:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:37:58.851082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3145dbb-0e41-4841-9cc9-60238d47b478 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:58.855456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:58.894283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 35/70] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:37:58.895299 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88c50b-b541-4222-955f-249fa10f3a03 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:58.994228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3145dbb-0e41-4841-9cc9-60238d47b478 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:59.021729 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88c50b-b541-4222-955f-249fa10f3a03 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:59.031261 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ea5b2-3521-463f-85b7-fd75521c1bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:59.031938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ea5b2-3521-463f-85b7-fd75521c1bcd None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:59.032223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ea5b2-3521-463f-85b7-fd75521c1bcd None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:59.032502 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ea5b2-3521-463f-85b7-fd75521c1bcd None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:59.033285 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ea5b2-3521-463f-85b7-fd75521c1bcd None admin] RBAC: Adding query filter params (name=member) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:37:59.033600 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ea5b2-3521-463f-85b7-fd75521c1bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:59.035018 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ea5b2-3521-463f-85b7-fd75521c1bcd None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:59.048079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 36/71] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:37:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:37:59.048079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ea5b2-3521-463f-85b7-fd75521c1bcd None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:59.063062 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ff704-559f-4406-a06a-581c00a36e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:59.063952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ff704-559f-4406-a06a-581c00a36e2c None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:59.064241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ff704-559f-4406-a06a-581c00a36e2c None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:59.064524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ff704-559f-4406-a06a-581c00a36e2c None admin] PATH_INFO: `/v3/users/d83e81b5c7054c4491fc17ac780d3cea` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:59.065757 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ff704-559f-4406-a06a-581c00a36e2c None admin] RBAC: Authorizing `identity:get_user(user_id=d83e81b5c7054c4491fc17ac780d3cea)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:59.067482 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ff704-559f-4406-a06a-581c00a36e2c None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:59.069214 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 36/72] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:37:58 2022] GET /identity/v3/users/d83e81b5c7054c4491fc17ac780d3cea => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:37:59.070940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d67b8d-12c6-4597-82eb-bd08feab98c8 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:59.071230 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d67b8d-12c6-4597-82eb-bd08feab98c8 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:59.071516 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d67b8d-12c6-4597-82eb-bd08feab98c8 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:59.072901 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 37/73] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:37:59.080218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d67b8d-12c6-4597-82eb-bd08feab98c8 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:59.099620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:59.118282 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:59.151540 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ea5b2-3521-463f-85b7-fd75521c1bcd None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:59.185018 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d4652-6def-4eda-8daf-07d5304ced64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:59.185851 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d4652-6def-4eda-8daf-07d5304ced64 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:59.186140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d4652-6def-4eda-8daf-07d5304ced64 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:59.186424 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d4652-6def-4eda-8daf-07d5304ced64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:59.187389 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d67b8d-12c6-4597-82eb-bd08feab98c8 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:59.199029 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d4652-6def-4eda-8daf-07d5304ced64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:37:59.207298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-685d4652-6def-4eda-8daf-07d5304ced64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:37:59.207298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:37:59.207298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:37:59.207298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:37:59.207298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:37:59.207298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:37:59.207298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:37:59.207298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:37:59.207298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:37:59.207298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:37:59.207298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:37:59.207298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:37:59.207298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:37:59.207298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:37:59.207298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:37:59.207298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:37:59.208127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:37:59.208127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:37:59.208127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:37:59.208127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:37:59.208127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:37:59.208127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:37:59.208127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:37:59.208127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:37:59.208127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:37:59.208127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:37:59.208127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:37:59.208127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:37:59.208127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:37:59.208127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:37:59.208127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:37:59.208127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:37:59.209041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:37:59.209041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:37:59.209041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:37:59.209041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:37:59.209041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:37:59.209041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:37:59.209041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:37:59.209041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:37:59.209041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:37:59.209041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:37:59.209041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:37:59.209041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:37:59.209041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 37/74] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:37:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:37:59.210298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d4652-6def-4eda-8daf-07d5304ced64 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:59.225064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe51852-efe3-4a0e-ac77-74e346366fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:59.225965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe51852-efe3-4a0e-ac77-74e346366fbb None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:59.226275 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe51852-efe3-4a0e-ac77-74e346366fbb None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:59.226784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe51852-efe3-4a0e-ac77-74e346366fbb None admin] PATH_INFO: `/v3/users/c75ee1380a57446ab1c1e588bd5bfa97` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:59.241348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe51852-efe3-4a0e-ac77-74e346366fbb None admin] RBAC: Authorizing `identity:get_user(user_id=c75ee1380a57446ab1c1e588bd5bfa97)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:59.243274 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe51852-efe3-4a0e-ac77-74e346366fbb None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:59.244952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 38/75] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:37:59 2022] GET /identity/v3/users/c75ee1380a57446ab1c1e588bd5bfa97 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:37:59.246218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed92b10-381d-442c-8c24-08537f6fd582 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:59.246509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed92b10-381d-442c-8c24-08537f6fd582 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:59.246788 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed92b10-381d-442c-8c24-08537f6fd582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:59.263134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-aed92b10-381d-442c-8c24-08537f6fd582 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:37:59.264317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-aed92b10-381d-442c-8c24-08537f6fd582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:37:59.314974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d4652-6def-4eda-8daf-07d5304ced64 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:59.334194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 39/76] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:37:59.335431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820d279-7bd3-40cb-9bfc-392ecaafeb63 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:59.336386 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820d279-7bd3-40cb-9bfc-392ecaafeb63 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:59.336900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820d279-7bd3-40cb-9bfc-392ecaafeb63 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:59.338230 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 40/77] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:37:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:37:59.342348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820d279-7bd3-40cb-9bfc-392ecaafeb63 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:59.342762 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:59.349734 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:59.359014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495b959-2e66-4fbf-8446-6155c16da38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:59.359684 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495b959-2e66-4fbf-8446-6155c16da38b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:59.359972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495b959-2e66-4fbf-8446-6155c16da38b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:59.360257 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495b959-2e66-4fbf-8446-6155c16da38b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:59.429068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495b959-2e66-4fbf-8446-6155c16da38b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:59.430817 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495b959-2e66-4fbf-8446-6155c16da38b None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:59.439817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820d279-7bd3-40cb-9bfc-392ecaafeb63 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:59.473478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ed23e-a42d-447a-aca8-d9bf9810cc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:59.474142 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ed23e-a42d-447a-aca8-d9bf9810cc95 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:59.474429 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ed23e-a42d-447a-aca8-d9bf9810cc95 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:59.474709 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ed23e-a42d-447a-aca8-d9bf9810cc95 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:59.475459 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ed23e-a42d-447a-aca8-d9bf9810cc95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:37:59.475766 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ed23e-a42d-447a-aca8-d9bf9810cc95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:59.477749 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ed23e-a42d-447a-aca8-d9bf9810cc95 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:59.485593 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 41/78] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:37:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:37:59.490267 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ed23e-a42d-447a-aca8-d9bf9810cc95 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:59.530584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 38/79] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:37:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:37:59.531719 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2152f-4dcd-41d2-a821-71a59328564b None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:59.532026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2152f-4dcd-41d2-a821-71a59328564b None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:59.532312 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2152f-4dcd-41d2-a821-71a59328564b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:59.549340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-c1d2152f-4dcd-41d2-a821-71a59328564b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:37:59.550085 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c1d2152f-4dcd-41d2-a821-71a59328564b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:37:59.556218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:59.571575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:59.593521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ed23e-a42d-447a-aca8-d9bf9810cc95 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:59.625315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 39/80] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:37:59.626227 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2152f-4dcd-41d2-a821-71a59328564b None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:59.626912 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e10b5-bf33-4881-b4d6-9702d8083676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:59.627568 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e10b5-bf33-4881-b4d6-9702d8083676 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:59.627861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e10b5-bf33-4881-b4d6-9702d8083676 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:59.628147 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e10b5-bf33-4881-b4d6-9702d8083676 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:59.695995 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e10b5-bf33-4881-b4d6-9702d8083676 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:59.697478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e10b5-bf33-4881-b4d6-9702d8083676 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:59.726205 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2152f-4dcd-41d2-a821-71a59328564b None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:59.756828 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:59.760865 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8ef66-1f50-4565-8e56-868c8552e1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:59.761684 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8ef66-1f50-4565-8e56-868c8552e1bd None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:59.761977 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8ef66-1f50-4565-8e56-868c8552e1bd None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:59.762261 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8ef66-1f50-4565-8e56-868c8552e1bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:59.763525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8ef66-1f50-4565-8e56-868c8552e1bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:59.764999 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8ef66-1f50-4565-8e56-868c8552e1bd None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:59.771145 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 40/81] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:37:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:37:59.771145 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8ef66-1f50-4565-8e56-868c8552e1bd None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:59.796141 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:37:59.797128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 42/82] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:37:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:37:59.797994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e10b5-bf33-4881-b4d6-9702d8083676 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:59.872019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8ef66-1f50-4565-8e56-868c8552e1bd None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:59.902735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e10b5-bf33-4881-b4d6-9702d8083676 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:37:59.906437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c08877-a7c1-40b0-ad3b-651cda529706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:59.907342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c08877-a7c1-40b0-ad3b-651cda529706 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:59.907629 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c08877-a7c1-40b0-ad3b-651cda529706 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:59.907905 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c08877-a7c1-40b0-ad3b-651cda529706 None admin] PATH_INFO: `/v3/users/c75ee1380a57446ab1c1e588bd5bfa97` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:59.909100 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c08877-a7c1-40b0-ad3b-651cda529706 None admin] RBAC: Authorizing `identity:get_user(user_id=c75ee1380a57446ab1c1e588bd5bfa97)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:59.910583 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c08877-a7c1-40b0-ad3b-651cda529706 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:59.912414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 41/83] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:37:59 2022] GET /identity/v3/users/c75ee1380a57446ab1c1e588bd5bfa97 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:37:59.913061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c08877-a7c1-40b0-ad3b-651cda529706 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:59.941395 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7f232-5c95-446a-ac7f-e3ff9119c49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:37:59.942513 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7f232-5c95-446a-ac7f-e3ff9119c49f None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:37:59.942802 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7f232-5c95-446a-ac7f-e3ff9119c49f None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:37:59.943083 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7f232-5c95-446a-ac7f-e3ff9119c49f None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:37:59.944272 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7f232-5c95-446a-ac7f-e3ff9119c49f None admin] RBAC: Authorizing `identity:get_project(project_id=deeac7725be842659d93e27cd19f954b)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:37:59.946579 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7f232-5c95-446a-ac7f-e3ff9119c49f None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:37:59.948286 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 43/84] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:37:59 2022] GET /identity/v3/projects/deeac7725be842659d93e27cd19f954b => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:37:59.949026 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7f232-5c95-446a-ac7f-e3ff9119c49f None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:37:59.979754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:00.004430 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:00.013670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c08877-a7c1-40b0-ad3b-651cda529706 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:00.048584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b2002-7a28-4ee0-8824-4c7b3691aa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:00.048776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7f232-5c95-446a-ac7f-e3ff9119c49f None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:00.049400 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b2002-7a28-4ee0-8824-4c7b3691aa3b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:00.049691 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b2002-7a28-4ee0-8824-4c7b3691aa3b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:00.049972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b2002-7a28-4ee0-8824-4c7b3691aa3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:00.060324 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b2002-7a28-4ee0-8824-4c7b3691aa3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:00.068143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-ee7b2002-7a28-4ee0-8824-4c7b3691aa3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:00.068143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:00.068143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:00.068143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:00.068143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:00.068143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:00.068143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:00.068143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:00.068143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:00.068143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:00.068143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:00.068143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:00.068143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:00.068143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:00.068143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:00.068143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:00.069005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:00.069005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:00.069005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:00.069005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:00.069005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:00.069005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:00.069005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:00.069005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:00.069005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:00.069005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:00.069005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:00.069005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:00.069005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:00.069005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:00.069005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:00.069005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:00.069803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:00.069803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:00.069803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:00.069803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:00.069803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:00.069803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:00.069803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:00.069803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:00.069803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:00.069803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:00.069803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:00.069803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:00.069803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 42/85] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:37:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:00.072009 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b2002-7a28-4ee0-8824-4c7b3691aa3b None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:00.083154 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf4282-1e4c-434b-9947-7572e40c3639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:00.083832 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf4282-1e4c-434b-9947-7572e40c3639 None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:00.084127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf4282-1e4c-434b-9947-7572e40c3639 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:00.084411 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf4282-1e4c-434b-9947-7572e40c3639 None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:00.085130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf4282-1e4c-434b-9947-7572e40c3639 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:00.087163 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf4282-1e4c-434b-9947-7572e40c3639 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:00.172733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 44/86] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 19:37:59 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:38:00.172733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf4282-1e4c-434b-9947-7572e40c3639 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:00.178111 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b2002-7a28-4ee0-8824-4c7b3691aa3b None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:00.221439 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98283a1e-fe0f-43a6-91b7-898b27c953af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:00.222334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98283a1e-fe0f-43a6-91b7-898b27c953af None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:00.222675 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98283a1e-fe0f-43a6-91b7-898b27c953af None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:00.222953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98283a1e-fe0f-43a6-91b7-898b27c953af None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:00.224274 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98283a1e-fe0f-43a6-91b7-898b27c953af None admin] RBAC: Authorizing `identity:get_project(project_id=deeac7725be842659d93e27cd19f954b)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:00.225800 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98283a1e-fe0f-43a6-91b7-898b27c953af None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:00.232687 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 43/87] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:00 2022] GET /identity/v3/projects/deeac7725be842659d93e27cd19f954b => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:00.232687 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98283a1e-fe0f-43a6-91b7-898b27c953af None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:00.255433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:00.276393 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:00.290920 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf4282-1e4c-434b-9947-7572e40c3639 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:00.332369 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6a515-4a32-4f80-86ea-72b7b29a7bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:00.333715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6a515-4a32-4f80-86ea-72b7b29a7bd7 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:00.334719 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6a515-4a32-4f80-86ea-72b7b29a7bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:00.334719 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6a515-4a32-4f80-86ea-72b7b29a7bd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:00.348275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98283a1e-fe0f-43a6-91b7-898b27c953af None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:00.389197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea431a34-b928-4f39-a5bc-e3ff7588a93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:00.389390 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea431a34-b928-4f39-a5bc-e3ff7588a93d None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:00.389669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea431a34-b928-4f39-a5bc-e3ff7588a93d None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:00.389957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea431a34-b928-4f39-a5bc-e3ff7588a93d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:00.390834 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea431a34-b928-4f39-a5bc-e3ff7588a93d None admin] RBAC: Adding query filter params (role.id=76bd0cf7bf094e4fa3db121b96215004, scope.project.id=deeac7725be842659d93e27cd19f954b, user.id=d83e81b5c7054c4491fc17ac780d3cea) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:00.391161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea431a34-b928-4f39-a5bc-e3ff7588a93d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:00.392653 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea431a34-b928-4f39-a5bc-e3ff7588a93d None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:00.400468 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 44/88] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:00 2022] GET /identity/v3/role_assignments?user.id=d83e81b5c7054c4491fc17ac780d3cea&scope.project.id=deeac7725be842659d93e27cd19f954b&role.id=76bd0cf7bf094e4fa3db121b96215004 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:00.400799 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea431a34-b928-4f39-a5bc-e3ff7588a93d None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:00.431737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6a515-4a32-4f80-86ea-72b7b29a7bd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:00.433327 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6a515-4a32-4f80-86ea-72b7b29a7bd7 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:00.516525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:00.534948 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea431a34-b928-4f39-a5bc-e3ff7588a93d None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:00.544368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:00.559502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 45/89] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:00.560559 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6a515-4a32-4f80-86ea-72b7b29a7bd7 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:00.582721 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11ac7a-82b9-4b84-b60d-792f06b9ba78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:00.583775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11ac7a-82b9-4b84-b60d-792f06b9ba78 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:00.584266 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11ac7a-82b9-4b84-b60d-792f06b9ba78 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:00.584763 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11ac7a-82b9-4b84-b60d-792f06b9ba78 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:00.586295 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11ac7a-82b9-4b84-b60d-792f06b9ba78 None admin] RBAC: Adding query filter params (name=member) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:00.586810 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11ac7a-82b9-4b84-b60d-792f06b9ba78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:00.588466 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11ac7a-82b9-4b84-b60d-792f06b9ba78 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:00.597791 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 45/90] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:00.598925 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11ac7a-82b9-4b84-b60d-792f06b9ba78 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:00.688936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6a515-4a32-4f80-86ea-72b7b29a7bd7 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:00.721308 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11ac7a-82b9-4b84-b60d-792f06b9ba78 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:00.749607 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986303e0-fd4b-4f01-9d83-b8a4f7daf575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:00.750616 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986303e0-fd4b-4f01-9d83-b8a4f7daf575 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:00.751126 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986303e0-fd4b-4f01-9d83-b8a4f7daf575 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:00.751604 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986303e0-fd4b-4f01-9d83-b8a4f7daf575 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:00.752655 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986303e0-fd4b-4f01-9d83-b8a4f7daf575 None admin] RBAC: Adding query filter params (role.id=61895d866a7c44de8924486b8e5ec6e8, scope.project.id=deeac7725be842659d93e27cd19f954b, user.id=c75ee1380a57446ab1c1e588bd5bfa97) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:00.753189 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986303e0-fd4b-4f01-9d83-b8a4f7daf575 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:00.755873 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986303e0-fd4b-4f01-9d83-b8a4f7daf575 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:00.767961 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 46/91] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:00 2022] GET /identity/v3/role_assignments?user.id=c75ee1380a57446ab1c1e588bd5bfa97&scope.project.id=deeac7725be842659d93e27cd19f954b&role.id=61895d866a7c44de8924486b8e5ec6e8 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:00.771632 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986303e0-fd4b-4f01-9d83-b8a4f7daf575 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:00.793320 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb17537-3a54-4482-a2b7-9b469fd523ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:00.794593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb17537-3a54-4482-a2b7-9b469fd523ee None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:00.795116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb17537-3a54-4482-a2b7-9b469fd523ee None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:00.795628 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb17537-3a54-4482-a2b7-9b469fd523ee None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:00.801465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb17537-3a54-4482-a2b7-9b469fd523ee None admin] RBAC: Authorizing `identity:get_project(project_id=deeac7725be842659d93e27cd19f954b)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:00.803404 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb17537-3a54-4482-a2b7-9b469fd523ee None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:00.805598 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 46/92] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:00 2022] GET /identity/v3/projects/deeac7725be842659d93e27cd19f954b => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:00.814247 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb17537-3a54-4482-a2b7-9b469fd523ee None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:00.839349 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:00.955424 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:00.988558 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb17537-3a54-4482-a2b7-9b469fd523ee None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:01.029474 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54496c67-d437-42e5-9e40-408059261f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:01.030253 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54496c67-d437-42e5-9e40-408059261f80 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:01.030549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54496c67-d437-42e5-9e40-408059261f80 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:01.030861 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54496c67-d437-42e5-9e40-408059261f80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:01.031679 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54496c67-d437-42e5-9e40-408059261f80 None admin] RBAC: Adding query filter params (role.id=f0bb7fa65c8545699b60f857f930b078, scope.project.id=deeac7725be842659d93e27cd19f954b, user.id=c75ee1380a57446ab1c1e588bd5bfa97) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:01.032003 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54496c67-d437-42e5-9e40-408059261f80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:01.033511 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54496c67-d437-42e5-9e40-408059261f80 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:01.039795 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 47/93] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:00 2022] GET /identity/v3/role_assignments?user.id=c75ee1380a57446ab1c1e588bd5bfa97&scope.project.id=deeac7725be842659d93e27cd19f954b&role.id=f0bb7fa65c8545699b60f857f930b078 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:01.071834 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986303e0-fd4b-4f01-9d83-b8a4f7daf575 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:01.134166 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57a3db-beec-4c96-88f2-c9fa606c960d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:01.135086 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57a3db-beec-4c96-88f2-c9fa606c960d None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:01.135370 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57a3db-beec-4c96-88f2-c9fa606c960d None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:01.135646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57a3db-beec-4c96-88f2-c9fa606c960d None admin] PATH_INFO: `/v3/users/c75ee1380a57446ab1c1e588bd5bfa97` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:01.137027 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57a3db-beec-4c96-88f2-c9fa606c960d None admin] RBAC: Authorizing `identity:get_user(user_id=c75ee1380a57446ab1c1e588bd5bfa97)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:01.138551 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57a3db-beec-4c96-88f2-c9fa606c960d None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:01.140257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 47/94] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:00 2022] GET /identity/v3/users/c75ee1380a57446ab1c1e588bd5bfa97 => generated 275 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:01.146017 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54496c67-d437-42e5-9e40-408059261f80 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:01.258184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:01.287849 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54496c67-d437-42e5-9e40-408059261f80 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:01.329285 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc21da-e793-4d7e-bd22-abc1d9a1a103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:01.329954 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc21da-e793-4d7e-bd22-abc1d9a1a103 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:01.330244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc21da-e793-4d7e-bd22-abc1d9a1a103 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:01.330526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc21da-e793-4d7e-bd22-abc1d9a1a103 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:01.403669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc21da-e793-4d7e-bd22-abc1d9a1a103 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:01.405194 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc21da-e793-4d7e-bd22-abc1d9a1a103 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:01.485531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:01.507090 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 48/95] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:01.513332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57a3db-beec-4c96-88f2-c9fa606c960d None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:01.645345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57a3db-beec-4c96-88f2-c9fa606c960d None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:01.671090 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:01.688817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7658f-74df-4567-a2c7-97ad7f35a35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:01.689719 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7658f-74df-4567-a2c7-97ad7f35a35c None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:01.690071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7658f-74df-4567-a2c7-97ad7f35a35c None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:01.690358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7658f-74df-4567-a2c7-97ad7f35a35c None admin] PATH_INFO: `/v3/projects/513b26119e324aa7a5de1353cab57400` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:01.693880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7658f-74df-4567-a2c7-97ad7f35a35c None admin] RBAC: Authorizing `identity:get_project(project_id=513b26119e324aa7a5de1353cab57400)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:01.696248 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7658f-74df-4567-a2c7-97ad7f35a35c None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:01.697705 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 48/96] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:01 2022] GET /identity/v3/projects/513b26119e324aa7a5de1353cab57400 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:01.703571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc21da-e793-4d7e-bd22-abc1d9a1a103 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:01.820924 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc21da-e793-4d7e-bd22-abc1d9a1a103 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:01.860725 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e0768-6926-441d-abff-2177a5bcd2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:01.861448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e0768-6926-441d-abff-2177a5bcd2a9 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:01.861738 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e0768-6926-441d-abff-2177a5bcd2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:01.862027 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e0768-6926-441d-abff-2177a5bcd2a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:01.862875 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e0768-6926-441d-abff-2177a5bcd2a9 None admin] RBAC: Adding query filter params (role.id=61895d866a7c44de8924486b8e5ec6e8, scope.project.id=513b26119e324aa7a5de1353cab57400, user.id=c75ee1380a57446ab1c1e588bd5bfa97) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:01.863194 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e0768-6926-441d-abff-2177a5bcd2a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:01.864658 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e0768-6926-441d-abff-2177a5bcd2a9 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:01.871020 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 49/97] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:01 2022] GET /identity/v3/role_assignments?user.id=c75ee1380a57446ab1c1e588bd5bfa97&scope.project.id=513b26119e324aa7a5de1353cab57400&role.id=61895d866a7c44de8924486b8e5ec6e8 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:03.197949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae499ff8-c9ed-4611-93c8-f78072bf93ff None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:03.198437 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae499ff8-c9ed-4611-93c8-f78072bf93ff None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:03.198437 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae499ff8-c9ed-4611-93c8-f78072bf93ff None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:03.199812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 49/98] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:03.215887 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d4f84-c5bb-4e57-b953-ef4f446b12c1 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:03.216382 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d4f84-c5bb-4e57-b953-ef4f446b12c1 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:03.216454 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d4f84-c5bb-4e57-b953-ef4f446b12c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:03.238188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-088d4f84-c5bb-4e57-b953-ef4f446b12c1 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:03.239417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-088d4f84-c5bb-4e57-b953-ef4f446b12c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:03.246577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb251b-220b-4879-be58-84b1997541fc None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:03.246870 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb251b-220b-4879-be58-84b1997541fc None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:03.247157 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb251b-220b-4879-be58-84b1997541fc None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:03.248528 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 50/99] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:38:03.253424 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17e2f0-cb12-48b3-afc9-6b9a1667dbe0 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:03.253714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17e2f0-cb12-48b3-afc9-6b9a1667dbe0 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:03.253999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17e2f0-cb12-48b3-afc9-6b9a1667dbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:03.280365 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-5f17e2f0-cb12-48b3-afc9-6b9a1667dbe0 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:03.281620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-5f17e2f0-cb12-48b3-afc9-6b9a1667dbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:03.316714 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:03.382509 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 50/100] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:03.400158 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 51/101] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:38:03.415920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d4f84-c5bb-4e57-b953-ef4f446b12c1 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:03.440038 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17e2f0-cb12-48b3-afc9-6b9a1667dbe0 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:03.519990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d4f84-c5bb-4e57-b953-ef4f446b12c1 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:03.555918 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e90ca-52d2-4e6e-a18d-dc47425eed2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:03.556725 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e90ca-52d2-4e6e-a18d-dc47425eed2d None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:03.557016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e90ca-52d2-4e6e-a18d-dc47425eed2d None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:03.557347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e90ca-52d2-4e6e-a18d-dc47425eed2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:03.568041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e90ca-52d2-4e6e-a18d-dc47425eed2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:03.576397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-127e90ca-52d2-4e6e-a18d-dc47425eed2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:38:03.576397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:03.576397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:03.576397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:03.576397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:03.576397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:03.576397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:03.576397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:03.576397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:03.576397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:03.576397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:03.576397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:03.576397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:03.576397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:03.576397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:03.576397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:03.578471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:03.578471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:03.578471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:03.578471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:03.578471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:03.578471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:03.578471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:03.578471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:03.578471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:03.578471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:03.578471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:03.578471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:03.578471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:03.578471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:03.578471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:03.578471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:03.580358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:03.580358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:03.580358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:03.580358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:03.580358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:03.580358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:03.580358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:03.580358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:03.580358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:03.580358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:03.580358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:38:03.580358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:03.580358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 51/102] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:38:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:03.594179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e90ca-52d2-4e6e-a18d-dc47425eed2d None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:03.621052 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17e2f0-cb12-48b3-afc9-6b9a1667dbe0 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:03.654615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:03.669800 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:03.684678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcabeac-1d3b-479a-a131-242cd63698ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:03.685526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcabeac-1d3b-479a-a131-242cd63698ff None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:03.685816 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcabeac-1d3b-479a-a131-242cd63698ff None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:03.686099 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcabeac-1d3b-479a-a131-242cd63698ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:03.706128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcabeac-1d3b-479a-a131-242cd63698ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:03.723091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-3bcabeac-1d3b-479a-a131-242cd63698ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 19:38:03.723091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:03.723091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:03.723091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:03.723091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:03.723091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:03.723091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:03.723091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:03.723091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:03.723091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:03.723091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:03.723091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:03.723091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:03.723091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:03.723091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:03.723091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:03.723979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:03.723979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:03.723979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:03.723979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:03.723979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:03.723979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:03.723979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:03.723979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:03.723979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:03.723979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:03.723979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:03.723979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:03.723979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:03.723979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:03.723979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:03.723979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:03.724746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:03.724746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:03.724746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:03.724746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:03.724746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:03.724746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:03.724746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:03.724746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:03.724746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:03.724746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:03.724746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 19:38:03.724746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:03.727489 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 52/103] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:03.728951 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcbd01-3a85-435b-967e-ed57c18181e0 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:03.729432 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcbd01-3a85-435b-967e-ed57c18181e0 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:03.729899 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcbd01-3a85-435b-967e-ed57c18181e0 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:03.731347 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 53/104] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:03.736915 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2cb60-083a-4eb5-8ecc-9830a61f3f12 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:03.737524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2cb60-083a-4eb5-8ecc-9830a61f3f12 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:03.737980 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2cb60-083a-4eb5-8ecc-9830a61f3f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:03.761931 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e90ca-52d2-4e6e-a18d-dc47425eed2d None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:03.776828 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-25e2cb60-083a-4eb5-8ecc-9830a61f3f12 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:03.778016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-25e2cb60-083a-4eb5-8ecc-9830a61f3f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:03.827320 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d6ace-1437-4af7-871b-5c738f0ebfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:03.828005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d6ace-1437-4af7-871b-5c738f0ebfe7 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:03.828295 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d6ace-1437-4af7-871b-5c738f0ebfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:03.828581 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d6ace-1437-4af7-871b-5c738f0ebfe7 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:03.829372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d6ace-1437-4af7-871b-5c738f0ebfe7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:03.829696 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d6ace-1437-4af7-871b-5c738f0ebfe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:03.831117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d6ace-1437-4af7-871b-5c738f0ebfe7 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:03.848694 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 52/105] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:03.849418 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d6ace-1437-4af7-871b-5c738f0ebfe7 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:03.926934 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 54/106] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:03.928329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2cb60-083a-4eb5-8ecc-9830a61f3f12 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:03.992613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:04.000183 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d6ace-1437-4af7-871b-5c738f0ebfe7 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:04.037552 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25eb21-95f9-4a24-97c1-ca8bc02418c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:04.038688 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25eb21-95f9-4a24-97c1-ca8bc02418c6 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:04.039136 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25eb21-95f9-4a24-97c1-ca8bc02418c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:04.039488 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25eb21-95f9-4a24-97c1-ca8bc02418c6 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:04.040754 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25eb21-95f9-4a24-97c1-ca8bc02418c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:04.041714 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25eb21-95f9-4a24-97c1-ca8bc02418c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:04.043712 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25eb21-95f9-4a24-97c1-ca8bc02418c6 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:04.050021 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2cb60-083a-4eb5-8ecc-9830a61f3f12 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:04.057181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 53/107] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:04.057181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71eeb7-ac7a-4704-87a7-2b20ea6212ca None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:04.057181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71eeb7-ac7a-4704-87a7-2b20ea6212ca None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:04.057181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71eeb7-ac7a-4704-87a7-2b20ea6212ca None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:04.057181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 54/108] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:04.057181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71eeb7-ac7a-4704-87a7-2b20ea6212ca None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:04.065911 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:04.093012 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0e640-dee5-4932-82b5-8acbfcab9b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:04.094119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0e640-dee5-4932-82b5-8acbfcab9b37 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:04.094572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0e640-dee5-4932-82b5-8acbfcab9b37 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:04.094988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0e640-dee5-4932-82b5-8acbfcab9b37 None admin] PATH_INFO: `/v3/users/d83e81b5c7054c4491fc17ac780d3cea` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:04.096892 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0e640-dee5-4932-82b5-8acbfcab9b37 None admin] RBAC: Authorizing `identity:get_user(user_id=d83e81b5c7054c4491fc17ac780d3cea)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:04.098734 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0e640-dee5-4932-82b5-8acbfcab9b37 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:04.100843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 55/109] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:03 2022] GET /identity/v3/users/d83e81b5c7054c4491fc17ac780d3cea => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:04.102313 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53c8f3-b759-4d0f-95c7-5b35fa52cec3 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:04.102596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53c8f3-b759-4d0f-95c7-5b35fa52cec3 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:04.102874 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53c8f3-b759-4d0f-95c7-5b35fa52cec3 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:04.104132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 56/110] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:04.104959 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53c8f3-b759-4d0f-95c7-5b35fa52cec3 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:04.172355 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71eeb7-ac7a-4704-87a7-2b20ea6212ca None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:04.209663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d472679-84dc-4568-afa2-3784772481d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:04.211302 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d472679-84dc-4568-afa2-3784772481d2 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:04.211806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d472679-84dc-4568-afa2-3784772481d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:04.212182 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d472679-84dc-4568-afa2-3784772481d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:04.213670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d472679-84dc-4568-afa2-3784772481d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:04.215228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d472679-84dc-4568-afa2-3784772481d2 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:04.216494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53c8f3-b759-4d0f-95c7-5b35fa52cec3 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:04.221786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 55/111] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:04.221786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018865bc-7db1-4ba5-85ec-8614efaf0975 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:04.221786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018865bc-7db1-4ba5-85ec-8614efaf0975 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:04.221786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018865bc-7db1-4ba5-85ec-8614efaf0975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:04.235407 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-018865bc-7db1-4ba5-85ec-8614efaf0975 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:04.236596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-018865bc-7db1-4ba5-85ec-8614efaf0975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:04.255181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:04.258730 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cede5c2-518a-495d-ba53-a17c73954b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:04.259604 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cede5c2-518a-495d-ba53-a17c73954b73 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:04.259889 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cede5c2-518a-495d-ba53-a17c73954b73 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:04.260171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cede5c2-518a-495d-ba53-a17c73954b73 None admin] PATH_INFO: `/v3/users/d4ee29bb005b4798a21c4becdcd3450f` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:04.275186 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cede5c2-518a-495d-ba53-a17c73954b73 None admin] RBAC: Authorizing `identity:get_user(user_id=d4ee29bb005b4798a21c4becdcd3450f)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:04.276649 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cede5c2-518a-495d-ba53-a17c73954b73 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:04.282990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 57/112] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:04 2022] GET /identity/v3/users/d4ee29bb005b4798a21c4becdcd3450f => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:04.282990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cede5c2-518a-495d-ba53-a17c73954b73 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:04.309549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 56/113] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:04.310892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3fe65-b376-4f92-baa3-aa0f26f6f883 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:04.311239 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3fe65-b376-4f92-baa3-aa0f26f6f883 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:04.311529 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3fe65-b376-4f92-baa3-aa0f26f6f883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:04.329687 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-c1d3fe65-b376-4f92-baa3-aa0f26f6f883 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:04.331111 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:04.331416 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c1d3fe65-b376-4f92-baa3-aa0f26f6f883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:04.399251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cede5c2-518a-495d-ba53-a17c73954b73 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:04.404106 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 57/114] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:04.405085 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3fe65-b376-4f92-baa3-aa0f26f6f883 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:04.446329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc536b5-df8a-40fd-9290-ca61e654a0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:04.447458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc536b5-df8a-40fd-9290-ca61e654a0c2 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:04.447750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc536b5-df8a-40fd-9290-ca61e654a0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:04.448281 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc536b5-df8a-40fd-9290-ca61e654a0c2 None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:04.450295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc536b5-df8a-40fd-9290-ca61e654a0c2 None admin] RBAC: Authorizing `identity:get_project(project_id=deeac7725be842659d93e27cd19f954b)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:04.452023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc536b5-df8a-40fd-9290-ca61e654a0c2 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:04.454622 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 58/115] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:04 2022] GET /identity/v3/projects/deeac7725be842659d93e27cd19f954b => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:04.455412 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc536b5-df8a-40fd-9290-ca61e654a0c2 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:04.508470 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:04.524918 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3fe65-b376-4f92-baa3-aa0f26f6f883 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:04.559710 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc536b5-df8a-40fd-9290-ca61e654a0c2 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:04.561368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:04.561927 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cf4ee-3102-43bf-a48d-5eed49004b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:04.562608 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cf4ee-3102-43bf-a48d-5eed49004b62 None admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:04.562899 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cf4ee-3102-43bf-a48d-5eed49004b62 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:04.563184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cf4ee-3102-43bf-a48d-5eed49004b62 None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:04.563905 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cf4ee-3102-43bf-a48d-5eed49004b62 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:04.565407 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cf4ee-3102-43bf-a48d-5eed49004b62 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:04.596234 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c53f7-b4f6-4b1a-a064-65ee3cdec2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:04.596969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c53f7-b4f6-4b1a-a064-65ee3cdec2f0 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:04.597355 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c53f7-b4f6-4b1a-a064-65ee3cdec2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:04.597716 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c53f7-b4f6-4b1a-a064-65ee3cdec2f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:04.636585 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 58/116] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 19:38:04 2022] POST /identity/v3/projects => generated 302 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:38:04.645388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cf4ee-3102-43bf-a48d-5eed49004b62 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:04.677907 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c53f7-b4f6-4b1a-a064-65ee3cdec2f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:04.680283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c53f7-b4f6-4b1a-a064-65ee3cdec2f0 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:04.797669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cf4ee-3102-43bf-a48d-5eed49004b62 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:04.801670 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 59/117] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:04.802742 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c53f7-b4f6-4b1a-a064-65ee3cdec2f0 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:04.817960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:04.844579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe970a-e734-42d5-a0b1-dda11986a956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:04.846081 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe970a-e734-42d5-a0b1-dda11986a956 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:04.846081 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe970a-e734-42d5-a0b1-dda11986a956 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:04.846081 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe970a-e734-42d5-a0b1-dda11986a956 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:04.852020 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:04.864167 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe970a-e734-42d5-a0b1-dda11986a956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:04.873196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-41fe970a-e734-42d5-a0b1-dda11986a956 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:04.873196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:04.873196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:04.873196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:04.873196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:04.873196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:04.873196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:04.873196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:04.873196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:04.873196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:04.873196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:04.873196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:04.873196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:04.873196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:04.873196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:04.873196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:04.874101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:04.874101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:04.874101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:04.874101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:04.874101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:04.874101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:04.874101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:04.874101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:04.874101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:04.874101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:04.874101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:04.874101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:04.874101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:04.874101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:04.874101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:04.874101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:04.874868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:04.874868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:04.874868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:04.874868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:04.874868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:04.874868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:04.874868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:04.874868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:04.874868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:04.874868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:04.874868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:04.874868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:04.874868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 59/118] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:04.874868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe970a-e734-42d5-a0b1-dda11986a956 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:04.971032 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c53f7-b4f6-4b1a-a064-65ee3cdec2f0 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:05.008070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece7564-41df-4863-97fc-5056390e08b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:05.008897 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece7564-41df-4863-97fc-5056390e08b8 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:05.009209 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece7564-41df-4863-97fc-5056390e08b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:05.009495 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece7564-41df-4863-97fc-5056390e08b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:05.021011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece7564-41df-4863-97fc-5056390e08b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:05.021829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe970a-e734-42d5-a0b1-dda11986a956 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:05.029585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-3ece7564-41df-4863-97fc-5056390e08b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:05.029585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:05.029585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:05.029585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:05.029585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:05.029585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:05.029585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:05.029585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:05.029585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:05.029585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:05.029585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:05.029585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:05.029585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:05.029585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:05.029585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:05.029585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:05.030474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:05.030474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:05.030474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:05.030474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:05.030474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:05.030474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:05.030474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:05.030474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:05.030474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:05.030474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:05.030474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:05.030474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:05.030474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:05.030474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:05.030474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:05.030474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:05.031233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:05.031233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:05.031233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:05.031233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:05.031233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:05.031233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:05.031233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:05.031233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:05.031233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:05.031233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:05.031233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:05.031233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:05.031233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 60/119] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:38:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:05.031943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece7564-41df-4863-97fc-5056390e08b8 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:05.060239 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eacc8d-8734-4324-9784-e2c4647fba54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:05.061136 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eacc8d-8734-4324-9784-e2c4647fba54 None admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:05.061454 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eacc8d-8734-4324-9784-e2c4647fba54 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:05.061739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eacc8d-8734-4324-9784-e2c4647fba54 None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b/users/d83e81b5c7054c4491fc17ac780d3cea/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:05.063802 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eacc8d-8734-4324-9784-e2c4647fba54 None admin] RBAC: Authorizing `identity:create_grant(project_id=deeac7725be842659d93e27cd19f954b, user_id=d83e81b5c7054c4491fc17ac780d3cea, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:05.066084 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eacc8d-8734-4324-9784-e2c4647fba54 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:05.096061 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:05.131369 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 60/120] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:38:04 2022] PUT /identity/v3/projects/deeac7725be842659d93e27cd19f954b/users/d83e81b5c7054c4491fc17ac780d3cea/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:38:05.135698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece7564-41df-4863-97fc-5056390e08b8 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:05.142231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eacc8d-8734-4324-9784-e2c4647fba54 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:05.189207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ea3ef-a7d1-44bd-8932-4ac411433351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:05.190489 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ea3ef-a7d1-44bd-8932-4ac411433351 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:05.190998 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ea3ef-a7d1-44bd-8932-4ac411433351 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:05.191514 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ea3ef-a7d1-44bd-8932-4ac411433351 None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:05.193422 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ea3ef-a7d1-44bd-8932-4ac411433351 None admin] RBAC: Authorizing `identity:get_project(project_id=deeac7725be842659d93e27cd19f954b)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:05.195790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ea3ef-a7d1-44bd-8932-4ac411433351 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:05.197936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 61/121] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:05 2022] GET /identity/v3/projects/deeac7725be842659d93e27cd19f954b => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:05.199517 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d9937-620d-47cd-91fb-d8084a12cb12 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:05.200058 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d9937-620d-47cd-91fb-d8084a12cb12 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:05.200544 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d9937-620d-47cd-91fb-d8084a12cb12 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:05.202069 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 62/122] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:05.203064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d9937-620d-47cd-91fb-d8084a12cb12 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:05.229490 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:05.295095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eacc8d-8734-4324-9784-e2c4647fba54 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:05.331646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d9937-620d-47cd-91fb-d8084a12cb12 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:05.341475 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e6d69-e1e6-444c-a182-4a9abaf07cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:05.342461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e6d69-e1e6-444c-a182-4a9abaf07cc3 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:05.342461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e6d69-e1e6-444c-a182-4a9abaf07cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:05.344070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e6d69-e1e6-444c-a182-4a9abaf07cc3 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:05.344070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e6d69-e1e6-444c-a182-4a9abaf07cc3 None admin] RBAC: Adding query filter params (name=member) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:05.344070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e6d69-e1e6-444c-a182-4a9abaf07cc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:05.345145 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e6d69-e1e6-444c-a182-4a9abaf07cc3 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:05.355220 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 61/123] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:05.356068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e6d69-e1e6-444c-a182-4a9abaf07cc3 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:05.369721 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:05.378991 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268063a-3128-4a36-80ee-d88886c41cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:05.380047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268063a-3128-4a36-80ee-d88886c41cbc None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:05.380547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268063a-3128-4a36-80ee-d88886c41cbc None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:05.381187 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268063a-3128-4a36-80ee-d88886c41cbc None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:05.389504 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268063a-3128-4a36-80ee-d88886c41cbc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:05.389504 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268063a-3128-4a36-80ee-d88886c41cbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:05.389504 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268063a-3128-4a36-80ee-d88886c41cbc None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:05.399153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 63/124] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:38:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:05.400680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae3d10-5cf7-42a6-85ce-978ba9d6abe1 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:05.401201 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae3d10-5cf7-42a6-85ce-978ba9d6abe1 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:05.401790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae3d10-5cf7-42a6-85ce-978ba9d6abe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:05.422834 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-61ae3d10-5cf7-42a6-85ce-978ba9d6abe1 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:05.424988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-61ae3d10-5cf7-42a6-85ce-978ba9d6abe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:05.471664 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e6d69-e1e6-444c-a182-4a9abaf07cc3 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:05.489784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:05.508338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfae916-d431-4c4c-84a8-86b671b58445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:05.509149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfae916-d431-4c4c-84a8-86b671b58445 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:05.509595 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfae916-d431-4c4c-84a8-86b671b58445 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:05.509978 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfae916-d431-4c4c-84a8-86b671b58445 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:05.510983 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfae916-d431-4c4c-84a8-86b671b58445 None admin] RBAC: Adding query filter params (role.id=d81add03275a412284f307885c341f6f, scope.project.id=deeac7725be842659d93e27cd19f954b, user.id=d4ee29bb005b4798a21c4becdcd3450f) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:05.511397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfae916-d431-4c4c-84a8-86b671b58445 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:05.512945 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfae916-d431-4c4c-84a8-86b671b58445 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:05.515451 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 64/125] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:05.516870 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae3d10-5cf7-42a6-85ce-978ba9d6abe1 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:05.519452 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 62/126] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:05 2022] GET /identity/v3/role_assignments?user.id=d4ee29bb005b4798a21c4becdcd3450f&scope.project.id=deeac7725be842659d93e27cd19f954b&role.id=d81add03275a412284f307885c341f6f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:05.525828 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfae916-d431-4c4c-84a8-86b671b58445 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:05.640489 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae3d10-5cf7-42a6-85ce-978ba9d6abe1 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:05.669620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:05.682938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e7a88-87a7-4f4b-9891-1f9c61ddc1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:05.684242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e7a88-87a7-4f4b-9891-1f9c61ddc1ac None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:05.686788 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e7a88-87a7-4f4b-9891-1f9c61ddc1ac None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:05.686788 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e7a88-87a7-4f4b-9891-1f9c61ddc1ac None admin] PATH_INFO: `/v3/users/c75ee1380a57446ab1c1e588bd5bfa97` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:05.686788 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e7a88-87a7-4f4b-9891-1f9c61ddc1ac None admin] RBAC: Authorizing `identity:get_user(user_id=c75ee1380a57446ab1c1e588bd5bfa97)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:05.689016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e7a88-87a7-4f4b-9891-1f9c61ddc1ac None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:05.691030 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 65/127] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:05 2022] GET /identity/v3/users/c75ee1380a57446ab1c1e588bd5bfa97 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:05.692448 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e7a88-87a7-4f4b-9891-1f9c61ddc1ac None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:05.773736 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfae916-d431-4c4c-84a8-86b671b58445 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:05.816792 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e7a88-87a7-4f4b-9891-1f9c61ddc1ac None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:05.825514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d00ad-04e6-455e-bacf-eb015f045957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:05.826460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d00ad-04e6-455e-bacf-eb015f045957 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:05.826750 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d00ad-04e6-455e-bacf-eb015f045957 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:05.828243 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d00ad-04e6-455e-bacf-eb015f045957 None admin] PATH_INFO: `/v3/users/c75ee1380a57446ab1c1e588bd5bfa97` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:05.829664 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d00ad-04e6-455e-bacf-eb015f045957 None admin] RBAC: Authorizing `identity:get_user(user_id=c75ee1380a57446ab1c1e588bd5bfa97)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:05.831204 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d00ad-04e6-455e-bacf-eb015f045957 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:05.833192 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 63/128] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:05 2022] GET /identity/v3/users/c75ee1380a57446ab1c1e588bd5bfa97 => generated 275 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:05.838075 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d00ad-04e6-455e-bacf-eb015f045957 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:05.861939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c145faf-adb9-401e-ae58-51c23250ff3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:05.863373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c145faf-adb9-401e-ae58-51c23250ff3d None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:05.863882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c145faf-adb9-401e-ae58-51c23250ff3d None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:05.864371 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c145faf-adb9-401e-ae58-51c23250ff3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:05.881524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c145faf-adb9-401e-ae58-51c23250ff3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:05.892047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-5c145faf-adb9-401e-ae58-51c23250ff3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:05.892047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:05.892047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:05.892047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:05.892047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:05.892047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:05.892047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:05.892047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:05.892047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:05.892047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:05.892047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:05.892047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:05.892047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:05.892047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:05.892047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:05.892047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:05.892906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:05.892906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:05.892906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:05.892906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:05.892906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:05.892906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:05.892906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:05.892906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:05.892906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:05.892906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:05.892906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:05.892906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:05.892906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:05.892906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:05.892906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:05.892906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:05.894033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:05.894033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:05.894033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:05.894033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:05.894033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:05.894033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:05.894033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:05.894033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:05.894033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:05.894033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:05.894033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:05.894033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:05.896848 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 66/129] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:05.898229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c145faf-adb9-401e-ae58-51c23250ff3d None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:05.949849 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:06.001591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:06.023759 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c145faf-adb9-401e-ae58-51c23250ff3d None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:06.060323 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d00ad-04e6-455e-bacf-eb015f045957 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:06.080925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5bbb3-8247-4aa8-b4cf-288d1daac2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:06.082484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5bbb3-8247-4aa8-b4cf-288d1daac2be None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:06.082926 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5bbb3-8247-4aa8-b4cf-288d1daac2be None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:06.083221 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5bbb3-8247-4aa8-b4cf-288d1daac2be None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:06.084440 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5bbb3-8247-4aa8-b4cf-288d1daac2be None admin] RBAC: Authorizing `identity:get_project(project_id=deeac7725be842659d93e27cd19f954b)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:06.086416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5bbb3-8247-4aa8-b4cf-288d1daac2be None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:06.088710 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 67/130] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:05 2022] GET /identity/v3/projects/deeac7725be842659d93e27cd19f954b => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:06.089932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5bbb3-8247-4aa8-b4cf-288d1daac2be None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:06.130018 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e0419-87cf-4212-b0c8-8199327a11ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:06.130942 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e0419-87cf-4212-b0c8-8199327a11ef None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:06.131229 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e0419-87cf-4212-b0c8-8199327a11ef None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:06.131563 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e0419-87cf-4212-b0c8-8199327a11ef None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:06.136000 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e0419-87cf-4212-b0c8-8199327a11ef None admin] RBAC: Authorizing `identity:get_project(project_id=deeac7725be842659d93e27cd19f954b)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:06.137580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e0419-87cf-4212-b0c8-8199327a11ef None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:06.139309 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 64/131] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:05 2022] GET /identity/v3/projects/deeac7725be842659d93e27cd19f954b => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:06.141079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e0419-87cf-4212-b0c8-8199327a11ef None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:06.207842 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5bbb3-8247-4aa8-b4cf-288d1daac2be None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:06.245526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:06.273346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ec5c8-8a7f-45c1-a10b-0e536885c69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:06.274124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ec5c8-8a7f-45c1-a10b-0e536885c69b None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:06.274424 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ec5c8-8a7f-45c1-a10b-0e536885c69b None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:06.274714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ec5c8-8a7f-45c1-a10b-0e536885c69b None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:06.275780 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ec5c8-8a7f-45c1-a10b-0e536885c69b None admin] RBAC: Adding query filter params (name=member) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:06.276102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ec5c8-8a7f-45c1-a10b-0e536885c69b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:06.277680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ec5c8-8a7f-45c1-a10b-0e536885c69b None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:06.287770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 68/132] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:06.288576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ec5c8-8a7f-45c1-a10b-0e536885c69b None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:06.384588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e0419-87cf-4212-b0c8-8199327a11ef None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:06.421761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:06.444061 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ec5c8-8a7f-45c1-a10b-0e536885c69b None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:06.465966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d452d27-0705-4492-beae-5d2c0ac22f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:06.466797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d452d27-0705-4492-beae-5d2c0ac22f96 None admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:06.467084 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d452d27-0705-4492-beae-5d2c0ac22f96 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:06.467364 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d452d27-0705-4492-beae-5d2c0ac22f96 None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b/users/c75ee1380a57446ab1c1e588bd5bfa97/roles/f0bb7fa65c8545699b60f857f930b078` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:06.474508 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d452d27-0705-4492-beae-5d2c0ac22f96 None admin] RBAC: Authorizing `identity:create_grant(project_id=deeac7725be842659d93e27cd19f954b, user_id=c75ee1380a57446ab1c1e588bd5bfa97, role_id=f0bb7fa65c8545699b60f857f930b078)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:06.476000 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d452d27-0705-4492-beae-5d2c0ac22f96 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:06.483169 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860cbed-a799-4266-a859-bd376c2c559f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:06.484081 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860cbed-a799-4266-a859-bd376c2c559f None admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:06.484373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860cbed-a799-4266-a859-bd376c2c559f None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:06.484661 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860cbed-a799-4266-a859-bd376c2c559f None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b/users/c75ee1380a57446ab1c1e588bd5bfa97/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:06.487354 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860cbed-a799-4266-a859-bd376c2c559f None admin] RBAC: Authorizing `identity:create_grant(project_id=deeac7725be842659d93e27cd19f954b, user_id=c75ee1380a57446ab1c1e588bd5bfa97, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:06.488887 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860cbed-a799-4266-a859-bd376c2c559f None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:06.564211 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 65/133] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:38:06 2022] PUT /identity/v3/projects/deeac7725be842659d93e27cd19f954b/users/c75ee1380a57446ab1c1e588bd5bfa97/roles/f0bb7fa65c8545699b60f857f930b078 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:38:06.566036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d452d27-0705-4492-beae-5d2c0ac22f96 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:06.596332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 69/134] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:38:06 2022] PUT /identity/v3/projects/deeac7725be842659d93e27cd19f954b/users/c75ee1380a57446ab1c1e588bd5bfa97/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:38:06.703580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d452d27-0705-4492-beae-5d2c0ac22f96 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:06.740946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff3cc0-010f-440b-a9e0-228e7f0e1142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:06.741884 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff3cc0-010f-440b-a9e0-228e7f0e1142 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:06.742178 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff3cc0-010f-440b-a9e0-228e7f0e1142 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:06.742439 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff3cc0-010f-440b-a9e0-228e7f0e1142 None admin] PATH_INFO: `/v3/users/c75ee1380a57446ab1c1e588bd5bfa97` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:06.743872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff3cc0-010f-440b-a9e0-228e7f0e1142 None admin] RBAC: Authorizing `identity:get_user(user_id=c75ee1380a57446ab1c1e588bd5bfa97)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:06.745406 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff3cc0-010f-440b-a9e0-228e7f0e1142 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:06.751309 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 66/135] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:06 2022] GET /identity/v3/users/c75ee1380a57446ab1c1e588bd5bfa97 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:06.753081 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860cbed-a799-4266-a859-bd376c2c559f None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:06.810895 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:06.888696 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860cbed-a799-4266-a859-bd376c2c559f None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:06.938456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e493a3-0ed6-4638-b84c-0ef17bd64d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:06.939335 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e493a3-0ed6-4638-b84c-0ef17bd64d3d None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:06.939622 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e493a3-0ed6-4638-b84c-0ef17bd64d3d None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:06.940804 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e493a3-0ed6-4638-b84c-0ef17bd64d3d None admin] PATH_INFO: `/v3/projects/513b26119e324aa7a5de1353cab57400` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:06.941113 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e493a3-0ed6-4638-b84c-0ef17bd64d3d None admin] RBAC: Authorizing `identity:get_project(project_id=513b26119e324aa7a5de1353cab57400)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:06.942912 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e493a3-0ed6-4638-b84c-0ef17bd64d3d None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:06.944656 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 70/136] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:06 2022] GET /identity/v3/projects/513b26119e324aa7a5de1353cab57400 => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:06.953319 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff3cc0-010f-440b-a9e0-228e7f0e1142 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:07.016608 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:07.078120 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff3cc0-010f-440b-a9e0-228e7f0e1142 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:07.113768 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c88d5-ccfe-4ce4-9f48-4e9b50fe818d None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:07.114093 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c88d5-ccfe-4ce4-9f48-4e9b50fe818d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:07.114333 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c88d5-ccfe-4ce4-9f48-4e9b50fe818d None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:07.115916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 71/137] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:38:07.116492 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61414e21-a523-4ef1-9e08-16a7380a2dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:07.118380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61414e21-a523-4ef1-9e08-16a7380a2dd9 None admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:07.118893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61414e21-a523-4ef1-9e08-16a7380a2dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:07.119371 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61414e21-a523-4ef1-9e08-16a7380a2dd9 None admin] PATH_INFO: `/v3/projects/513b26119e324aa7a5de1353cab57400/users/c75ee1380a57446ab1c1e588bd5bfa97/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:07.125195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c9a01-3b4a-4703-8590-a4fe01ab0d44 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:07.125195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c9a01-3b4a-4703-8590-a4fe01ab0d44 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:07.125195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c9a01-3b4a-4703-8590-a4fe01ab0d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:07.126392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61414e21-a523-4ef1-9e08-16a7380a2dd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=513b26119e324aa7a5de1353cab57400, user_id=c75ee1380a57446ab1c1e588bd5bfa97, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:07.128091 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61414e21-a523-4ef1-9e08-16a7380a2dd9 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:07.157653 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-d30c9a01-3b4a-4703-8590-a4fe01ab0d44 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:07.159069 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d30c9a01-3b4a-4703-8590-a4fe01ab0d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:07.212378 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 67/138] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:38:06 2022] PUT /identity/v3/projects/513b26119e324aa7a5de1353cab57400/users/c75ee1380a57446ab1c1e588bd5bfa97/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:38:07.264650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 72/139] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:38:07.286626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61414e21-a523-4ef1-9e08-16a7380a2dd9 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:07.442413 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61414e21-a523-4ef1-9e08-16a7380a2dd9 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:07.451711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:07.481348 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17023a9a-ddb1-42b0-8d52-18c6a0c4dc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:07.482617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17023a9a-ddb1-42b0-8d52-18c6a0c4dc8f None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:07.483107 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17023a9a-ddb1-42b0-8d52-18c6a0c4dc8f None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:07.483588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17023a9a-ddb1-42b0-8d52-18c6a0c4dc8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:07.485080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17023a9a-ddb1-42b0-8d52-18c6a0c4dc8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:07.486886 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17023a9a-ddb1-42b0-8d52-18c6a0c4dc8f None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:07.493286 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 68/140] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:07.495439 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c9a01-3b4a-4703-8590-a4fe01ab0d44 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:07.543242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:07.610018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c9a01-3b4a-4703-8590-a4fe01ab0d44 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:07.658976 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fd35c-0f9d-45b5-afec-7bc0b3d4da5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:07.660058 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fd35c-0f9d-45b5-afec-7bc0b3d4da5a None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:07.660572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fd35c-0f9d-45b5-afec-7bc0b3d4da5a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:07.661090 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fd35c-0f9d-45b5-afec-7bc0b3d4da5a None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:07.662092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fd35c-0f9d-45b5-afec-7bc0b3d4da5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:07.664356 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fd35c-0f9d-45b5-afec-7bc0b3d4da5a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:07.738168 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 73/141] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 19:38:07 2022] POST /identity/v3/users => generated 283 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:38:07.806582 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bcc40-dc1d-4296-ad58-b2267e828101 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:07.807214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bcc40-dc1d-4296-ad58-b2267e828101 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:07.807698 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bcc40-dc1d-4296-ad58-b2267e828101 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:07.809699 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 69/142] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:07.825092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a3a50-8174-4562-8a47-2e970af07bce None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:07.825835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a3a50-8174-4562-8a47-2e970af07bce None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:07.826339 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a3a50-8174-4562-8a47-2e970af07bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:07.852986 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-de1a3a50-8174-4562-8a47-2e970af07bce None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:07.854322 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-de1a3a50-8174-4562-8a47-2e970af07bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:07.959534 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 74/143] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:07.987225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bcc40-dc1d-4296-ad58-b2267e828101 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:08.102091 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bcc40-dc1d-4296-ad58-b2267e828101 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:08.138052 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e443e-ef60-4493-a5db-5a46a252b45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:08.139184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e443e-ef60-4493-a5db-5a46a252b45b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:08.139694 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e443e-ef60-4493-a5db-5a46a252b45b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:08.140172 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e443e-ef60-4493-a5db-5a46a252b45b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:08.151400 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e443e-ef60-4493-a5db-5a46a252b45b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:08.159708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-d36e443e-ef60-4493-a5db-5a46a252b45b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:38:08.159708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:08.159708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:08.159708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:08.159708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:08.159708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:08.159708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:08.159708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:08.159708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:08.159708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:08.159708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:08.159708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:08.159708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:08.159708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:08.159708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:08.159708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:08.160584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:08.160584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:08.160584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:08.160584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:08.160584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:08.160584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:08.160584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:08.160584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:08.160584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:08.160584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:08.160584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:08.160584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:08.160584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:08.160584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:08.160584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:08.160584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:08.161365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:08.161365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:08.161365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:08.161365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:08.161365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:08.161365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:08.161365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:08.161365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:08.161365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:08.161365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:08.161365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:38:08.161365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:08.166428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 70/144] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:38:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:08.174278 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a3a50-8174-4562-8a47-2e970af07bce None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:08.217211 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:08.309914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a3a50-8174-4562-8a47-2e970af07bce None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:08.359869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7f1f0-30ae-442e-9eb8-3a030c54a7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:08.360471 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7f1f0-30ae-442e-9eb8-3a030c54a7d1 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:08.360765 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7f1f0-30ae-442e-9eb8-3a030c54a7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:08.361056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7f1f0-30ae-442e-9eb8-3a030c54a7d1 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:08.361889 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7f1f0-30ae-442e-9eb8-3a030c54a7d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:08.362205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7f1f0-30ae-442e-9eb8-3a030c54a7d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:08.363602 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7f1f0-30ae-442e-9eb8-3a030c54a7d1 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:08.377027 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 75/145] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:08.383711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e443e-ef60-4493-a5db-5a46a252b45b None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:08.433979 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:08.533289 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e443e-ef60-4493-a5db-5a46a252b45b None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:08.580373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bdbd2-e48a-4598-9f46-3d8279fae75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:08.581293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bdbd2-e48a-4598-9f46-3d8279fae75a None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:08.581585 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bdbd2-e48a-4598-9f46-3d8279fae75a None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:08.581868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bdbd2-e48a-4598-9f46-3d8279fae75a None admin] PATH_INFO: `/v3/users/d83e81b5c7054c4491fc17ac780d3cea` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:08.585920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bdbd2-e48a-4598-9f46-3d8279fae75a None admin] RBAC: Authorizing `identity:get_user(user_id=d83e81b5c7054c4491fc17ac780d3cea)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:08.587413 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bdbd2-e48a-4598-9f46-3d8279fae75a None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:08.589091 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 71/146] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:08 2022] GET /identity/v3/users/d83e81b5c7054c4491fc17ac780d3cea => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:08.595233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7f1f0-30ae-442e-9eb8-3a030c54a7d1 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:08.664846 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbe59e-059c-4e19-8e4c-4f0e83a5f241 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:08.665209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbe59e-059c-4e19-8e4c-4f0e83a5f241 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:08.665435 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbe59e-059c-4e19-8e4c-4f0e83a5f241 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:08.666822 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 72/147] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:38:08.677405 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c60309-0c82-43d7-9973-b8a51ce37abf None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:08.677695 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c60309-0c82-43d7-9973-b8a51ce37abf None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:08.677981 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c60309-0c82-43d7-9973-b8a51ce37abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:08.708248 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-61c60309-0c82-43d7-9973-b8a51ce37abf None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:08.709539 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-61c60309-0c82-43d7-9973-b8a51ce37abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:08.719930 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:08.747642 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7f1f0-30ae-442e-9eb8-3a030c54a7d1 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:08.806626 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b10b3-a4f1-49b9-9d88-ba17b68d78dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:08.807297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b10b3-a4f1-49b9-9d88-ba17b68d78dd None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:08.807591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b10b3-a4f1-49b9-9d88-ba17b68d78dd None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:08.807879 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b10b3-a4f1-49b9-9d88-ba17b68d78dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:08.865838 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 73/148] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:38:08.921194 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c60309-0c82-43d7-9973-b8a51ce37abf None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:08.938237 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b10b3-a4f1-49b9-9d88-ba17b68d78dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:08.939753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b10b3-a4f1-49b9-9d88-ba17b68d78dd None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:08.990715 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:09.104915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c60309-0c82-43d7-9973-b8a51ce37abf None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:09.107911 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:09.133549 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 76/149] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:09.139766 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b10b3-a4f1-49b9-9d88-ba17b68d78dd None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:09.194008 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335210d-fe04-48d3-a85f-98ca1fb52ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:09.194759 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335210d-fe04-48d3-a85f-98ca1fb52ba0 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:09.195581 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335210d-fe04-48d3-a85f-98ca1fb52ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:09.198441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335210d-fe04-48d3-a85f-98ca1fb52ba0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:09.226168 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335210d-fe04-48d3-a85f-98ca1fb52ba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:09.235083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-5335210d-fe04-48d3-a85f-98ca1fb52ba0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 19:38:09.235083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:09.235083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:09.235083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:09.235083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:09.235083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:09.235083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:09.235083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:09.235083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:09.235083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:09.235083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:09.235083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:09.235083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:09.235083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:09.235083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:09.235083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:09.236166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:09.236166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:09.236166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:09.236166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:09.236166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:09.236166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:09.236166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:09.236166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:09.236166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:09.236166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:09.236166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:09.236166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:09.236166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:09.236166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:09.236166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:09.236166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:09.237021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:09.237021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:09.237021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:09.237021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:09.237021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:09.237021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:09.237021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:09.237021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:09.237021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:09.237021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:09.237021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 19:38:09.237021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:09.237021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 74/150] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:38:09.246220 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335210d-fe04-48d3-a85f-98ca1fb52ba0 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:09.302499 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b10b3-a4f1-49b9-9d88-ba17b68d78dd None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:09.349551 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80aaff-3ac7-4e26-a2b8-91d3058e8825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:09.351869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80aaff-3ac7-4e26-a2b8-91d3058e8825 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:09.352314 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80aaff-3ac7-4e26-a2b8-91d3058e8825 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:09.352741 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80aaff-3ac7-4e26-a2b8-91d3058e8825 None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:09.354762 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80aaff-3ac7-4e26-a2b8-91d3058e8825 None admin] RBAC: Authorizing `identity:get_project(project_id=deeac7725be842659d93e27cd19f954b)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:09.357174 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80aaff-3ac7-4e26-a2b8-91d3058e8825 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:09.360377 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 77/151] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:09 2022] GET /identity/v3/projects/deeac7725be842659d93e27cd19f954b => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:09.365602 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80aaff-3ac7-4e26-a2b8-91d3058e8825 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:09.402067 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:09.415413 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335210d-fe04-48d3-a85f-98ca1fb52ba0 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:09.444735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:09.462122 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaa149-a7ff-46fb-9a4c-90cf6972d182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:09.463909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaa149-a7ff-46fb-9a4c-90cf6972d182 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:09.463909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaa149-a7ff-46fb-9a4c-90cf6972d182 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:09.463909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaa149-a7ff-46fb-9a4c-90cf6972d182 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:09.464947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afaa149-a7ff-46fb-9a4c-90cf6972d182 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:09.465434 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afaa149-a7ff-46fb-9a4c-90cf6972d182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:09.467814 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afaa149-a7ff-46fb-9a4c-90cf6972d182 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:09.479325 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 75/152] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:09.485060 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaa149-a7ff-46fb-9a4c-90cf6972d182 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:09.518612 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80aaff-3ac7-4e26-a2b8-91d3058e8825 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:09.584622 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dda78a-b406-4a31-b33f-0fd6833908b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:09.585317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dda78a-b406-4a31-b33f-0fd6833908b9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:09.585641 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dda78a-b406-4a31-b33f-0fd6833908b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:09.585922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dda78a-b406-4a31-b33f-0fd6833908b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:09.588062 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dda78a-b406-4a31-b33f-0fd6833908b9 None admin] RBAC: Adding query filter params (role.id=76bd0cf7bf094e4fa3db121b96215004, scope.project.id=deeac7725be842659d93e27cd19f954b, user.id=d83e81b5c7054c4491fc17ac780d3cea) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:09.590395 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dda78a-b406-4a31-b33f-0fd6833908b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:09.597617 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dda78a-b406-4a31-b33f-0fd6833908b9 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:09.609983 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 78/153] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:09 2022] GET /identity/v3/role_assignments?user.id=d83e81b5c7054c4491fc17ac780d3cea&scope.project.id=deeac7725be842659d93e27cd19f954b&role.id=76bd0cf7bf094e4fa3db121b96215004 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:09.670700 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaa149-a7ff-46fb-9a4c-90cf6972d182 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:09.720145 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2d7a0-651c-46c9-9f48-acbcd9ca4ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:09.721317 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2d7a0-651c-46c9-9f48-acbcd9ca4ba8 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:09.721748 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2d7a0-651c-46c9-9f48-acbcd9ca4ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:09.722169 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2d7a0-651c-46c9-9f48-acbcd9ca4ba8 None admin] PATH_INFO: `/v3/users/d4ee29bb005b4798a21c4becdcd3450f` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:09.724523 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2d7a0-651c-46c9-9f48-acbcd9ca4ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=d4ee29bb005b4798a21c4becdcd3450f)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:09.727065 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2d7a0-651c-46c9-9f48-acbcd9ca4ba8 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:09.729225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 76/154] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:09 2022] GET /identity/v3/users/d4ee29bb005b4798a21c4becdcd3450f => generated 289 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:09.734618 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dda78a-b406-4a31-b33f-0fd6833908b9 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:09.864929 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dda78a-b406-4a31-b33f-0fd6833908b9 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:09.902684 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:09.927230 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cd8d6-a86b-4098-bf2f-9c862eee7ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:09.928120 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cd8d6-a86b-4098-bf2f-9c862eee7ff3 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:09.928406 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cd8d6-a86b-4098-bf2f-9c862eee7ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:09.928685 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cd8d6-a86b-4098-bf2f-9c862eee7ff3 None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:09.933948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cd8d6-a86b-4098-bf2f-9c862eee7ff3 None admin] RBAC: Authorizing `identity:get_project(project_id=deeac7725be842659d93e27cd19f954b)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:09.935441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cd8d6-a86b-4098-bf2f-9c862eee7ff3 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:09.937215 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 79/155] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:09 2022] GET /identity/v3/projects/deeac7725be842659d93e27cd19f954b => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:09.943457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2d7a0-651c-46c9-9f48-acbcd9ca4ba8 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:09.984603 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:10.005712 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086d650-9601-4ea4-920a-8756efbc154c None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:10.006355 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086d650-9601-4ea4-920a-8756efbc154c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:10.007181 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086d650-9601-4ea4-920a-8756efbc154c None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:10.013458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 80/156] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:10.026721 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02ae06-bee5-4db3-b6e3-019d5a97705c None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:10.027352 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02ae06-bee5-4db3-b6e3-019d5a97705c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:10.027828 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02ae06-bee5-4db3-b6e3-019d5a97705c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:10.060731 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-ed02ae06-bee5-4db3-b6e3-019d5a97705c None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:10.063085 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ed02ae06-bee5-4db3-b6e3-019d5a97705c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:10.097043 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2d7a0-651c-46c9-9f48-acbcd9ca4ba8 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:10.163462 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 81/157] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:38:10.166538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebda79-ee71-4db4-a07b-f41a997c6e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:10.167362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebda79-ee71-4db4-a07b-f41a997c6e51 None admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:10.167646 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebda79-ee71-4db4-a07b-f41a997c6e51 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:10.167922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebda79-ee71-4db4-a07b-f41a997c6e51 None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b/users/d4ee29bb005b4798a21c4becdcd3450f/roles/d81add03275a412284f307885c341f6f` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:10.174561 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebda79-ee71-4db4-a07b-f41a997c6e51 None admin] RBAC: Authorizing `identity:create_grant(project_id=deeac7725be842659d93e27cd19f954b, user_id=d4ee29bb005b4798a21c4becdcd3450f, role_id=d81add03275a412284f307885c341f6f)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:10.176057 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebda79-ee71-4db4-a07b-f41a997c6e51 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:10.191161 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02ae06-bee5-4db3-b6e3-019d5a97705c None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:10.276158 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 77/158] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:38:09 2022] PUT /identity/v3/projects/deeac7725be842659d93e27cd19f954b/users/d4ee29bb005b4798a21c4becdcd3450f/roles/d81add03275a412284f307885c341f6f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:38:10.323610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02ae06-bee5-4db3-b6e3-019d5a97705c None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:10.348097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:10.375783 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6bb9a-a487-4445-bf82-2a1eebe2629f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:10.376829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6bb9a-a487-4445-bf82-2a1eebe2629f None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:10.377419 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6bb9a-a487-4445-bf82-2a1eebe2629f None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:10.377741 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6bb9a-a487-4445-bf82-2a1eebe2629f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:10.396511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6bb9a-a487-4445-bf82-2a1eebe2629f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:10.405336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-a5f6bb9a-a487-4445-bf82-2a1eebe2629f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:10.405336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:10.405336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:10.405336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:10.405336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:10.405336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:10.405336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:10.405336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:10.405336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:10.405336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:10.405336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:10.405336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:10.405336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:10.405336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:10.405336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:10.405336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:10.406342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:10.406342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:10.406342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:10.406342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:10.406342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:10.406342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:10.406342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:10.406342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:10.406342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:10.406342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:10.406342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:10.406342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:10.406342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:10.406342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:10.406342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:10.406342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:10.407116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:10.407116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:10.407116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:10.407116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:10.407116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:10.407116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:10.407116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:10.407116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:10.407116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:10.407116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:10.407116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:10.407116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:10.407116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 82/159] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:38:10.415701 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebda79-ee71-4db4-a07b-f41a997c6e51 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:10.512339 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f625f6d-3fdc-4e26-bac6-01ff7ebee9ee None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:10.512663 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f625f6d-3fdc-4e26-bac6-01ff7ebee9ee None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:10.512911 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f625f6d-3fdc-4e26-bac6-01ff7ebee9ee None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:10.514354 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 83/160] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:10.530323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e004fa-b805-41e1-8e29-9db6245bf44e None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:10.530586 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e004fa-b805-41e1-8e29-9db6245bf44e None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:10.530814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e004fa-b805-41e1-8e29-9db6245bf44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:10.552642 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:10.570883 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-b1e004fa-b805-41e1-8e29-9db6245bf44e None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:10.572143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-b1e004fa-b805-41e1-8e29-9db6245bf44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:10.582191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebda79-ee71-4db4-a07b-f41a997c6e51 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:10.661807 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501ac38-c9e5-400c-8719-10c32e7670db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:10.662501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501ac38-c9e5-400c-8719-10c32e7670db None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:10.662785 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501ac38-c9e5-400c-8719-10c32e7670db None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:10.663066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501ac38-c9e5-400c-8719-10c32e7670db None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:10.664356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501ac38-c9e5-400c-8719-10c32e7670db None admin] RBAC: Adding query filter params (name=member) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:10.664664 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501ac38-c9e5-400c-8719-10c32e7670db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:10.666119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501ac38-c9e5-400c-8719-10c32e7670db None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:10.675584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 78/161] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:10.681818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501ac38-c9e5-400c-8719-10c32e7670db None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:10.737788 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 84/162] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:10.792617 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e004fa-b805-41e1-8e29-9db6245bf44e None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:10.863262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501ac38-c9e5-400c-8719-10c32e7670db None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:10.969907 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e948f5-0eae-4f93-9ad1-3d8d455582e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:10.970862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e948f5-0eae-4f93-9ad1-3d8d455582e8 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:10.971156 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e948f5-0eae-4f93-9ad1-3d8d455582e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:10.971438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e948f5-0eae-4f93-9ad1-3d8d455582e8 None admin] PATH_INFO: `/v3/users/c75ee1380a57446ab1c1e588bd5bfa97` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:10.972734 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e948f5-0eae-4f93-9ad1-3d8d455582e8 None admin] RBAC: Authorizing `identity:get_user(user_id=c75ee1380a57446ab1c1e588bd5bfa97)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:10.974414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e948f5-0eae-4f93-9ad1-3d8d455582e8 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:10.976141 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 79/163] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:10 2022] GET /identity/v3/users/c75ee1380a57446ab1c1e588bd5bfa97 => generated 275 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:10.977420 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448a6cd-66d2-40db-b935-f7d4215cb28a None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:10.977710 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448a6cd-66d2-40db-b935-f7d4215cb28a None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:10.977992 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448a6cd-66d2-40db-b935-f7d4215cb28a None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:10.979358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 80/164] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:10.986546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2a45b-5cf7-4d21-aa43-0950230044f1 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:10.986842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2a45b-5cf7-4d21-aa43-0950230044f1 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:10.987125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2a45b-5cf7-4d21-aa43-0950230044f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:11.011661 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e004fa-b805-41e1-8e29-9db6245bf44e None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:11.019985 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-ade2a45b-5cf7-4d21-aa43-0950230044f1 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:11.021201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ade2a45b-5cf7-4d21-aa43-0950230044f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:11.023811 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:11.032615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:11.085351 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e49b33-4c72-4439-b9ac-68c033847dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:11.086652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e49b33-4c72-4439-b9ac-68c033847dea None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:11.086945 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e49b33-4c72-4439-b9ac-68c033847dea None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:11.087277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e49b33-4c72-4439-b9ac-68c033847dea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:11.121189 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e49b33-4c72-4439-b9ac-68c033847dea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:11.130210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-23e49b33-4c72-4439-b9ac-68c033847dea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:11.130210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:11.130210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:11.130210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:11.130210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:11.130210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:11.130210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:11.130210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:11.130210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:11.130210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:11.130210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:11.130210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:11.130210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:11.130210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:11.130210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:11.130210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:11.131164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:11.131164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:11.131164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:11.131164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:11.131164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:11.131164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:11.131164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:11.131164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:11.131164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:11.131164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:11.131164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:11.131164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:11.131164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:11.131164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:11.131164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:11.131164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:11.131940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:11.131940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:11.131940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:11.131940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:11.131940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:11.131940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:11.131940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:11.131940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:11.131940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:11.131940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:11.131940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:11.131940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:11.137902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 85/165] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:38:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:38:11.138755 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e49b33-4c72-4439-b9ac-68c033847dea None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:11.181181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 81/166] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:11.181181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2a45b-5cf7-4d21-aa43-0950230044f1 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:11.343445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e49b33-4c72-4439-b9ac-68c033847dea None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:11.392509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34ff11-4638-47cf-bfee-14c7d24103c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:11.393553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34ff11-4638-47cf-bfee-14c7d24103c0 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:11.394078 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34ff11-4638-47cf-bfee-14c7d24103c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:11.394564 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34ff11-4638-47cf-bfee-14c7d24103c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:11.418797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2a45b-5cf7-4d21-aa43-0950230044f1 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:11.457552 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:11.496713 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43078daa-c1b1-440a-ad01-dd6cc6c12248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:11.497453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43078daa-c1b1-440a-ad01-dd6cc6c12248 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:11.497746 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43078daa-c1b1-440a-ad01-dd6cc6c12248 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:11.498037 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43078daa-c1b1-440a-ad01-dd6cc6c12248 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:11.498810 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43078daa-c1b1-440a-ad01-dd6cc6c12248 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:11.499124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43078daa-c1b1-440a-ad01-dd6cc6c12248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:11.500589 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43078daa-c1b1-440a-ad01-dd6cc6c12248 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:11.514983 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 82/167] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:38:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:11.515650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43078daa-c1b1-440a-ad01-dd6cc6c12248 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:11.525543 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:11.566016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34ff11-4638-47cf-bfee-14c7d24103c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:11.567758 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34ff11-4638-47cf-bfee-14c7d24103c0 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:11.666534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43078daa-c1b1-440a-ad01-dd6cc6c12248 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:11.758424 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 86/168] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:11.759652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34ff11-4638-47cf-bfee-14c7d24103c0 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:11.765552 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e955fc-2a1a-495e-a92b-09b9b9212bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:11.766365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e955fc-2a1a-495e-a92b-09b9b9212bae None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:11.766654 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e955fc-2a1a-495e-a92b-09b9b9212bae None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:11.766935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e955fc-2a1a-495e-a92b-09b9b9212bae None admin] PATH_INFO: `/v3/roles/member` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:11.791169 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e955fc-2a1a-495e-a92b-09b9b9212bae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:11.799480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-18e955fc-2a1a-495e-a92b-09b9b9212bae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:11.799480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:11.799480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:11.799480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:11.799480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:11.799480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:11.799480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:11.799480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:11.799480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:11.799480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:11.799480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:11.799480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:11.799480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:11.799480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:11.799480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:11.799480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:11.800365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:11.800365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:11.800365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:11.800365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:11.800365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:11.800365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:11.800365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:11.800365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:11.800365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:11.800365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:11.800365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:11.800365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:11.800365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:11.800365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:11.800365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:11.800365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:11.801188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:11.801188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:11.801188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:11.801188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:11.801188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:11.801188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:11.801188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:11.801188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:11.801188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:11.801188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:11.801188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:11.801188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:11.801188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 83/169] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:11.810031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e955fc-2a1a-495e-a92b-09b9b9212bae None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:11.841521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:11.908542 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34ff11-4638-47cf-bfee-14c7d24103c0 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:11.965635 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:11.990693 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797c015-6b25-409b-868c-da09664d3034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:11.991583 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797c015-6b25-409b-868c-da09664d3034 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:11.991973 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797c015-6b25-409b-868c-da09664d3034 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:11.992259 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797c015-6b25-409b-868c-da09664d3034 None admin] PATH_INFO: `/v3/users/c75ee1380a57446ab1c1e588bd5bfa97` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:11.993873 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797c015-6b25-409b-868c-da09664d3034 None admin] RBAC: Authorizing `identity:get_user(user_id=c75ee1380a57446ab1c1e588bd5bfa97)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:11.995351 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797c015-6b25-409b-868c-da09664d3034 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:11.997025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 87/170] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:11 2022] GET /identity/v3/users/c75ee1380a57446ab1c1e588bd5bfa97 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:11.997823 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797c015-6b25-409b-868c-da09664d3034 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:12.021397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e955fc-2a1a-495e-a92b-09b9b9212bae None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:12.085465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3eadf-3c02-46d6-805a-c714c52b85e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:12.086966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3eadf-3c02-46d6-805a-c714c52b85e1 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:12.087330 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3eadf-3c02-46d6-805a-c714c52b85e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:12.087559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3eadf-3c02-46d6-805a-c714c52b85e1 None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:12.090273 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3eadf-3c02-46d6-805a-c714c52b85e1 None admin] RBAC: Authorizing `identity:get_project(project_id=deeac7725be842659d93e27cd19f954b)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:12.092932 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3eadf-3c02-46d6-805a-c714c52b85e1 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:12.101351 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 84/171] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:11 2022] GET /identity/v3/projects/deeac7725be842659d93e27cd19f954b => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:12.102297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3eadf-3c02-46d6-805a-c714c52b85e1 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:12.201080 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797c015-6b25-409b-868c-da09664d3034 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:12.224033 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3eadf-3c02-46d6-805a-c714c52b85e1 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:12.254847 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:12.261127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8fb9a-8153-403b-808b-f2d3ff2e0015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:12.266831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8fb9a-8153-403b-808b-f2d3ff2e0015 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:12.266831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8fb9a-8153-403b-808b-f2d3ff2e0015 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:12.266831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8fb9a-8153-403b-808b-f2d3ff2e0015 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:12.290406 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca050d59-dde2-4462-8fec-16f9fe52d367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:12.291019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca050d59-dde2-4462-8fec-16f9fe52d367 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:12.291417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca050d59-dde2-4462-8fec-16f9fe52d367 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:12.291804 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca050d59-dde2-4462-8fec-16f9fe52d367 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:12.292687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca050d59-dde2-4462-8fec-16f9fe52d367 None admin] RBAC: Adding query filter params (name=member) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:12.293112 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca050d59-dde2-4462-8fec-16f9fe52d367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:12.294650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca050d59-dde2-4462-8fec-16f9fe52d367 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:12.297458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:12.312461 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 88/172] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:12.313378 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca050d59-dde2-4462-8fec-16f9fe52d367 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:12.344436 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8fb9a-8153-403b-808b-f2d3ff2e0015 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:12.345975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8fb9a-8153-403b-808b-f2d3ff2e0015 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:12.452916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 85/173] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:12.453807 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8fb9a-8153-403b-808b-f2d3ff2e0015 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:12.489576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:12.517737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca050d59-dde2-4462-8fec-16f9fe52d367 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:12.557753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9ba03-7141-468b-81d0-bc74217e2429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:12.558441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9ba03-7141-468b-81d0-bc74217e2429 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:12.558785 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9ba03-7141-468b-81d0-bc74217e2429 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:12.559072 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9ba03-7141-468b-81d0-bc74217e2429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:12.559391 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8fb9a-8153-403b-808b-f2d3ff2e0015 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:12.559909 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9ba03-7141-468b-81d0-bc74217e2429 None admin] RBAC: Adding query filter params (role.id=61895d866a7c44de8924486b8e5ec6e8, scope.project.id=deeac7725be842659d93e27cd19f954b, user.id=c75ee1380a57446ab1c1e588bd5bfa97) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:12.560228 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9ba03-7141-468b-81d0-bc74217e2429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:12.561926 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9ba03-7141-468b-81d0-bc74217e2429 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:12.568624 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 89/174] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:12 2022] GET /identity/v3/role_assignments?user.id=c75ee1380a57446ab1c1e588bd5bfa97&scope.project.id=deeac7725be842659d93e27cd19f954b&role.id=61895d866a7c44de8924486b8e5ec6e8 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:12.570545 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5004cb-d84c-4f19-9687-760d241fda69 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:12.570840 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5004cb-d84c-4f19-9687-760d241fda69 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:12.571123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5004cb-d84c-4f19-9687-760d241fda69 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:12.572557 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 90/175] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:12.573187 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5004cb-d84c-4f19-9687-760d241fda69 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:12.609687 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd9f0f-a084-4f9c-921a-d575d84485b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:12.610601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd9f0f-a084-4f9c-921a-d575d84485b7 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:12.610885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd9f0f-a084-4f9c-921a-d575d84485b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:12.611160 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd9f0f-a084-4f9c-921a-d575d84485b7 None admin] PATH_INFO: `/v3/users/c75ee1380a57446ab1c1e588bd5bfa97` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:12.612504 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd9f0f-a084-4f9c-921a-d575d84485b7 None admin] RBAC: Authorizing `identity:get_user(user_id=c75ee1380a57446ab1c1e588bd5bfa97)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:12.614044 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd9f0f-a084-4f9c-921a-d575d84485b7 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:12.615794 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 86/176] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:12 2022] GET /identity/v3/users/c75ee1380a57446ab1c1e588bd5bfa97 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:12.617720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43553178-4d43-403b-b966-f3447b9705b3 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:12.617995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43553178-4d43-403b-b966-f3447b9705b3 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:12.618259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43553178-4d43-403b-b966-f3447b9705b3 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:12.619809 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 87/177] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:12.620738 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8b36f-3090-476b-b4b6-a5bfd4d17734 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:12.621236 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8b36f-3090-476b-b4b6-a5bfd4d17734 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:12.621562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8b36f-3090-476b-b4b6-a5bfd4d17734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:12.640669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-4ad8b36f-3090-476b-b4b6-a5bfd4d17734 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:12.641926 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-4ad8b36f-3090-476b-b4b6-a5bfd4d17734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:12.669447 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:12.720267 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5004cb-d84c-4f19-9687-760d241fda69 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:12.721252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 88/178] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:12.722502 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8b36f-3090-476b-b4b6-a5bfd4d17734 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:12.756316 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:12.760956 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fd2b7-08fa-416d-9e7f-ebbd80f90441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:12.761940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fd2b7-08fa-416d-9e7f-ebbd80f90441 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:12.762231 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fd2b7-08fa-416d-9e7f-ebbd80f90441 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:12.762564 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fd2b7-08fa-416d-9e7f-ebbd80f90441 None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:12.763915 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fd2b7-08fa-416d-9e7f-ebbd80f90441 None admin] RBAC: Authorizing `identity:get_project(project_id=deeac7725be842659d93e27cd19f954b)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:12.765512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fd2b7-08fa-416d-9e7f-ebbd80f90441 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:12.770241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 91/179] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:12 2022] GET /identity/v3/projects/deeac7725be842659d93e27cd19f954b => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:12.770241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde0b27-fb4d-495d-8eeb-3672f9841f6b None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:12.770241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde0b27-fb4d-495d-8eeb-3672f9841f6b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:12.770241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde0b27-fb4d-495d-8eeb-3672f9841f6b None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:12.770816 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 92/180] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:12.772025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafb502-5332-4d92-9de0-2e74ac0a8e28 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:12.772656 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafb502-5332-4d92-9de0-2e74ac0a8e28 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:12.773083 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafb502-5332-4d92-9de0-2e74ac0a8e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:12.791105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-0fafb502-5332-4d92-9de0-2e74ac0a8e28 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:12.792267 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-0fafb502-5332-4d92-9de0-2e74ac0a8e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:12.838872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8b36f-3090-476b-b4b6-a5bfd4d17734 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:12.876863 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 93/181] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:12.877797 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafb502-5332-4d92-9de0-2e74ac0a8e28 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:12.890042 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac733b-51b5-4d41-af52-8b4d46cbb5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:12.891536 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac733b-51b5-4d41-af52-8b4d46cbb5e6 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:12.891831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac733b-51b5-4d41-af52-8b4d46cbb5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:12.892117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac733b-51b5-4d41-af52-8b4d46cbb5e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:12.966962 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:12.968376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac733b-51b5-4d41-af52-8b4d46cbb5e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:12.969962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac733b-51b5-4d41-af52-8b4d46cbb5e6 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:13.001763 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:13.010925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafb502-5332-4d92-9de0-2e74ac0a8e28 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:13.047573 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b6042-bcf2-4b21-a7e9-b6b262f79232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:13.048380 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b6042-bcf2-4b21-a7e9-b6b262f79232 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:13.049091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b6042-bcf2-4b21-a7e9-b6b262f79232 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:13.049408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b6042-bcf2-4b21-a7e9-b6b262f79232 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:13.061604 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b6042-bcf2-4b21-a7e9-b6b262f79232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:13.072398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-131b6042-bcf2-4b21-a7e9-b6b262f79232 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:38:13.072398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:13.072398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:13.072398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:13.072398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:13.072398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:13.072398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:13.072398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:13.072398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:13.072398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:13.072398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:13.072398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:13.072398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:13.072398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:13.072398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:13.072398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:13.073372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:13.073372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:13.073372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:13.073372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:13.073372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:13.073372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:13.073372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:13.073372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:13.073372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:13.073372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:13.073372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:13.073372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:13.073372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:13.073372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:13.073372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:13.073372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:13.074190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:13.074190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:13.074190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:13.074190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:13.074190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:13.074190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:13.074190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:13.074190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:13.074190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:13.074190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:13.074190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:38:13.074190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:13.074835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 94/182] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:38:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:13.075513 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b6042-bcf2-4b21-a7e9-b6b262f79232 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:13.078838 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 89/183] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:13.080328 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721f855-bf3a-4ef3-a3b4-f4eebea5ba98 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:13.080619 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721f855-bf3a-4ef3-a3b4-f4eebea5ba98 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:13.080898 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721f855-bf3a-4ef3-a3b4-f4eebea5ba98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:13.099136 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-c721f855-bf3a-4ef3-a3b4-f4eebea5ba98 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:13.100324 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c721f855-bf3a-4ef3-a3b4-f4eebea5ba98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:13.170761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 90/184] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:13.171609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721f855-bf3a-4ef3-a3b4-f4eebea5ba98 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:13.207428 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b6042-bcf2-4b21-a7e9-b6b262f79232 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:13.227825 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:13.237804 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:13.246360 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc190d68-b32f-4234-85b7-c193573d5f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:13.247018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc190d68-b32f-4234-85b7-c193573d5f96 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:13.247304 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc190d68-b32f-4234-85b7-c193573d5f96 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:13.247581 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc190d68-b32f-4234-85b7-c193573d5f96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:13.248422 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc190d68-b32f-4234-85b7-c193573d5f96 None admin] RBAC: Adding query filter params (role.id=f0bb7fa65c8545699b60f857f930b078, scope.project.id=deeac7725be842659d93e27cd19f954b, user.id=c75ee1380a57446ab1c1e588bd5bfa97) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:13.248740 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc190d68-b32f-4234-85b7-c193573d5f96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:13.250271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc190d68-b32f-4234-85b7-c193573d5f96 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:13.256060 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 95/185] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:13 2022] GET /identity/v3/role_assignments?user.id=c75ee1380a57446ab1c1e588bd5bfa97&scope.project.id=deeac7725be842659d93e27cd19f954b&role.id=f0bb7fa65c8545699b60f857f930b078 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:13.256844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc190d68-b32f-4234-85b7-c193573d5f96 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:13.283900 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721f855-bf3a-4ef3-a3b4-f4eebea5ba98 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:13.332070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae2989-94d8-4b4e-a8e9-83d61f8e61c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:13.332947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae2989-94d8-4b4e-a8e9-83d61f8e61c3 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:13.333281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae2989-94d8-4b4e-a8e9-83d61f8e61c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:13.333565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae2989-94d8-4b4e-a8e9-83d61f8e61c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:13.335804 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae2989-94d8-4b4e-a8e9-83d61f8e61c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:13.337418 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae2989-94d8-4b4e-a8e9-83d61f8e61c3 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:13.340413 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 91/186] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:13.341365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae2989-94d8-4b4e-a8e9-83d61f8e61c3 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:13.395772 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc190d68-b32f-4234-85b7-c193573d5f96 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:13.439403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f5dc0-ab93-47cd-a983-7e22b85d3882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:13.440080 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f5dc0-ab93-47cd-a983-7e22b85d3882 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:13.440364 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f5dc0-ab93-47cd-a983-7e22b85d3882 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:13.440643 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f5dc0-ab93-47cd-a983-7e22b85d3882 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:13.441424 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f5dc0-ab93-47cd-a983-7e22b85d3882 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:13.441733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f5dc0-ab93-47cd-a983-7e22b85d3882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:13.443381 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f5dc0-ab93-47cd-a983-7e22b85d3882 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:13.455366 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 96/187] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:13.456037 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f5dc0-ab93-47cd-a983-7e22b85d3882 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:13.477328 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae2989-94d8-4b4e-a8e9-83d61f8e61c3 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:13.508988 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:13.512843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:13.517691 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ffad4-4672-463c-8b29-14a387f04cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:13.518605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ffad4-4672-463c-8b29-14a387f04cb6 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:13.525972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ffad4-4672-463c-8b29-14a387f04cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:13.525972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ffad4-4672-463c-8b29-14a387f04cb6 None admin] PATH_INFO: `/v3/projects/513b26119e324aa7a5de1353cab57400` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:13.525972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ffad4-4672-463c-8b29-14a387f04cb6 None admin] RBAC: Authorizing `identity:get_project(project_id=513b26119e324aa7a5de1353cab57400)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:13.525972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ffad4-4672-463c-8b29-14a387f04cb6 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:13.525972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 92/188] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:13 2022] GET /identity/v3/projects/513b26119e324aa7a5de1353cab57400 => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:13.525972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ffad4-4672-463c-8b29-14a387f04cb6 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:13.566976 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f5dc0-ab93-47cd-a983-7e22b85d3882 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:13.603499 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f6db2-06c2-458f-afc7-b0b9f7a4a813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:13.604300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f6db2-06c2-458f-afc7-b0b9f7a4a813 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:13.604583 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f6db2-06c2-458f-afc7-b0b9f7a4a813 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:13.604859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f6db2-06c2-458f-afc7-b0b9f7a4a813 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:13.614989 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f6db2-06c2-458f-afc7-b0b9f7a4a813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:13.623055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-4a9f6db2-06c2-458f-afc7-b0b9f7a4a813 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:13.623055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:13.623055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:13.623055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:13.623055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:13.623055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:13.623055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:13.623055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:13.623055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:13.623055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:13.623055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:13.623055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:13.623055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:13.623055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:13.623055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:13.623055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:13.629346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:13.629346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:13.629346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:13.629346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:13.629346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:13.629346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:13.629346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:13.629346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:13.629346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:13.629346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:13.629346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:13.629346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:13.629346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:13.629346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:13.629346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:13.629346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:13.630596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:13.630596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:13.630596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:13.630596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:13.630596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:13.630596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:13.630596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:13.630596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:13.630596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:13.630596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:13.630596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:13.630596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:13.630596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 97/189] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:38:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:13.630596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f6db2-06c2-458f-afc7-b0b9f7a4a813 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:13.631472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ffad4-4672-463c-8b29-14a387f04cb6 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:13.659956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996f78c-c882-4473-98f9-484ebdd35062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:13.660623 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996f78c-c882-4473-98f9-484ebdd35062 None admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:13.660909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996f78c-c882-4473-98f9-484ebdd35062 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:13.661213 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996f78c-c882-4473-98f9-484ebdd35062 None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:13.661924 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996f78c-c882-4473-98f9-484ebdd35062 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:13.663368 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996f78c-c882-4473-98f9-484ebdd35062 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:13.727020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f6db2-06c2-458f-afc7-b0b9f7a4a813 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:13.729253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:13.743075 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 93/190] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 19:38:13 2022] POST /identity/v3/users => generated 297 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:38:13.744509 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6def2-4d76-4d13-9b72-1f07a0ec4021 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:13.744802 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6def2-4d76-4d13-9b72-1f07a0ec4021 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:13.745086 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6def2-4d76-4d13-9b72-1f07a0ec4021 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:13.749767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 94/191] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:13.749767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6def2-4d76-4d13-9b72-1f07a0ec4021 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:13.766095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc760f-d5bf-4684-bde2-5ba69a54b70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:13.774079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc760f-d5bf-4684-bde2-5ba69a54b70e None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:13.774079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc760f-d5bf-4684-bde2-5ba69a54b70e None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:13.774079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc760f-d5bf-4684-bde2-5ba69a54b70e None admin] PATH_INFO: `/v3/users/5ffcefcb92714491a79e1e609f28771b` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:13.784031 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc760f-d5bf-4684-bde2-5ba69a54b70e None admin] RBAC: Authorizing `identity:get_user(user_id=5ffcefcb92714491a79e1e609f28771b)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:13.785625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc760f-d5bf-4684-bde2-5ba69a54b70e None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:13.792115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 98/192] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:13 2022] GET /identity/v3/users/5ffcefcb92714491a79e1e609f28771b => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:13.792115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc760f-d5bf-4684-bde2-5ba69a54b70e None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:13.821575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:13.872865 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6def2-4d76-4d13-9b72-1f07a0ec4021 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:13.912163 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc760f-d5bf-4684-bde2-5ba69a54b70e None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:13.912420 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f98406-19da-49b7-b012-b789a050d26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:13.913247 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f98406-19da-49b7-b012-b789a050d26e None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:13.913700 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f98406-19da-49b7-b012-b789a050d26e None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:13.914891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f98406-19da-49b7-b012-b789a050d26e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:13.916084 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f98406-19da-49b7-b012-b789a050d26e None admin] RBAC: Adding query filter params (role.id=61895d866a7c44de8924486b8e5ec6e8, scope.project.id=513b26119e324aa7a5de1353cab57400, user.id=c75ee1380a57446ab1c1e588bd5bfa97) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:13.916624 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f98406-19da-49b7-b012-b789a050d26e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:13.918302 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f98406-19da-49b7-b012-b789a050d26e None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:13.925499 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 95/193] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:13 2022] GET /identity/v3/role_assignments?user.id=c75ee1380a57446ab1c1e588bd5bfa97&scope.project.id=513b26119e324aa7a5de1353cab57400&role.id=61895d866a7c44de8924486b8e5ec6e8 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:13.926560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581b583-c866-43f5-9749-070409cba309 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:13.926857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581b583-c866-43f5-9749-070409cba309 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:13.927141 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581b583-c866-43f5-9749-070409cba309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:13.947993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-6581b583-c866-43f5-9749-070409cba309 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:13.949393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-6581b583-c866-43f5-9749-070409cba309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:13.965345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966b5ed-f437-45ba-aef0-f80bb775f01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:13.966341 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966b5ed-f437-45ba-aef0-f80bb775f01b None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:13.966813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966b5ed-f437-45ba-aef0-f80bb775f01b None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:13.967094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966b5ed-f437-45ba-aef0-f80bb775f01b None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:13.967863 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966b5ed-f437-45ba-aef0-f80bb775f01b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:13.968172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966b5ed-f437-45ba-aef0-f80bb775f01b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:13.969621 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966b5ed-f437-45ba-aef0-f80bb775f01b None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:13.980959 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 99/194] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:38:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:13.982312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966b5ed-f437-45ba-aef0-f80bb775f01b None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:14.024289 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:14.057648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 96/195] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:14.059246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581b583-c866-43f5-9749-070409cba309 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:14.131751 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:14.139875 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966b5ed-f437-45ba-aef0-f80bb775f01b None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:14.181375 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f66e0-4e70-4082-81a6-d6e97eb8497c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:14.182037 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f66e0-4e70-4082-81a6-d6e97eb8497c None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:14.182322 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f66e0-4e70-4082-81a6-d6e97eb8497c None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:14.182602 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f66e0-4e70-4082-81a6-d6e97eb8497c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:14.197500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581b583-c866-43f5-9749-070409cba309 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:14.243676 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c4a96-ddb9-478e-8eca-b90b0366da44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:14.245434 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c4a96-ddb9-478e-8eca-b90b0366da44 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:14.245728 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c4a96-ddb9-478e-8eca-b90b0366da44 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:14.246008 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c4a96-ddb9-478e-8eca-b90b0366da44 None admin] PATH_INFO: `/v3/users/5ffcefcb92714491a79e1e609f28771b` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:14.247949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c4a96-ddb9-478e-8eca-b90b0366da44 None admin] RBAC: Authorizing `identity:get_user(user_id=5ffcefcb92714491a79e1e609f28771b)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:14.249518 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c4a96-ddb9-478e-8eca-b90b0366da44 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:14.252076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 97/196] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:14 2022] GET /identity/v3/users/5ffcefcb92714491a79e1e609f28771b => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:14.252910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c4a96-ddb9-478e-8eca-b90b0366da44 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:14.269843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f66e0-4e70-4082-81a6-d6e97eb8497c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:14.271313 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f66e0-4e70-4082-81a6-d6e97eb8497c None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:14.298974 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:14.384628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 100/197] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:14.385779 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f66e0-4e70-4082-81a6-d6e97eb8497c None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:14.392626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c4a96-ddb9-478e-8eca-b90b0366da44 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:14.408189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:14.430241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150940a-e848-4b2a-9f3e-34a5a8e66f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:14.431417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150940a-e848-4b2a-9f3e-34a5a8e66f96 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:14.431704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150940a-e848-4b2a-9f3e-34a5a8e66f96 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:14.431981 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150940a-e848-4b2a-9f3e-34a5a8e66f96 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:14.445951 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150940a-e848-4b2a-9f3e-34a5a8e66f96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:14.457342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-2150940a-e848-4b2a-9f3e-34a5a8e66f96 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 19:38:14.457342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:14.457342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:14.457342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:14.457342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:14.457342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:14.457342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:14.457342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:14.457342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:14.457342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:14.457342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:14.457342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:14.457342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:14.457342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:14.457342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:14.457342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:14.458426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:14.458426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:14.458426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:14.458426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:14.458426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:14.458426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:14.458426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:14.458426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:14.458426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:14.458426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:14.458426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:14.458426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:14.458426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:14.458426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:14.458426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:14.458426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:14.459327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:14.459327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:14.459327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:14.459327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:14.459327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:14.459327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:14.459327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:14.459327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:14.459327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:14.459327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:14.459327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 19:38:14.459327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:14.459327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 98/198] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:14.460151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150940a-e848-4b2a-9f3e-34a5a8e66f96 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:14.489806 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f66e0-4e70-4082-81a6-d6e97eb8497c None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:14.522859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:14.526953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868c741-36be-4157-9133-353faa2f9b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:14.527904 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868c741-36be-4157-9133-353faa2f9b24 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:14.528306 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868c741-36be-4157-9133-353faa2f9b24 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:14.528877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868c741-36be-4157-9133-353faa2f9b24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:14.587939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150940a-e848-4b2a-9f3e-34a5a8e66f96 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:14.623112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba2778-27dd-4bc6-a190-e4f7e5d6b2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:14.623496 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868c741-36be-4157-9133-353faa2f9b24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:14.623978 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba2778-27dd-4bc6-a190-e4f7e5d6b2d2 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:14.624257 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba2778-27dd-4bc6-a190-e4f7e5d6b2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:14.624529 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba2778-27dd-4bc6-a190-e4f7e5d6b2d2 None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:14.625407 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868c741-36be-4157-9133-353faa2f9b24 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:14.625737 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba2778-27dd-4bc6-a190-e4f7e5d6b2d2 None admin] RBAC: Authorizing `identity:get_project(project_id=3ffde5ab0f994cd5b8e67d5092a69564)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:14.627252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba2778-27dd-4bc6-a190-e4f7e5d6b2d2 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:14.629049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 99/199] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:14 2022] GET /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:14.629877 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba2778-27dd-4bc6-a190-e4f7e5d6b2d2 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:14.692269 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:14.731651 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 101/200] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:14.732586 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868c741-36be-4157-9133-353faa2f9b24 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:14.758205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:14.769939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba2778-27dd-4bc6-a190-e4f7e5d6b2d2 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:14.808090 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bb04e-7a71-4157-aadd-7c6ee3831972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:14.808533 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bb04e-7a71-4157-aadd-7c6ee3831972 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:14.808816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bb04e-7a71-4157-aadd-7c6ee3831972 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:14.809090 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bb04e-7a71-4157-aadd-7c6ee3831972 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:14.809885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704bb04e-7a71-4157-aadd-7c6ee3831972 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:14.810195 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704bb04e-7a71-4157-aadd-7c6ee3831972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:14.811652 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704bb04e-7a71-4157-aadd-7c6ee3831972 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:14.821816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 100/201] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:14.823327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bb04e-7a71-4157-aadd-7c6ee3831972 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:14.846569 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868c741-36be-4157-9133-353faa2f9b24 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:14.892289 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca0d54-abdc-43b6-9d8a-8cbc4abb9779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:14.892960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca0d54-abdc-43b6-9d8a-8cbc4abb9779 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:14.893309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca0d54-abdc-43b6-9d8a-8cbc4abb9779 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:14.893592 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca0d54-abdc-43b6-9d8a-8cbc4abb9779 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:14.894948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca0d54-abdc-43b6-9d8a-8cbc4abb9779 None admin] RBAC: Adding query filter params (role.id=76bd0cf7bf094e4fa3db121b96215004, scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564, user.id=5ffcefcb92714491a79e1e609f28771b) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:14.895263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca0d54-abdc-43b6-9d8a-8cbc4abb9779 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:14.897003 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca0d54-abdc-43b6-9d8a-8cbc4abb9779 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:14.906062 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 102/202] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:14 2022] GET /identity/v3/role_assignments?user.id=5ffcefcb92714491a79e1e609f28771b&scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564&role.id=76bd0cf7bf094e4fa3db121b96215004 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:14.906062 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca0d54-abdc-43b6-9d8a-8cbc4abb9779 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:15.000381 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bb04e-7a71-4157-aadd-7c6ee3831972 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:15.005508 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:15.075861 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde7c9e-57bf-4bc2-afb5-e88169ebdea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:15.076730 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde7c9e-57bf-4bc2-afb5-e88169ebdea3 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:15.077011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde7c9e-57bf-4bc2-afb5-e88169ebdea3 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:15.077310 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde7c9e-57bf-4bc2-afb5-e88169ebdea3 None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:15.079534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde7c9e-57bf-4bc2-afb5-e88169ebdea3 None admin] RBAC: Authorizing `identity:get_project(project_id=3ffde5ab0f994cd5b8e67d5092a69564)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:15.081015 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde7c9e-57bf-4bc2-afb5-e88169ebdea3 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:15.083186 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 101/203] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:14 2022] GET /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:15.090237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde7c9e-57bf-4bc2-afb5-e88169ebdea3 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:15.094922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:15.108878 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca0d54-abdc-43b6-9d8a-8cbc4abb9779 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:15.188250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d1306-19ec-4347-afc5-6131a035313a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:15.189236 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d1306-19ec-4347-afc5-6131a035313a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:15.189527 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d1306-19ec-4347-afc5-6131a035313a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:15.189858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d1306-19ec-4347-afc5-6131a035313a None admin] PATH_INFO: `/v3/users/d4ee29bb005b4798a21c4becdcd3450f` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:15.193432 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d1306-19ec-4347-afc5-6131a035313a None admin] RBAC: Authorizing `identity:get_user(user_id=d4ee29bb005b4798a21c4becdcd3450f)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:15.195600 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d1306-19ec-4347-afc5-6131a035313a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:15.197350 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 103/204] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:14 2022] GET /identity/v3/users/d4ee29bb005b4798a21c4becdcd3450f => generated 289 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:15.205806 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d1306-19ec-4347-afc5-6131a035313a None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:15.208249 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde7c9e-57bf-4bc2-afb5-e88169ebdea3 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:15.249671 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafe8b5-6ff2-4445-b233-4bcf39300e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:15.250333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafe8b5-6ff2-4445-b233-4bcf39300e22 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:15.250949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafe8b5-6ff2-4445-b233-4bcf39300e22 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:15.251178 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafe8b5-6ff2-4445-b233-4bcf39300e22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:15.252453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafe8b5-6ff2-4445-b233-4bcf39300e22 None admin] RBAC: Adding query filter params (role.id=f0bb7fa65c8545699b60f857f930b078, scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564, user.id=5ffcefcb92714491a79e1e609f28771b) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:15.252778 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafe8b5-6ff2-4445-b233-4bcf39300e22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:15.254432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafe8b5-6ff2-4445-b233-4bcf39300e22 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:15.261966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 102/205] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:15 2022] GET /identity/v3/role_assignments?user.id=5ffcefcb92714491a79e1e609f28771b&scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564&role.id=f0bb7fa65c8545699b60f857f930b078 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:15.354885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d1306-19ec-4347-afc5-6131a035313a None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:15.394032 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa08e5-ef7f-4c0d-8421-110212c5fba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:15.394693 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa08e5-ef7f-4c0d-8421-110212c5fba6 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:15.394975 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa08e5-ef7f-4c0d-8421-110212c5fba6 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:15.395252 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa08e5-ef7f-4c0d-8421-110212c5fba6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:15.423849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:15.469464 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa08e5-ef7f-4c0d-8421-110212c5fba6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:15.470977 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa08e5-ef7f-4c0d-8421-110212c5fba6 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:15.611379 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 104/206] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 19:38:15.617259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafe8b5-6ff2-4445-b233-4bcf39300e22 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:15.654110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:15.720442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafe8b5-6ff2-4445-b233-4bcf39300e22 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:15.754630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b28996-4397-4ea5-9590-f97cb315a044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:15.755543 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b28996-4397-4ea5-9590-f97cb315a044 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:15.755833 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b28996-4397-4ea5-9590-f97cb315a044 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:15.756104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b28996-4397-4ea5-9590-f97cb315a044 None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:15.757842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b28996-4397-4ea5-9590-f97cb315a044 None admin] RBAC: Authorizing `identity:get_project(project_id=deeac7725be842659d93e27cd19f954b)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:15.759297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b28996-4397-4ea5-9590-f97cb315a044 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:15.761356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 103/207] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:15 2022] GET /identity/v3/projects/deeac7725be842659d93e27cd19f954b => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:15.770233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa08e5-ef7f-4c0d-8421-110212c5fba6 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:15.848723 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:15.933747 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa08e5-ef7f-4c0d-8421-110212c5fba6 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:15.971720 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8d620-74e5-4a0d-8cb3-f6b23550f5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:15.972381 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8d620-74e5-4a0d-8cb3-f6b23550f5aa None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:15.972662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8d620-74e5-4a0d-8cb3-f6b23550f5aa None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:15.972937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8d620-74e5-4a0d-8cb3-f6b23550f5aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:15.973895 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8d620-74e5-4a0d-8cb3-f6b23550f5aa None admin] RBAC: Adding query filter params (role.id=d81add03275a412284f307885c341f6f, scope.project.id=deeac7725be842659d93e27cd19f954b, user.id=d4ee29bb005b4798a21c4becdcd3450f) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:15.974212 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8d620-74e5-4a0d-8cb3-f6b23550f5aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:15.975662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8d620-74e5-4a0d-8cb3-f6b23550f5aa None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:15.982347 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 105/208] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:15 2022] GET /identity/v3/role_assignments?user.id=d4ee29bb005b4798a21c4becdcd3450f&scope.project.id=deeac7725be842659d93e27cd19f954b&role.id=d81add03275a412284f307885c341f6f => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:16.289178 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d4e5b-a745-4b84-8046-39e766fc0eff None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:16.289739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d4e5b-a745-4b84-8046-39e766fc0eff None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:16.289739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d4e5b-a745-4b84-8046-39e766fc0eff None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:16.291007 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 104/209] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:16.296325 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0b9a6-10dd-4168-aa83-a392fede0e09 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:16.296620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0b9a6-10dd-4168-aa83-a392fede0e09 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:16.296906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0b9a6-10dd-4168-aa83-a392fede0e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:16.315133 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-63a0b9a6-10dd-4168-aa83-a392fede0e09 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:16.316336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-63a0b9a6-10dd-4168-aa83-a392fede0e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:16.366288 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713019a9-2aa4-4e66-9271-261c8b3e4099 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:16.366979 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713019a9-2aa4-4e66-9271-261c8b3e4099 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:16.367475 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713019a9-2aa4-4e66-9271-261c8b3e4099 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:16.370154 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 105/210] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:38:16.376459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b7267-0d4b-43d9-8ac5-a9e35d5fea16 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:16.377010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b7267-0d4b-43d9-8ac5-a9e35d5fea16 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:16.377547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b7267-0d4b-43d9-8ac5-a9e35d5fea16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:16.395873 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-f49b7267-0d4b-43d9-8ac5-a9e35d5fea16 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:16.396802 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 106/211] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:16.398718 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f49b7267-0d4b-43d9-8ac5-a9e35d5fea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:16.428050 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0b9a6-10dd-4168-aa83-a392fede0e09 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:16.484875 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 106/212] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:16.499234 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:16.518692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b7267-0d4b-43d9-8ac5-a9e35d5fea16 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:16.559876 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:16.563032 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0b9a6-10dd-4168-aa83-a392fede0e09 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:16.600162 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd5565-d5e6-49fe-8b57-3dbb5bb957da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:16.601675 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd5565-d5e6-49fe-8b57-3dbb5bb957da None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:16.602063 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd5565-d5e6-49fe-8b57-3dbb5bb957da None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:16.602442 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd5565-d5e6-49fe-8b57-3dbb5bb957da None admin] PATH_INFO: `/v3/roles/member` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:16.617589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd5565-d5e6-49fe-8b57-3dbb5bb957da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:16.627486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-d9fd5565-d5e6-49fe-8b57-3dbb5bb957da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:16.627486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:16.627486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:16.627486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:16.627486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:16.627486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:16.627486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:16.627486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:16.627486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:16.627486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:16.627486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:16.627486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:16.627486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:16.627486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:16.627486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:16.627486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:16.628572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:16.628572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:16.628572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:16.628572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:16.628572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:16.628572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:16.628572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:16.628572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:16.628572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:16.628572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:16.628572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:16.628572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:16.628572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:16.628572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:16.628572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:16.628572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:16.629578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:16.629578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:16.629578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:16.629578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:16.629578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:16.629578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:16.629578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:16.629578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:16.629578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:16.629578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:16.629578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:16.629578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:16.632062 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 107/213] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:16.638405 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd5565-d5e6-49fe-8b57-3dbb5bb957da None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:16.659758 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b7267-0d4b-43d9-8ac5-a9e35d5fea16 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:16.699775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25270be1-6058-4734-8e07-67d16236ea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:16.701198 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25270be1-6058-4734-8e07-67d16236ea3b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:16.701695 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25270be1-6058-4734-8e07-67d16236ea3b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:16.702280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25270be1-6058-4734-8e07-67d16236ea3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:16.703689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25270be1-6058-4734-8e07-67d16236ea3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:16.705497 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25270be1-6058-4734-8e07-67d16236ea3b None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:16.707850 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 107/214] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:16.714062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25270be1-6058-4734-8e07-67d16236ea3b None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:16.760533 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd5565-d5e6-49fe-8b57-3dbb5bb957da None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:16.774917 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:16.808273 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c9f0f-bc50-47e6-ac7d-d81f3e46b07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:16.809316 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c9f0f-bc50-47e6-ac7d-d81f3e46b07a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:16.809805 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c9f0f-bc50-47e6-ac7d-d81f3e46b07a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:16.810349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c9f0f-bc50-47e6-ac7d-d81f3e46b07a None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:16.811293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c9f0f-bc50-47e6-ac7d-d81f3e46b07a None admin] RBAC: Adding query filter params (name=member) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:16.811793 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c9f0f-bc50-47e6-ac7d-d81f3e46b07a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:16.813393 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c9f0f-bc50-47e6-ac7d-d81f3e46b07a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:16.827282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 108/215] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:16.829049 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c9f0f-bc50-47e6-ac7d-d81f3e46b07a None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:16.840437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25270be1-6058-4734-8e07-67d16236ea3b None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:16.842712 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:16.932551 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf0847-99ad-4b05-bace-aaaff40ad1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:16.933259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf0847-99ad-4b05-bace-aaaff40ad1bf None admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:16.933551 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf0847-99ad-4b05-bace-aaaff40ad1bf None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:16.933828 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf0847-99ad-4b05-bace-aaaff40ad1bf None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:16.934550 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf0847-99ad-4b05-bace-aaaff40ad1bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:16.936012 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf0847-99ad-4b05-bace-aaaff40ad1bf None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:16.970066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c9f0f-bc50-47e6-ac7d-d81f3e46b07a None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:17.007768 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73438ade-78a6-451f-bd7b-f9768db532d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:17.008986 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73438ade-78a6-451f-bd7b-f9768db532d0 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:17.009478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73438ade-78a6-451f-bd7b-f9768db532d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:17.010050 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73438ade-78a6-451f-bd7b-f9768db532d0 None admin] PATH_INFO: `/v3/users/688c2d3c08ae43bca329afdca59d8908` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:17.024853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73438ade-78a6-451f-bd7b-f9768db532d0 None admin] RBAC: Authorizing `identity:get_user(user_id=688c2d3c08ae43bca329afdca59d8908)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:17.026678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73438ade-78a6-451f-bd7b-f9768db532d0 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:17.028595 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 109/216] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:16 2022] GET /identity/v3/users/688c2d3c08ae43bca329afdca59d8908 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:17.034007 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73438ade-78a6-451f-bd7b-f9768db532d0 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:17.049266 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 108/217] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 19:38:16 2022] POST /identity/v3/users => generated 297 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:38:17.070823 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:17.153028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73438ade-78a6-451f-bd7b-f9768db532d0 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:17.192225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a6382-4213-485a-bfaa-116db8d76a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:17.193183 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a6382-4213-485a-bfaa-116db8d76a87 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:17.193475 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a6382-4213-485a-bfaa-116db8d76a87 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:17.193756 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a6382-4213-485a-bfaa-116db8d76a87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:17.268757 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a6382-4213-485a-bfaa-116db8d76a87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:17.270323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a6382-4213-485a-bfaa-116db8d76a87 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:17.302651 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:17.374732 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 110/218] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 19:38:17.380616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf0847-99ad-4b05-bace-aaaff40ad1bf None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:17.490692 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20f095-65e3-4ae5-9143-80595fd08465 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:17.491325 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20f095-65e3-4ae5-9143-80595fd08465 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:17.492702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20f095-65e3-4ae5-9143-80595fd08465 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:17.496982 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 111/219] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:17.504299 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec30cd-054e-4f88-b9d1-9742061d89aa None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:17.504824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec30cd-054e-4f88-b9d1-9742061d89aa None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:17.505357 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec30cd-054e-4f88-b9d1-9742061d89aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:17.514548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf0847-99ad-4b05-bace-aaaff40ad1bf None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:17.528849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-95ec30cd-054e-4f88-b9d1-9742061d89aa None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:17.530417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-95ec30cd-054e-4f88-b9d1-9742061d89aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:17.561935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fa28f-acaa-4415-806e-c432f069e546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:17.563044 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fa28f-acaa-4415-806e-c432f069e546 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:17.563617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fa28f-acaa-4415-806e-c432f069e546 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:17.564024 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fa28f-acaa-4415-806e-c432f069e546 None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:17.565391 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fa28f-acaa-4415-806e-c432f069e546 None admin] RBAC: Authorizing `identity:get_project(project_id=3ffde5ab0f994cd5b8e67d5092a69564)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:17.567097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fa28f-acaa-4415-806e-c432f069e546 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:17.573257 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 109/220] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:17 2022] GET /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:17.576491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fa28f-acaa-4415-806e-c432f069e546 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:17.612209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:17.653873 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 112/221] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:38:17.655635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c9d76-67c1-431e-8d6f-3737380bb52d None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:17.656065 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c9d76-67c1-431e-8d6f-3737380bb52d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:17.656484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c9d76-67c1-431e-8d6f-3737380bb52d None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:17.657983 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 113/222] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:17.664324 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f3671-a777-4ec9-9ca8-431d8d3bc33c None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:17.664917 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f3671-a777-4ec9-9ca8-431d8d3bc33c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:17.665433 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f3671-a777-4ec9-9ca8-431d8d3bc33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:17.683306 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-202f3671-a777-4ec9-9ca8-431d8d3bc33c None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:17.684826 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-202f3671-a777-4ec9-9ca8-431d8d3bc33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:17.708557 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fa28f-acaa-4415-806e-c432f069e546 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:17.752832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f69f1-4b46-496c-8a07-3ca2747b502b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:17.753785 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f69f1-4b46-496c-8a07-3ca2747b502b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:17.754324 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f69f1-4b46-496c-8a07-3ca2747b502b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:17.754796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f69f1-4b46-496c-8a07-3ca2747b502b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:17.755901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f69f1-4b46-496c-8a07-3ca2747b502b None admin] RBAC: Adding query filter params (role.id=61895d866a7c44de8924486b8e5ec6e8, scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564, user.id=688c2d3c08ae43bca329afdca59d8908) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:17.756409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f69f1-4b46-496c-8a07-3ca2747b502b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:17.758088 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:17.760431 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f69f1-4b46-496c-8a07-3ca2747b502b None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:17.761339 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 114/223] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:17.762173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f3671-a777-4ec9-9ca8-431d8d3bc33c None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:17.773559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 110/224] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:17 2022] GET /identity/v3/role_assignments?user.id=688c2d3c08ae43bca329afdca59d8908&scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564&role.id=61895d866a7c44de8924486b8e5ec6e8 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:17.812189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f69f1-4b46-496c-8a07-3ca2747b502b None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:17.916326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f3671-a777-4ec9-9ca8-431d8d3bc33c None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:17.959841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b5521-6bca-4b07-b5c3-9fc17013e3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:17.960789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5521-6bca-4b07-b5c3-9fc17013e3db None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:17.961080 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5521-6bca-4b07-b5c3-9fc17013e3db None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:17.961388 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5521-6bca-4b07-b5c3-9fc17013e3db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:17.986741 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b5521-6bca-4b07-b5c3-9fc17013e3db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:18.002658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-666b5521-6bca-4b07-b5c3-9fc17013e3db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:38:18.002658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:18.002658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:18.002658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:18.002658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:18.002658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:18.002658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:18.002658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:18.002658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:18.002658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:18.002658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:18.002658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:18.002658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:18.002658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:18.002658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:18.002658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:18.003615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:18.003615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:18.003615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:18.003615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:18.003615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:18.003615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:18.003615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:18.003615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:18.003615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:18.003615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:18.003615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:18.003615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:18.003615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:18.003615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:18.003615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:18.003615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:18.004391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:18.004391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:18.004391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:18.004391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:18.004391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:18.004391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:18.004391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:18.004391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:18.004391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:18.004391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:18.004391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:38:18.004391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:18.004391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 115/225] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:38:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:18.012104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b5521-6bca-4b07-b5c3-9fc17013e3db None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:18.020152 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:18.031900 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f69f1-4b46-496c-8a07-3ca2747b502b None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:18.069364 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd63548-284f-4331-8f55-ad90a1615626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:18.071426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd63548-284f-4331-8f55-ad90a1615626 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:18.071910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd63548-284f-4331-8f55-ad90a1615626 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:18.072390 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd63548-284f-4331-8f55-ad90a1615626 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:18.088877 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd63548-284f-4331-8f55-ad90a1615626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:18.097560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-2bd63548-284f-4331-8f55-ad90a1615626 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:18.097560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:18.097560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:18.097560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:18.097560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:18.097560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:18.097560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:18.097560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:18.097560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:18.097560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:18.097560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:18.097560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:18.097560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:18.097560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:18.097560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:18.097560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:18.098448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:18.098448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:18.098448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:18.098448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:18.098448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:18.098448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:18.098448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:18.098448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:18.098448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:18.098448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:18.098448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:18.098448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:18.098448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:18.098448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:18.098448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:18.098448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:18.099250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:18.099250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:18.099250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:18.099250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:18.099250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:18.099250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:18.099250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:18.099250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:18.099250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:18.099250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:18.099250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:18.099250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:18.107334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 111/226] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:38:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:18.108744 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd63548-284f-4331-8f55-ad90a1615626 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:18.114428 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:18.220102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd63548-284f-4331-8f55-ad90a1615626 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:18.251318 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b5521-6bca-4b07-b5c3-9fc17013e3db None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:18.256941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf9c08-d83f-461b-9513-8a3ae5bdf99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:18.259139 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf9c08-d83f-461b-9513-8a3ae5bdf99a None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:18.259674 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf9c08-d83f-461b-9513-8a3ae5bdf99a None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:18.260149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf9c08-d83f-461b-9513-8a3ae5bdf99a None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:18.261128 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf9c08-d83f-461b-9513-8a3ae5bdf99a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:18.261671 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf9c08-d83f-461b-9513-8a3ae5bdf99a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:18.263320 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf9c08-d83f-461b-9513-8a3ae5bdf99a None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:18.272050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 112/227] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:38:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:18.279770 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf9c08-d83f-461b-9513-8a3ae5bdf99a None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:18.309073 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:18.324948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df910e3e-fd3a-4c9c-87ce-65e619c8c2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:18.325963 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df910e3e-fd3a-4c9c-87ce-65e619c8c2e9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:18.326517 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df910e3e-fd3a-4c9c-87ce-65e619c8c2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:18.326985 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df910e3e-fd3a-4c9c-87ce-65e619c8c2e9 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:18.327978 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df910e3e-fd3a-4c9c-87ce-65e619c8c2e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:18.329092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df910e3e-fd3a-4c9c-87ce-65e619c8c2e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:18.331216 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df910e3e-fd3a-4c9c-87ce-65e619c8c2e9 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:18.352458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 116/228] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:18.355220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df910e3e-fd3a-4c9c-87ce-65e619c8c2e9 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:18.479763 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf9c08-d83f-461b-9513-8a3ae5bdf99a None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:18.534603 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929cb008-6322-480a-bbad-bb237f18ed9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:18.535851 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cb008-6322-480a-bbad-bb237f18ed9e None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:18.536332 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cb008-6322-480a-bbad-bb237f18ed9e None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:18.536821 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cb008-6322-480a-bbad-bb237f18ed9e None admin] PATH_INFO: `/v3/users/5ffcefcb92714491a79e1e609f28771b` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:18.538257 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929cb008-6322-480a-bbad-bb237f18ed9e None admin] RBAC: Authorizing `identity:get_user(user_id=5ffcefcb92714491a79e1e609f28771b)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:18.540575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929cb008-6322-480a-bbad-bb237f18ed9e None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:18.546480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 113/229] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:18 2022] GET /identity/v3/users/5ffcefcb92714491a79e1e609f28771b => generated 283 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:18.548372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929cb008-6322-480a-bbad-bb237f18ed9e None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:18.556562 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df910e3e-fd3a-4c9c-87ce-65e619c8c2e9 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:18.571488 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:18.594322 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668529b-7cf8-490f-9a2a-552d8d362c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:18.595207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668529b-7cf8-490f-9a2a-552d8d362c7d None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:18.595560 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668529b-7cf8-490f-9a2a-552d8d362c7d None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:18.595841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668529b-7cf8-490f-9a2a-552d8d362c7d None admin] PATH_INFO: `/v3/users/5ffcefcb92714491a79e1e609f28771b` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:18.597101 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668529b-7cf8-490f-9a2a-552d8d362c7d None admin] RBAC: Authorizing `identity:get_user(user_id=5ffcefcb92714491a79e1e609f28771b)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:18.599084 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668529b-7cf8-490f-9a2a-552d8d362c7d None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:18.600547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 117/230] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:18 2022] GET /identity/v3/users/5ffcefcb92714491a79e1e609f28771b => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:18.607094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668529b-7cf8-490f-9a2a-552d8d362c7d None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:18.719201 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668529b-7cf8-490f-9a2a-552d8d362c7d None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:18.755421 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962f832-c01c-4028-aad3-caef97e87f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:18.756415 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962f832-c01c-4028-aad3-caef97e87f9a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:18.756733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962f832-c01c-4028-aad3-caef97e87f9a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:18.757174 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962f832-c01c-4028-aad3-caef97e87f9a None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:18.759033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962f832-c01c-4028-aad3-caef97e87f9a None admin] RBAC: Authorizing `identity:get_project(project_id=3ffde5ab0f994cd5b8e67d5092a69564)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:18.760630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962f832-c01c-4028-aad3-caef97e87f9a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:18.763197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 118/231] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:18 2022] GET /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:18.773519 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962f832-c01c-4028-aad3-caef97e87f9a None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:18.794268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:18.826177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929cb008-6322-480a-bbad-bb237f18ed9e None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:18.840525 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:18.877178 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962f832-c01c-4028-aad3-caef97e87f9a None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:18.901683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f5901-2bf6-4b2f-ba32-6d27908175cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:18.902849 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f5901-2bf6-4b2f-ba32-6d27908175cd None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:18.902969 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f5901-2bf6-4b2f-ba32-6d27908175cd None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:18.903277 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f5901-2bf6-4b2f-ba32-6d27908175cd None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:18.909859 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f5901-2bf6-4b2f-ba32-6d27908175cd None admin] RBAC: Authorizing `identity:get_project(project_id=3ffde5ab0f994cd5b8e67d5092a69564)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:18.911486 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f5901-2bf6-4b2f-ba32-6d27908175cd None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:18.913695 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 114/232] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:18 2022] GET /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564 => generated 302 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:18.915172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331d52c-90b3-444a-9659-ec9aaa8f90be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:18.916281 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331d52c-90b3-444a-9659-ec9aaa8f90be None admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:18.916743 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331d52c-90b3-444a-9659-ec9aaa8f90be None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:18.917239 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331d52c-90b3-444a-9659-ec9aaa8f90be None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564/users/5ffcefcb92714491a79e1e609f28771b/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:18.919710 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331d52c-90b3-444a-9659-ec9aaa8f90be None admin] RBAC: Authorizing `identity:create_grant(project_id=3ffde5ab0f994cd5b8e67d5092a69564, user_id=5ffcefcb92714491a79e1e609f28771b, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:18.920246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f5901-2bf6-4b2f-ba32-6d27908175cd None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:18.921704 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331d52c-90b3-444a-9659-ec9aaa8f90be None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:19.042536 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 119/233] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:38:18 2022] PUT /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564/users/5ffcefcb92714491a79e1e609f28771b/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:38:19.053355 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f5901-2bf6-4b2f-ba32-6d27908175cd None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:19.110445 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76b7f2-c5be-4ea9-a8a5-aa94b8cadfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:19.111715 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76b7f2-c5be-4ea9-a8a5-aa94b8cadfb2 None admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:19.112193 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76b7f2-c5be-4ea9-a8a5-aa94b8cadfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:19.112649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76b7f2-c5be-4ea9-a8a5-aa94b8cadfb2 None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564/users/5ffcefcb92714491a79e1e609f28771b/roles/f0bb7fa65c8545699b60f857f930b078` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:19.119308 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76b7f2-c5be-4ea9-a8a5-aa94b8cadfb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ffde5ab0f994cd5b8e67d5092a69564, user_id=5ffcefcb92714491a79e1e609f28771b, role_id=f0bb7fa65c8545699b60f857f930b078)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:19.121138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76b7f2-c5be-4ea9-a8a5-aa94b8cadfb2 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:19.207721 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 115/234] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:38:18 2022] PUT /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564/users/5ffcefcb92714491a79e1e609f28771b/roles/f0bb7fa65c8545699b60f857f930b078 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:38:19.519379 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bee13-bcf0-4c61-b334-fa817b2d861f None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:19.519764 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bee13-bcf0-4c61-b334-fa817b2d861f None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:19.519958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bee13-bcf0-4c61-b334-fa817b2d861f None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:19.521669 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 120/235] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:19.527425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8b5d5-e27b-4149-8555-beaba98a68bf None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:19.527905 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8b5d5-e27b-4149-8555-beaba98a68bf None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:19.527982 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8b5d5-e27b-4149-8555-beaba98a68bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:19.550179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-34b8b5d5-e27b-4149-8555-beaba98a68bf None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:19.551376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-34b8b5d5-e27b-4149-8555-beaba98a68bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:19.553654 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:19.647724 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 116/236] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:19.683442 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bee13-bcf0-4c61-b334-fa817b2d861f None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:19.814002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bee13-bcf0-4c61-b334-fa817b2d861f None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:19.824466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:19.842693 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a18a-3b02-4582-bf47-ca0c94341ef6 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:19.842981 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a18a-3b02-4582-bf47-ca0c94341ef6 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:19.843264 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a18a-3b02-4582-bf47-ca0c94341ef6 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:19.844869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 117/237] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:19.859834 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d0a81-3412-4f5f-982b-734217a1eed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:19.860713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d0a81-3412-4f5f-982b-734217a1eed6 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:19.860998 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d0a81-3412-4f5f-982b-734217a1eed6 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:19.861366 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d0a81-3412-4f5f-982b-734217a1eed6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:19.862687 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a70eb-c492-4721-ad43-2e7afe8a141b None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:19.862985 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a70eb-c492-4721-ad43-2e7afe8a141b None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:19.863273 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a70eb-c492-4721-ad43-2e7afe8a141b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:19.879734 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d0a81-3412-4f5f-982b-734217a1eed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:19.889096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-906d0a81-3412-4f5f-982b-734217a1eed6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 19:38:19.889096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:19.889096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:19.889096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:19.889096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:19.889096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:19.889096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:19.889096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:19.889096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:19.889096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:19.889096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:19.889096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:19.889096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:19.889096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:19.889096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:19.889096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:19.890018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:19.890018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:19.890018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:19.890018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:19.890018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:19.890018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:19.890018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:19.890018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:19.890018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:19.890018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:19.890018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:19.890018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:19.890018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:19.890018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:19.890018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:19.890018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:19.891302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:19.891302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:19.891302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:19.891302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:19.891302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:19.891302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:19.891302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:19.891302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:19.891302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:19.891302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:19.891302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 19:38:19.891302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:19.891302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 121/238] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:19.901346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d0a81-3412-4f5f-982b-734217a1eed6 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:19.907776 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-a08a70eb-c492-4721-ad43-2e7afe8a141b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:19.907776 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-a08a70eb-c492-4721-ad43-2e7afe8a141b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:20.027671 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 118/239] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:20.057657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d0a81-3412-4f5f-982b-734217a1eed6 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:20.071885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a70eb-c492-4721-ad43-2e7afe8a141b None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:20.110418 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e02200-52f2-40d1-81f4-637c2de2253c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:20.111492 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e02200-52f2-40d1-81f4-637c2de2253c None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:20.111984 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e02200-52f2-40d1-81f4-637c2de2253c None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:20.112465 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e02200-52f2-40d1-81f4-637c2de2253c None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:20.113461 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e02200-52f2-40d1-81f4-637c2de2253c None admin] RBAC: Adding query filter params (name=reader) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:20.113993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e02200-52f2-40d1-81f4-637c2de2253c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:20.115770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e02200-52f2-40d1-81f4-637c2de2253c None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:20.130506 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 122/240] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:20.137704 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e02200-52f2-40d1-81f4-637c2de2253c None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:20.201225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:20.215815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:20.285182 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a70eb-c492-4721-ad43-2e7afe8a141b None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:20.285425 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e02200-52f2-40d1-81f4-637c2de2253c None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:20.346886 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a4833-d81a-44a6-b0bb-cd7bb01a27af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:20.347692 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a4833-d81a-44a6-b0bb-cd7bb01a27af None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:20.347983 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a4833-d81a-44a6-b0bb-cd7bb01a27af None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:20.348263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a4833-d81a-44a6-b0bb-cd7bb01a27af None admin] PATH_INFO: `/v3/users/ee96faca63aa40caa22e08f48bfd09b2` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:20.359562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003c8d1-8450-4f80-b0ec-65564a25e14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:20.360366 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003c8d1-8450-4f80-b0ec-65564a25e14d None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:20.360653 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003c8d1-8450-4f80-b0ec-65564a25e14d None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:20.360932 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003c8d1-8450-4f80-b0ec-65564a25e14d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:20.362154 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003c8d1-8450-4f80-b0ec-65564a25e14d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:20.363634 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003c8d1-8450-4f80-b0ec-65564a25e14d None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:20.366738 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 119/241] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:20.373359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003c8d1-8450-4f80-b0ec-65564a25e14d None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:20.379640 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a4833-d81a-44a6-b0bb-cd7bb01a27af None admin] RBAC: Authorizing `identity:get_user(user_id=ee96faca63aa40caa22e08f48bfd09b2)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:20.381122 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a4833-d81a-44a6-b0bb-cd7bb01a27af None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:20.383804 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 123/242] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:20 2022] GET /identity/v3/users/ee96faca63aa40caa22e08f48bfd09b2 => generated 297 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:20.384978 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a6434-27f5-48a9-8b6a-aeb2b68d00bd None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:20.385333 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a6434-27f5-48a9-8b6a-aeb2b68d00bd None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:20.385619 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a6434-27f5-48a9-8b6a-aeb2b68d00bd None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:20.386979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 124/243] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:20.390789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a6434-27f5-48a9-8b6a-aeb2b68d00bd None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:20.496793 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:20.498845 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003c8d1-8450-4f80-b0ec-65564a25e14d None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:20.515608 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a6434-27f5-48a9-8b6a-aeb2b68d00bd None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:20.547380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e21fd4-45e8-417f-8217-b9974123715c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:20.548069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21fd4-45e8-417f-8217-b9974123715c None admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:20.548337 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21fd4-45e8-417f-8217-b9974123715c None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:20.548613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21fd4-45e8-417f-8217-b9974123715c None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:20.549382 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e21fd4-45e8-417f-8217-b9974123715c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:20.551489 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e21fd4-45e8-417f-8217-b9974123715c None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:20.556586 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b56628-30b9-410e-8244-6cda820b799d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:20.557569 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b56628-30b9-410e-8244-6cda820b799d None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:20.558061 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b56628-30b9-410e-8244-6cda820b799d None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:20.558597 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b56628-30b9-410e-8244-6cda820b799d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:20.560950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:20.636719 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b56628-30b9-410e-8244-6cda820b799d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:20.638231 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b56628-30b9-410e-8244-6cda820b799d None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:20.683275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 120/244] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 19:38:20 2022] POST /identity/v3/users => generated 293 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:38:20.685387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46494948-90f3-495a-93ad-f9968f6ed0a3 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:20.686422 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46494948-90f3-495a-93ad-f9968f6ed0a3 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:20.687262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46494948-90f3-495a-93ad-f9968f6ed0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:20.712953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-46494948-90f3-495a-93ad-f9968f6ed0a3 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:20.715642 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-46494948-90f3-495a-93ad-f9968f6ed0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:20.734829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:20.749009 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 125/245] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:20.754025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b56628-30b9-410e-8244-6cda820b799d None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:20.821325 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 121/246] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:20.862745 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46494948-90f3-495a-93ad-f9968f6ed0a3 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:20.919048 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b56628-30b9-410e-8244-6cda820b799d None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:20.968433 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6683b2-b547-4c96-ae1a-f12c1ca185ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:20.969335 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6683b2-b547-4c96-ae1a-f12c1ca185ad None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:20.969620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6683b2-b547-4c96-ae1a-f12c1ca185ad None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:20.969980 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6683b2-b547-4c96-ae1a-f12c1ca185ad None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:20.972096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6683b2-b547-4c96-ae1a-f12c1ca185ad None admin] RBAC: Authorizing `identity:get_project(project_id=3ffde5ab0f994cd5b8e67d5092a69564)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:20.973622 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6683b2-b547-4c96-ae1a-f12c1ca185ad None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:20.975859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 126/247] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:20 2022] GET /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:20.981495 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6683b2-b547-4c96-ae1a-f12c1ca185ad None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:21.021303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46494948-90f3-495a-93ad-f9968f6ed0a3 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:21.051217 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:21.052894 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:21.068334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627ecec-26c8-4367-a10f-c81cc8675284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:21.070198 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627ecec-26c8-4367-a10f-c81cc8675284 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:21.070493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627ecec-26c8-4367-a10f-c81cc8675284 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:21.070776 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627ecec-26c8-4367-a10f-c81cc8675284 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:21.084221 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627ecec-26c8-4367-a10f-c81cc8675284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:21.096367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-f627ecec-26c8-4367-a10f-c81cc8675284 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:21.096367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:21.096367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:21.096367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:21.096367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:21.096367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:21.096367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:21.096367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:21.096367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:21.096367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:21.096367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:21.096367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:21.096367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:21.096367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:21.096367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:21.096367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:21.097577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:21.097577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:21.097577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:21.097577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:21.097577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:21.097577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:21.097577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:21.097577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:21.097577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:21.097577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:21.097577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:21.097577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:21.097577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:21.097577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:21.097577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:21.097577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:21.098571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:21.098571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:21.098571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:21.098571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:21.098571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:21.098571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:21.098571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:21.098571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:21.098571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:21.098571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:21.098571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:21.098571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:21.104404 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 122/248] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:21.106065 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627ecec-26c8-4367-a10f-c81cc8675284 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:21.130436 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6683b2-b547-4c96-ae1a-f12c1ca185ad None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:21.182471 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0226b30-74bb-4ac5-9553-33f36a2b8806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:21.182666 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0226b30-74bb-4ac5-9553-33f36a2b8806 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:21.183666 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0226b30-74bb-4ac5-9553-33f36a2b8806 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:21.183666 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0226b30-74bb-4ac5-9553-33f36a2b8806 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:21.184068 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0226b30-74bb-4ac5-9553-33f36a2b8806 None admin] RBAC: Adding query filter params (role.id=d81add03275a412284f307885c341f6f, scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564, user.id=ee96faca63aa40caa22e08f48bfd09b2) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:21.185103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0226b30-74bb-4ac5-9553-33f36a2b8806 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:21.186418 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0226b30-74bb-4ac5-9553-33f36a2b8806 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:21.199282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 127/249] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:20 2022] GET /identity/v3/role_assignments?user.id=ee96faca63aa40caa22e08f48bfd09b2&scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564&role.id=d81add03275a412284f307885c341f6f => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:21.250650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627ecec-26c8-4367-a10f-c81cc8675284 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:21.291166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f501d0-909e-471e-b3e2-2bf384a9fa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:21.291857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f501d0-909e-471e-b3e2-2bf384a9fa8a None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:21.292144 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f501d0-909e-471e-b3e2-2bf384a9fa8a None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:21.292423 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f501d0-909e-471e-b3e2-2bf384a9fa8a None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:21.293218 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f501d0-909e-471e-b3e2-2bf384a9fa8a None admin] RBAC: Adding query filter params (name=member) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:21.293533 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f501d0-909e-471e-b3e2-2bf384a9fa8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:21.294964 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f501d0-909e-471e-b3e2-2bf384a9fa8a None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:21.306873 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 123/250] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:21.312561 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0226b30-74bb-4ac5-9553-33f36a2b8806 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:21.434202 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0226b30-74bb-4ac5-9553-33f36a2b8806 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:21.456621 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:21.475202 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c6467-192b-4e02-a970-43df21f1c635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:21.477023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c6467-192b-4e02-a970-43df21f1c635 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:21.477568 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c6467-192b-4e02-a970-43df21f1c635 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:21.478051 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c6467-192b-4e02-a970-43df21f1c635 None admin] PATH_INFO: `/v3/users/688c2d3c08ae43bca329afdca59d8908` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:21.479550 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c6467-192b-4e02-a970-43df21f1c635 None admin] RBAC: Authorizing `identity:get_user(user_id=688c2d3c08ae43bca329afdca59d8908)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:21.481277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c6467-192b-4e02-a970-43df21f1c635 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:21.483458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 128/251] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:21 2022] GET /identity/v3/users/688c2d3c08ae43bca329afdca59d8908 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:21.488749 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f501d0-909e-471e-b3e2-2bf384a9fa8a None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:21.567351 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:21.638418 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e006d6d-7abc-43ba-9f44-c7bbe698cf20 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:21.639072 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e006d6d-7abc-43ba-9f44-c7bbe698cf20 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:21.639580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e006d6d-7abc-43ba-9f44-c7bbe698cf20 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:21.641188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 129/252] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:21.646418 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754c760-bb06-4ddd-8b0e-7d3f06c7b828 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:21.647140 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754c760-bb06-4ddd-8b0e-7d3f06c7b828 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:21.647628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754c760-bb06-4ddd-8b0e-7d3f06c7b828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:21.664841 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f501d0-909e-471e-b3e2-2bf384a9fa8a None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:21.673901 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-5754c760-bb06-4ddd-8b0e-7d3f06c7b828 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:21.675866 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-5754c760-bb06-4ddd-8b0e-7d3f06c7b828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:21.775816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083948e-9c00-42c0-bbda-baebc793859c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:21.785262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083948e-9c00-42c0-bbda-baebc793859c None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:21.785262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083948e-9c00-42c0-bbda-baebc793859c None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:21.785262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083948e-9c00-42c0-bbda-baebc793859c None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:21.785262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083948e-9c00-42c0-bbda-baebc793859c None admin] RBAC: Authorizing `identity:get_project(project_id=3ffde5ab0f994cd5b8e67d5092a69564)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:21.785262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083948e-9c00-42c0-bbda-baebc793859c None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:21.785262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 124/253] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:21 2022] GET /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564 => generated 302 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:21.785814 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5262b-4dfe-4b6d-84be-db4c429b9269 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:21.785814 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5262b-4dfe-4b6d-84be-db4c429b9269 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:21.785814 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5262b-4dfe-4b6d-84be-db4c429b9269 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:21.785814 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 125/254] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:21.787702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 130/255] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:38:21.791796 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754c760-bb06-4ddd-8b0e-7d3f06c7b828 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:21.792321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44b9e7-b7b4-4105-81ef-ad6f65f6e37f None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:21.792756 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44b9e7-b7b4-4105-81ef-ad6f65f6e37f None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:21.793219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44b9e7-b7b4-4105-81ef-ad6f65f6e37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:21.825562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-4b44b9e7-b7b4-4105-81ef-ad6f65f6e37f None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:21.826804 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-4b44b9e7-b7b4-4105-81ef-ad6f65f6e37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:21.965949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 126/256] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:21.967179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44b9e7-b7b4-4105-81ef-ad6f65f6e37f None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:22.002848 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754c760-bb06-4ddd-8b0e-7d3f06c7b828 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:22.022173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:22.040284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f2ce7-64d5-462f-ac39-e55cffb9c2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:22.041118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f2ce7-64d5-462f-ac39-e55cffb9c2ec None admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:22.041437 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f2ce7-64d5-462f-ac39-e55cffb9c2ec None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:22.041716 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f2ce7-64d5-462f-ac39-e55cffb9c2ec None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564/users/688c2d3c08ae43bca329afdca59d8908/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:22.043692 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f2ce7-64d5-462f-ac39-e55cffb9c2ec None admin] RBAC: Authorizing `identity:create_grant(project_id=3ffde5ab0f994cd5b8e67d5092a69564, user_id=688c2d3c08ae43bca329afdca59d8908, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:22.045169 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f2ce7-64d5-462f-ac39-e55cffb9c2ec None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:22.092446 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:22.114207 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44b9e7-b7b4-4105-81ef-ad6f65f6e37f None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:22.153181 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 131/257] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:38:21 2022] PUT /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564/users/688c2d3c08ae43bca329afdca59d8908/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:38:22.153181 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f2ce7-64d5-462f-ac39-e55cffb9c2ec None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:22.160012 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46e2ea-4726-4c4b-b084-e7f839dd28f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:22.160857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46e2ea-4726-4c4b-b084-e7f839dd28f7 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:22.161148 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46e2ea-4726-4c4b-b084-e7f839dd28f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:22.161451 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46e2ea-4726-4c4b-b084-e7f839dd28f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:22.201078 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46e2ea-4726-4c4b-b084-e7f839dd28f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:22.217345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-8b46e2ea-4726-4c4b-b084-e7f839dd28f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:22.217345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:22.217345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:22.217345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:22.217345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:22.217345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:22.217345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:22.217345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:22.217345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:22.217345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:22.217345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:22.217345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:22.217345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:22.217345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:22.217345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:22.217345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:22.218290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:22.218290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:22.218290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:22.218290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:22.218290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:22.218290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:22.218290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:22.218290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:22.218290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:22.218290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:22.218290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:22.218290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:22.218290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:22.218290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:22.218290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:22.218290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:22.219066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:22.219066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:22.219066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:22.219066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:22.219066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:22.219066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:22.219066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:22.219066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:22.219066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:22.219066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:22.219066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:22.219066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:22.220228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 127/258] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:38:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:22.226675 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46e2ea-4726-4c4b-b084-e7f839dd28f7 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:22.405441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46e2ea-4726-4c4b-b084-e7f839dd28f7 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:22.407667 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:22.415158 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f2ce7-64d5-462f-ac39-e55cffb9c2ec None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:22.456016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493277c-275e-4518-9404-8df6c4ec9d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:22.456697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493277c-275e-4518-9404-8df6c4ec9d8d None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:22.456981 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493277c-275e-4518-9404-8df6c4ec9d8d None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:22.457285 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493277c-275e-4518-9404-8df6c4ec9d8d None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:22.458047 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493277c-275e-4518-9404-8df6c4ec9d8d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:22.458358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493277c-275e-4518-9404-8df6c4ec9d8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:22.462451 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493277c-275e-4518-9404-8df6c4ec9d8d None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:22.478146 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 128/259] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:38:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:22.480591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b8c45-7b81-4604-a378-765ca62f8329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:22.481419 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b8c45-7b81-4604-a378-765ca62f8329 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:22.481705 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b8c45-7b81-4604-a378-765ca62f8329 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:22.481984 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b8c45-7b81-4604-a378-765ca62f8329 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:22.484639 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493277c-275e-4518-9404-8df6c4ec9d8d None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:22.505139 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b8c45-7b81-4604-a378-765ca62f8329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:22.514312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-337b8c45-7b81-4604-a378-765ca62f8329 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:38:22.514312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:22.514312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:22.514312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:22.514312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:22.514312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:22.514312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:22.514312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:22.514312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:22.514312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:22.514312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:22.514312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:22.514312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:22.514312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:22.514312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:22.514312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:22.515171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:22.515171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:22.515171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:22.515171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:22.515171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:22.515171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:22.515171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:22.515171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:22.515171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:22.515171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:22.515171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:22.515171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:22.515171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:22.515171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:22.515171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:22.515171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:22.516219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:22.516219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:22.516219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:22.516219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:22.516219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:22.516219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:22.516219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:22.516219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:22.516219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:22.516219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:22.516219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:38:22.516219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:22.516219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 132/260] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:38:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:22.521052 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b8c45-7b81-4604-a378-765ca62f8329 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:22.573643 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:22.659786 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b8c45-7b81-4604-a378-765ca62f8329 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:22.707133 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9508b-25f7-4f7f-9518-71686d63737c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:22.707820 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9508b-25f7-4f7f-9518-71686d63737c None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:22.708108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9508b-25f7-4f7f-9518-71686d63737c None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:22.708392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9508b-25f7-4f7f-9518-71686d63737c None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:22.709175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9508b-25f7-4f7f-9518-71686d63737c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:22.709492 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9508b-25f7-4f7f-9518-71686d63737c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:22.711518 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9508b-25f7-4f7f-9518-71686d63737c None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:22.735371 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 133/261] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:22.740466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9508b-25f7-4f7f-9518-71686d63737c None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:22.747784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493277c-275e-4518-9404-8df6c4ec9d8d None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:22.835004 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2abe8-5273-4a90-b539-239be0190f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:22.836089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2abe8-5273-4a90-b539-239be0190f2d None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:22.836380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2abe8-5273-4a90-b539-239be0190f2d None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:22.836669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2abe8-5273-4a90-b539-239be0190f2d None admin] PATH_INFO: `/v3/users/5ffcefcb92714491a79e1e609f28771b` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:22.841891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2abe8-5273-4a90-b539-239be0190f2d None admin] RBAC: Authorizing `identity:get_user(user_id=5ffcefcb92714491a79e1e609f28771b)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:22.843375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2abe8-5273-4a90-b539-239be0190f2d None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:22.845572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 129/262] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:22 2022] GET /identity/v3/users/5ffcefcb92714491a79e1e609f28771b => generated 283 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:22.853106 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2abe8-5273-4a90-b539-239be0190f2d None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:22.939845 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:22.974164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:22.978134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9508b-25f7-4f7f-9518-71686d63737c None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:23.057920 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b66dc3-4b81-46f4-b4a3-1b2f65eeabf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:23.058831 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b66dc3-4b81-46f4-b4a3-1b2f65eeabf9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:23.059122 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b66dc3-4b81-46f4-b4a3-1b2f65eeabf9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:23.059404 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b66dc3-4b81-46f4-b4a3-1b2f65eeabf9 None admin] PATH_INFO: `/v3/users/5ffcefcb92714491a79e1e609f28771b` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:23.060699 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b66dc3-4b81-46f4-b4a3-1b2f65eeabf9 None admin] RBAC: Authorizing `identity:get_user(user_id=5ffcefcb92714491a79e1e609f28771b)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:23.062205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b66dc3-4b81-46f4-b4a3-1b2f65eeabf9 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:23.064184 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 134/263] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:22 2022] GET /identity/v3/users/5ffcefcb92714491a79e1e609f28771b => generated 283 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:23.073984 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b66dc3-4b81-46f4-b4a3-1b2f65eeabf9 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:23.104587 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2abe8-5273-4a90-b539-239be0190f2d None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:23.147379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130b3b-25b6-466a-a9af-f18400918f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:23.148994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130b3b-25b6-466a-a9af-f18400918f01 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:23.149312 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130b3b-25b6-466a-a9af-f18400918f01 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:23.149593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130b3b-25b6-466a-a9af-f18400918f01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:23.230796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec130b3b-25b6-466a-a9af-f18400918f01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:23.232216 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec130b3b-25b6-466a-a9af-f18400918f01 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:23.267757 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:23.348283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 130/264] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 19:38:23.353819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130b3b-25b6-466a-a9af-f18400918f01 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:23.364938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b66dc3-4b81-46f4-b4a3-1b2f65eeabf9 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:23.461894 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86839ac-7ea7-4951-ae7a-7b9555ad1754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:23.462568 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86839ac-7ea7-4951-ae7a-7b9555ad1754 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:23.462854 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86839ac-7ea7-4951-ae7a-7b9555ad1754 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:23.463138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86839ac-7ea7-4951-ae7a-7b9555ad1754 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:23.463560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130b3b-25b6-466a-a9af-f18400918f01 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:23.504508 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:23.509644 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:23.512893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23336bae-35a9-485b-bd13-b1dbb4c40d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:23.515953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23336bae-35a9-485b-bd13-b1dbb4c40d56 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:23.515953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23336bae-35a9-485b-bd13-b1dbb4c40d56 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:23.515953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23336bae-35a9-485b-bd13-b1dbb4c40d56 None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:23.515953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23336bae-35a9-485b-bd13-b1dbb4c40d56 None admin] RBAC: Authorizing `identity:get_project(project_id=3ffde5ab0f994cd5b8e67d5092a69564)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:23.517697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23336bae-35a9-485b-bd13-b1dbb4c40d56 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:23.519854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 131/265] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:23 2022] GET /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:23.525602 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23336bae-35a9-485b-bd13-b1dbb4c40d56 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:23.587235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86839ac-7ea7-4951-ae7a-7b9555ad1754 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:23.588718 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86839ac-7ea7-4951-ae7a-7b9555ad1754 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:23.755523 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23336bae-35a9-485b-bd13-b1dbb4c40d56 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:23.756349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 135/266] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:23.762875 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86839ac-7ea7-4951-ae7a-7b9555ad1754 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:23.838590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa35aa-de4a-4460-b6be-d595b4655584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:23.839276 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa35aa-de4a-4460-b6be-d595b4655584 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:23.839731 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa35aa-de4a-4460-b6be-d595b4655584 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:23.840159 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa35aa-de4a-4460-b6be-d595b4655584 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:23.841208 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa35aa-de4a-4460-b6be-d595b4655584 None admin] RBAC: Adding query filter params (role.id=f0bb7fa65c8545699b60f857f930b078, scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564, user.id=5ffcefcb92714491a79e1e609f28771b) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:23.841666 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa35aa-de4a-4460-b6be-d595b4655584 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:23.843262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa35aa-de4a-4460-b6be-d595b4655584 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:23.858894 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 132/267] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:23 2022] GET /identity/v3/role_assignments?user.id=5ffcefcb92714491a79e1e609f28771b&scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564&role.id=f0bb7fa65c8545699b60f857f930b078 => generated 608 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:23.904726 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:23.967535 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86839ac-7ea7-4951-ae7a-7b9555ad1754 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:24.015812 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99f38a-17de-4a1f-815b-ed6c4f975bed None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:24.016485 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99f38a-17de-4a1f-815b-ed6c4f975bed None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:24.016969 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99f38a-17de-4a1f-815b-ed6c4f975bed None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:24.017321 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c5297-92ed-40ac-b5ce-ae007e68167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:24.018237 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c5297-92ed-40ac-b5ce-ae007e68167b None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:24.018524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c5297-92ed-40ac-b5ce-ae007e68167b None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:24.018808 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c5297-92ed-40ac-b5ce-ae007e68167b None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:24.019479 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 133/268] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:38:24.025182 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c5297-92ed-40ac-b5ce-ae007e68167b None admin] RBAC: Authorizing `identity:get_project(project_id=3ffde5ab0f994cd5b8e67d5092a69564)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:24.025182 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c5297-92ed-40ac-b5ce-ae007e68167b None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:24.025182 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 136/269] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:23 2022] GET /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:24.025712 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49d5a7-8857-4e31-8886-b880646a4813 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:24.026009 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49d5a7-8857-4e31-8886-b880646a4813 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:24.026295 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49d5a7-8857-4e31-8886-b880646a4813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:24.033499 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c5297-92ed-40ac-b5ce-ae007e68167b None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:24.059362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-aa49d5a7-8857-4e31-8886-b880646a4813 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:24.060572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-aa49d5a7-8857-4e31-8886-b880646a4813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:24.177734 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:24.189255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 134/270] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:24.227811 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd3f5f-d8c4-464c-a111-96f017755099 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:24.228254 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd3f5f-d8c4-464c-a111-96f017755099 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:24.228645 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd3f5f-d8c4-464c-a111-96f017755099 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:24.234474 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 135/271] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:24.235932 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd3f5f-d8c4-464c-a111-96f017755099 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:24.238499 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c5297-92ed-40ac-b5ce-ae007e68167b None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:24.279233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fbcb6-8a99-4858-8eb9-5d8008629eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:24.279812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fbcb6-8a99-4858-8eb9-5d8008629eb5 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:24.280097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fbcb6-8a99-4858-8eb9-5d8008629eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:24.280373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fbcb6-8a99-4858-8eb9-5d8008629eb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:24.281364 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fbcb6-8a99-4858-8eb9-5d8008629eb5 None admin] RBAC: Adding query filter params (role.id=76bd0cf7bf094e4fa3db121b96215004, scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564, user.id=5ffcefcb92714491a79e1e609f28771b) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:24.281671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fbcb6-8a99-4858-8eb9-5d8008629eb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:24.283280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fbcb6-8a99-4858-8eb9-5d8008629eb5 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:24.286367 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:24.290728 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 137/272] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:24 2022] GET /identity/v3/role_assignments?user.id=5ffcefcb92714491a79e1e609f28771b&scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564&role.id=76bd0cf7bf094e4fa3db121b96215004 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:24.292116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b885a3-4a6c-45fc-a3b5-828f936d714d None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:24.292479 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b885a3-4a6c-45fc-a3b5-828f936d714d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:24.292830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b885a3-4a6c-45fc-a3b5-828f936d714d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:24.314881 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-f6b885a3-4a6c-45fc-a3b5-828f936d714d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:24.316279 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f6b885a3-4a6c-45fc-a3b5-828f936d714d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:24.380202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd3f5f-d8c4-464c-a111-96f017755099 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:24.424990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fe2eb-69fb-4520-b6b7-42052d963cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:24.426267 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fe2eb-69fb-4520-b6b7-42052d963cb6 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:24.426730 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fe2eb-69fb-4520-b6b7-42052d963cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:24.427208 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fe2eb-69fb-4520-b6b7-42052d963cb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:24.440358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fe2eb-69fb-4520-b6b7-42052d963cb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:24.449928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-d92fe2eb-69fb-4520-b6b7-42052d963cb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:24.449928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:24.449928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:24.449928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:24.449928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:24.449928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:24.449928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:24.449928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:24.449928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:24.449928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:24.449928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:24.449928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:24.449928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:24.449928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:24.449928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:24.449928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:24.450885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:24.450885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:24.450885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:24.450885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:24.450885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:24.450885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:24.450885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:24.450885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:24.450885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:24.450885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:24.450885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:24.450885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:24.450885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:24.450885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:24.450885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:24.450885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:24.451663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:24.451663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:24.451663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:24.451663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:24.451663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:24.451663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:24.451663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:24.451663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:24.451663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:24.451663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:24.451663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:24.451663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:24.452248 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 138/273] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:24.454406 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 136/274] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:24.462236 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aacf4e-2cce-4461-a956-1929847652c9 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:24.462830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aacf4e-2cce-4461-a956-1929847652c9 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:24.463263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aacf4e-2cce-4461-a956-1929847652c9 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:24.464823 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 139/275] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:24.469905 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fe2eb-69fb-4520-b6b7-42052d963cb6 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:24.479466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa28ac-1e2a-4996-8da2-34fc1e67121d None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:24.480745 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa28ac-1e2a-4996-8da2-34fc1e67121d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:24.481031 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa28ac-1e2a-4996-8da2-34fc1e67121d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:24.505719 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-44fa28ac-1e2a-4996-8da2-34fc1e67121d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:24.507888 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-44fa28ac-1e2a-4996-8da2-34fc1e67121d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:24.544339 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:24.603415 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 140/276] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:24.609178 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa28ac-1e2a-4996-8da2-34fc1e67121d None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:24.609318 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fe2eb-69fb-4520-b6b7-42052d963cb6 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:24.647729 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951779c-80b2-4502-b120-f4370f1df25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:24.648971 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951779c-80b2-4502-b120-f4370f1df25a None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:24.649315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951779c-80b2-4502-b120-f4370f1df25a None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:24.649595 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951779c-80b2-4502-b120-f4370f1df25a None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:24.650365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951779c-80b2-4502-b120-f4370f1df25a None admin] RBAC: Adding query filter params (name=member) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:24.650806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951779c-80b2-4502-b120-f4370f1df25a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:24.652332 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951779c-80b2-4502-b120-f4370f1df25a None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:24.666078 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 137/277] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:24.666078 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951779c-80b2-4502-b120-f4370f1df25a None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:24.680936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:24.724345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa28ac-1e2a-4996-8da2-34fc1e67121d None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:24.763192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96630767-cea7-4e5a-8794-35e245b59a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:24.763982 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96630767-cea7-4e5a-8794-35e245b59a41 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:24.764265 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96630767-cea7-4e5a-8794-35e245b59a41 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:24.764542 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96630767-cea7-4e5a-8794-35e245b59a41 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:24.773718 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951779c-80b2-4502-b120-f4370f1df25a None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:24.775185 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96630767-cea7-4e5a-8794-35e245b59a41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:24.782872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-96630767-cea7-4e5a-8794-35e245b59a41 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 19:38:24.782872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:24.782872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:24.782872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:24.782872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:24.782872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:24.782872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:24.782872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:24.782872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:24.782872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:24.782872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:24.782872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:24.782872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:24.782872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:24.782872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:24.782872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:24.783776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:24.783776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:24.783776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:24.783776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:24.783776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:24.783776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:24.783776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:24.783776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:24.783776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:24.783776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:24.783776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:24.783776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:24.783776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:24.783776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:24.783776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:24.783776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:24.784590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:24.784590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:24.784590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:24.784590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:24.784590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:24.784590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:24.784590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:24.784590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:24.784590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:24.784590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:24.784590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 19:38:24.784590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:24.784590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 141/278] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:24.785299 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96630767-cea7-4e5a-8794-35e245b59a41 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:24.795222 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:24.815288 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164d361-a749-4708-b253-a67d20d40bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:24.816130 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164d361-a749-4708-b253-a67d20d40bfd None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:24.816418 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164d361-a749-4708-b253-a67d20d40bfd None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:24.816697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164d361-a749-4708-b253-a67d20d40bfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:24.818138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164d361-a749-4708-b253-a67d20d40bfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:24.819587 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164d361-a749-4708-b253-a67d20d40bfd None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:24.821995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 138/279] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:24.822686 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164d361-a749-4708-b253-a67d20d40bfd None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:24.907468 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96630767-cea7-4e5a-8794-35e245b59a41 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:24.928370 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:24.935673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164d361-a749-4708-b253-a67d20d40bfd None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:24.942514 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714314b9-1979-4d2a-b717-bd6b543b4945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:24.943640 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714314b9-1979-4d2a-b717-bd6b543b4945 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:24.943925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714314b9-1979-4d2a-b717-bd6b543b4945 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:24.944202 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714314b9-1979-4d2a-b717-bd6b543b4945 None admin] PATH_INFO: `/v3/users/bd71bcb0cc1b40b2adcba2ffce886eea` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:24.958672 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714314b9-1979-4d2a-b717-bd6b543b4945 None admin] RBAC: Authorizing `identity:get_user(user_id=bd71bcb0cc1b40b2adcba2ffce886eea)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:24.960142 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714314b9-1979-4d2a-b717-bd6b543b4945 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:24.963068 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 142/280] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:24 2022] GET /identity/v3/users/bd71bcb0cc1b40b2adcba2ffce886eea => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:24.963827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714314b9-1979-4d2a-b717-bd6b543b4945 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:24.980595 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa327dbc-01a2-48ac-b4c1-74f524693ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:24.981414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa327dbc-01a2-48ac-b4c1-74f524693ed3 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:24.981706 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa327dbc-01a2-48ac-b4c1-74f524693ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:24.981989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa327dbc-01a2-48ac-b4c1-74f524693ed3 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:24.982747 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa327dbc-01a2-48ac-b4c1-74f524693ed3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:24.983062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa327dbc-01a2-48ac-b4c1-74f524693ed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:24.984448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa327dbc-01a2-48ac-b4c1-74f524693ed3 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:24.993206 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 139/281] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:24.994515 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227c5ae-d72d-42eb-a851-f8093e01a215 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:24.994809 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227c5ae-d72d-42eb-a851-f8093e01a215 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:24.995087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227c5ae-d72d-42eb-a851-f8093e01a215 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:24.996451 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 140/282] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:24.997051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227c5ae-d72d-42eb-a851-f8093e01a215 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:25.043514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:25.070854 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714314b9-1979-4d2a-b717-bd6b543b4945 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:25.098785 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227c5ae-d72d-42eb-a851-f8093e01a215 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:25.103870 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ec4d3-4538-481a-8553-c5c7477c5272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:25.104537 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ec4d3-4538-481a-8553-c5c7477c5272 None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:25.104819 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ec4d3-4538-481a-8553-c5c7477c5272 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:25.105096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ec4d3-4538-481a-8553-c5c7477c5272 None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:25.105881 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ec4d3-4538-481a-8553-c5c7477c5272 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:25.107316 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ec4d3-4538-481a-8553-c5c7477c5272 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:25.131228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805eebd-1085-4618-b973-deccd5f884c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:25.132254 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805eebd-1085-4618-b973-deccd5f884c7 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:25.132254 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805eebd-1085-4618-b973-deccd5f884c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:25.133079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805eebd-1085-4618-b973-deccd5f884c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:25.133945 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805eebd-1085-4618-b973-deccd5f884c7 None admin] RBAC: Adding query filter params (role.id=61895d866a7c44de8924486b8e5ec6e8, user.id=bd71bcb0cc1b40b2adcba2ffce886eea, scope.system=all) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:25.134259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805eebd-1085-4618-b973-deccd5f884c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:25.135734 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805eebd-1085-4618-b973-deccd5f884c7 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:25.140767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 141/283] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Jun 23 19:38:24 2022] GET /identity/v3/role_assignments?user.id=bd71bcb0cc1b40b2adcba2ffce886eea&scope.system=all&role.id=61895d866a7c44de8924486b8e5ec6e8 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:25.141559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805eebd-1085-4618-b973-deccd5f884c7 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:25.184292 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 143/284] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 19:38:24 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:38:25.195594 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52f2cb-9935-44e2-a248-5b708410481e None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:25.196895 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52f2cb-9935-44e2-a248-5b708410481e None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:25.197428 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52f2cb-9935-44e2-a248-5b708410481e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:25.221806 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-bb52f2cb-9935-44e2-a248-5b708410481e None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:25.224420 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-bb52f2cb-9935-44e2-a248-5b708410481e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:25.265189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805eebd-1085-4618-b973-deccd5f884c7 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:25.270062 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:25.285597 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:25.315397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8e8fc-0908-4dc9-9620-95734e87b75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:25.316455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8e8fc-0908-4dc9-9620-95734e87b75e None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:25.316845 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8e8fc-0908-4dc9-9620-95734e87b75e None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:25.317258 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8e8fc-0908-4dc9-9620-95734e87b75e None admin] PATH_INFO: `/v3/users/ee96faca63aa40caa22e08f48bfd09b2` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:25.320358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8e8fc-0908-4dc9-9620-95734e87b75e None admin] RBAC: Authorizing `identity:get_user(user_id=ee96faca63aa40caa22e08f48bfd09b2)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:25.324245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8e8fc-0908-4dc9-9620-95734e87b75e None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:25.324245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 142/285] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:25 2022] GET /identity/v3/users/ee96faca63aa40caa22e08f48bfd09b2 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:25.330943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8e8fc-0908-4dc9-9620-95734e87b75e None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:25.331351 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 144/286] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:25.356329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52f2cb-9935-44e2-a248-5b708410481e None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:25.481476 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52f2cb-9935-44e2-a248-5b708410481e None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:25.487157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8e8fc-0908-4dc9-9620-95734e87b75e None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:25.525435 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363fe4e-d8e9-4503-bd0f-6613796ee3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:25.526503 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363fe4e-d8e9-4503-bd0f-6613796ee3fc None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:25.526790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363fe4e-d8e9-4503-bd0f-6613796ee3fc None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:25.527524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363fe4e-d8e9-4503-bd0f-6613796ee3fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:25.535910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e108586-2f5f-47dc-afac-1c5b92572922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:25.536770 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e108586-2f5f-47dc-afac-1c5b92572922 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:25.537055 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e108586-2f5f-47dc-afac-1c5b92572922 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:25.537358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e108586-2f5f-47dc-afac-1c5b92572922 None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:25.539996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e108586-2f5f-47dc-afac-1c5b92572922 None admin] RBAC: Authorizing `identity:get_project(project_id=3ffde5ab0f994cd5b8e67d5092a69564)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:25.541490 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e108586-2f5f-47dc-afac-1c5b92572922 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:25.543361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 143/287] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:25 2022] GET /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:25.547707 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363fe4e-d8e9-4503-bd0f-6613796ee3fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:25.550084 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e108586-2f5f-47dc-afac-1c5b92572922 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:25.557610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-6363fe4e-d8e9-4503-bd0f-6613796ee3fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:25.557610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:25.557610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:25.557610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:25.557610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:25.557610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:25.557610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:25.557610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:25.557610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:25.557610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:25.557610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:25.557610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:25.557610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:25.557610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:25.557610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:25.557610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:25.558507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:25.558507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:25.558507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:25.558507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:25.558507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:25.558507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:25.558507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:25.558507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:25.558507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:25.558507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:25.558507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:25.558507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:25.558507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:25.558507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:25.558507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:25.558507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:25.559320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:25.559320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:25.559320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:25.559320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:25.559320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:25.559320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:25.559320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:25.559320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:25.559320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:25.559320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:25.559320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:25.559320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:25.559320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 145/288] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:38:25.565254 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363fe4e-d8e9-4503-bd0f-6613796ee3fc None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:25.595626 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:25.612000 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:25.680565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e108586-2f5f-47dc-afac-1c5b92572922 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:25.708019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363fe4e-d8e9-4503-bd0f-6613796ee3fc None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:25.720512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815477d-0116-4e76-8b4f-7b9133d20c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:25.721450 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815477d-0116-4e76-8b4f-7b9133d20c71 None admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:25.722298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815477d-0116-4e76-8b4f-7b9133d20c71 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:25.722584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815477d-0116-4e76-8b4f-7b9133d20c71 None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564/users/ee96faca63aa40caa22e08f48bfd09b2/roles/d81add03275a412284f307885c341f6f` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:25.725069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2815477d-0116-4e76-8b4f-7b9133d20c71 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ffde5ab0f994cd5b8e67d5092a69564, user_id=ee96faca63aa40caa22e08f48bfd09b2, role_id=d81add03275a412284f307885c341f6f)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:25.727414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2815477d-0116-4e76-8b4f-7b9133d20c71 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:25.751201 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83fdc6-7eef-4ebd-956d-bc8bfdcc6bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:25.751882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83fdc6-7eef-4ebd-956d-bc8bfdcc6bb4 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:25.752172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83fdc6-7eef-4ebd-956d-bc8bfdcc6bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:25.752455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83fdc6-7eef-4ebd-956d-bc8bfdcc6bb4 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:25.753256 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83fdc6-7eef-4ebd-956d-bc8bfdcc6bb4 None admin] RBAC: Adding query filter params (name=member) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:25.753570 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83fdc6-7eef-4ebd-956d-bc8bfdcc6bb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:25.754960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83fdc6-7eef-4ebd-956d-bc8bfdcc6bb4 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:25.764789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 146/289] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:25.770005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83fdc6-7eef-4ebd-956d-bc8bfdcc6bb4 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:25.811846 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 144/290] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:38:25 2022] PUT /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564/users/ee96faca63aa40caa22e08f48bfd09b2/roles/d81add03275a412284f307885c341f6f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:38:25.872847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:25.886930 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83fdc6-7eef-4ebd-956d-bc8bfdcc6bb4 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:25.925058 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870ee95-5029-43a8-bd35-1497ccede967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:25.926091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870ee95-5029-43a8-bd35-1497ccede967 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:25.926601 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870ee95-5029-43a8-bd35-1497ccede967 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:25.926935 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870ee95-5029-43a8-bd35-1497ccede967 None admin] PATH_INFO: `/v3/users/688c2d3c08ae43bca329afdca59d8908` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:25.928221 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870ee95-5029-43a8-bd35-1497ccede967 None admin] RBAC: Authorizing `identity:get_user(user_id=688c2d3c08ae43bca329afdca59d8908)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:25.930355 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870ee95-5029-43a8-bd35-1497ccede967 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:25.932606 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 147/291] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:25 2022] GET /identity/v3/users/688c2d3c08ae43bca329afdca59d8908 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:25.937844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815477d-0116-4e76-8b4f-7b9133d20c71 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:26.068715 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815477d-0116-4e76-8b4f-7b9133d20c71 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:26.076991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:26.104908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964afdfe-e17a-4b2a-89ea-5da3034a0ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:26.105932 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964afdfe-e17a-4b2a-89ea-5da3034a0ce1 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:26.106391 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964afdfe-e17a-4b2a-89ea-5da3034a0ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:26.106865 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964afdfe-e17a-4b2a-89ea-5da3034a0ce1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:26.176356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964afdfe-e17a-4b2a-89ea-5da3034a0ce1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:26.178141 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964afdfe-e17a-4b2a-89ea-5da3034a0ce1 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:26.280631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 145/292] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 19:38:26.286046 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870ee95-5029-43a8-bd35-1497ccede967 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:26.475369 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870ee95-5029-43a8-bd35-1497ccede967 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:26.515394 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090be89-abe4-41fb-b8d0-6a901a0f337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:26.516261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090be89-abe4-41fb-b8d0-6a901a0f337e None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:26.516550 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090be89-abe4-41fb-b8d0-6a901a0f337e None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:26.516830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090be89-abe4-41fb-b8d0-6a901a0f337e None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:26.521860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090be89-abe4-41fb-b8d0-6a901a0f337e None admin] RBAC: Authorizing `identity:get_project(project_id=3ffde5ab0f994cd5b8e67d5092a69564)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:26.523717 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090be89-abe4-41fb-b8d0-6a901a0f337e None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:26.525454 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 148/293] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:26 2022] GET /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:26.531216 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964afdfe-e17a-4b2a-89ea-5da3034a0ce1 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:26.540172 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:26.653446 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964afdfe-e17a-4b2a-89ea-5da3034a0ce1 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:26.687745 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c105831-61af-4418-8e4d-cf0af3814b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:26.688399 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c105831-61af-4418-8e4d-cf0af3814b4a None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:26.688681 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c105831-61af-4418-8e4d-cf0af3814b4a None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:26.688956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c105831-61af-4418-8e4d-cf0af3814b4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:26.689828 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c105831-61af-4418-8e4d-cf0af3814b4a None admin] RBAC: Adding query filter params (role.id=61895d866a7c44de8924486b8e5ec6e8, scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564, user.id=688c2d3c08ae43bca329afdca59d8908) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:26.690139 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c105831-61af-4418-8e4d-cf0af3814b4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:26.691582 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c105831-61af-4418-8e4d-cf0af3814b4a None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:26.698852 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 146/294] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:26 2022] GET /identity/v3/role_assignments?user.id=688c2d3c08ae43bca329afdca59d8908&scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564&role.id=61895d866a7c44de8924486b8e5ec6e8 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:27.592814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a05ca-8b42-48a2-88ad-b1cd8c42d259 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:27.593899 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a05ca-8b42-48a2-88ad-b1cd8c42d259 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:27.594394 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a05ca-8b42-48a2-88ad-b1cd8c42d259 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:27.595973 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 149/295] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:27.602011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fced1-7ece-4454-ab56-c0c4447301a2 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:27.602840 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fced1-7ece-4454-ab56-c0c4447301a2 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:27.603359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fced1-7ece-4454-ab56-c0c4447301a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:27.620455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-7c8fced1-7ece-4454-ab56-c0c4447301a2 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:27.621973 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7c8fced1-7ece-4454-ab56-c0c4447301a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:27.691528 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:27.696951 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 147/296] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:27.720001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a05ca-8b42-48a2-88ad-b1cd8c42d259 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:27.735490 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af32947-39c4-4deb-985a-1cac2f0515c6 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:27.735776 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af32947-39c4-4deb-985a-1cac2f0515c6 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:27.736047 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af32947-39c4-4deb-985a-1cac2f0515c6 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:27.737775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 148/297] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:38:27.743792 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d169f-7d12-4d7b-ac07-595110b2c8e6 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:27.744080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d169f-7d12-4d7b-ac07-595110b2c8e6 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:27.744365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d169f-7d12-4d7b-ac07-595110b2c8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:27.748484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:27.761396 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-882d169f-7d12-4d7b-ac07-595110b2c8e6 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:27.762584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-882d169f-7d12-4d7b-ac07-595110b2c8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:27.841403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 149/298] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:27.844805 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a05ca-8b42-48a2-88ad-b1cd8c42d259 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:27.860006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d169f-7d12-4d7b-ac07-595110b2c8e6 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:27.881428 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336c81d-a8f1-45af-8deb-13304bee1461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:27.882307 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336c81d-a8f1-45af-8deb-13304bee1461 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:27.882590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336c81d-a8f1-45af-8deb-13304bee1461 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:27.882879 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336c81d-a8f1-45af-8deb-13304bee1461 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:27.893841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336c81d-a8f1-45af-8deb-13304bee1461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:27.902251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-4336c81d-a8f1-45af-8deb-13304bee1461 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:27.902251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:27.902251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:27.902251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:27.902251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:27.902251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:27.902251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:27.902251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:27.902251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:27.902251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:27.902251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:27.902251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:27.902251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:27.902251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:27.902251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:27.902251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:27.903114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:27.903114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:27.903114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:27.903114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:27.903114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:27.903114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:27.903114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:27.903114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:27.903114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:27.903114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:27.903114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:27.903114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:27.903114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:27.903114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:27.903114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:27.903114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:27.903902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:27.903902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:27.903902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:27.903902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:27.903902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:27.903902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:27.903902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:27.903902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:27.903902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:27.903902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:27.903902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:27.903902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:27.908331 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 150/299] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:27.909637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c07257-9154-460d-a2da-8d159247521b None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:27.910023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c07257-9154-460d-a2da-8d159247521b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:27.910290 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c07257-9154-460d-a2da-8d159247521b None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:27.913210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 151/300] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:27.915513 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c07257-9154-460d-a2da-8d159247521b None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:27.971000 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d169f-7d12-4d7b-ac07-595110b2c8e6 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:28.000679 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:28.006999 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6be0e1-79bb-42b4-8bb7-840e60053458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:28.007466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:28.007894 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6be0e1-79bb-42b4-8bb7-840e60053458 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:28.008222 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6be0e1-79bb-42b4-8bb7-840e60053458 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:28.008502 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6be0e1-79bb-42b4-8bb7-840e60053458 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:28.009970 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6be0e1-79bb-42b4-8bb7-840e60053458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:28.011547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6be0e1-79bb-42b4-8bb7-840e60053458 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:28.017259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 150/301] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:28.017259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d674206-cada-48ff-8347-97bcbc387370 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:28.017259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d674206-cada-48ff-8347-97bcbc387370 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:28.017259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d674206-cada-48ff-8347-97bcbc387370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:28.031447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-9d674206-cada-48ff-8347-97bcbc387370 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:28.032412 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c07257-9154-460d-a2da-8d159247521b None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:28.032660 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-9d674206-cada-48ff-8347-97bcbc387370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:28.068697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e4c12-dadc-47b1-a668-10f54dc844cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:28.069410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e4c12-dadc-47b1-a668-10f54dc844cb None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:28.070346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e4c12-dadc-47b1-a668-10f54dc844cb None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:28.070661 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e4c12-dadc-47b1-a668-10f54dc844cb None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:28.071397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e4c12-dadc-47b1-a668-10f54dc844cb None admin] RBAC: Adding query filter params (name=member) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:28.071710 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e4c12-dadc-47b1-a668-10f54dc844cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:28.073100 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e4c12-dadc-47b1-a668-10f54dc844cb None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:28.085885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 152/302] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:28.085885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e4c12-dadc-47b1-a668-10f54dc844cb None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:28.107041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 151/303] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:28.118053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d674206-cada-48ff-8347-97bcbc387370 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:28.192971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e4c12-dadc-47b1-a668-10f54dc844cb None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:28.229619 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d674206-cada-48ff-8347-97bcbc387370 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:28.231533 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84857b3c-9398-4bdd-875c-24958fad4088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:28.233079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84857b3c-9398-4bdd-875c-24958fad4088 None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:28.233411 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84857b3c-9398-4bdd-875c-24958fad4088 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:28.233695 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84857b3c-9398-4bdd-875c-24958fad4088 None admin] PATH_INFO: `/v3/groups` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:28.234391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84857b3c-9398-4bdd-875c-24958fad4088 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:28.235839 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84857b3c-9398-4bdd-875c-24958fad4088 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:28.258464 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:28.265982 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443580c4-c53e-4e2c-a69a-f81e6f2aedda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:28.266882 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443580c4-c53e-4e2c-a69a-f81e6f2aedda None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:28.267206 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443580c4-c53e-4e2c-a69a-f81e6f2aedda None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:28.267488 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443580c4-c53e-4e2c-a69a-f81e6f2aedda None admin] PATH_INFO: `/v3/users/bd71bcb0cc1b40b2adcba2ffce886eea` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:28.268675 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443580c4-c53e-4e2c-a69a-f81e6f2aedda None admin] RBAC: Authorizing `identity:get_user(user_id=bd71bcb0cc1b40b2adcba2ffce886eea)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:28.270162 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443580c4-c53e-4e2c-a69a-f81e6f2aedda None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:28.271789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 152/304] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:28 2022] GET /identity/v3/users/bd71bcb0cc1b40b2adcba2ffce886eea => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:28.271789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443580c4-c53e-4e2c-a69a-f81e6f2aedda None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:28.316530 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 153/305] 10.222.0.13 () {60 vars in 1134 bytes} [Thu Jun 23 19:38:28 2022] POST /identity/v3/groups => generated 229 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:38:28.316530 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84857b3c-9398-4bdd-875c-24958fad4088 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:28.321717 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:28.391857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443580c4-c53e-4e2c-a69a-f81e6f2aedda None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:28.429820 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84857b3c-9398-4bdd-875c-24958fad4088 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:28.435777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8468630-118c-495e-b9c5-8d7b70f118f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:28.436591 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8468630-118c-495e-b9c5-8d7b70f118f5 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:28.436880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8468630-118c-495e-b9c5-8d7b70f118f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:28.437173 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8468630-118c-495e-b9c5-8d7b70f118f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:28.452574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8468630-118c-495e-b9c5-8d7b70f118f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:28.460659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-e8468630-118c-495e-b9c5-8d7b70f118f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 19:38:28.460659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:28.460659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:28.460659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:28.460659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:28.460659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:28.460659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:28.460659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:28.460659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:28.460659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:28.460659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:28.460659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:28.460659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:28.460659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:28.460659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:28.460659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:28.462361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:28.462361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:28.462361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:28.462361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:28.462361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:28.462361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:28.462361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:28.462361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:28.462361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:28.462361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:28.462361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:28.462361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:28.462361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:28.462361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:28.462361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:28.462361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:28.463360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:28.463360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:28.463360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:28.463360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:28.463360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:28.463360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:28.463360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:28.463360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:28.463360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:28.463360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:28.463360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 19:38:28.463360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:28.466092 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 153/306] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:28.467081 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51aa2f-8733-463b-b370-1e37521496b1 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:28.467403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51aa2f-8733-463b-b370-1e37521496b1 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:28.468355 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51aa2f-8733-463b-b370-1e37521496b1 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:28.469270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 154/307] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:28.469870 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51aa2f-8733-463b-b370-1e37521496b1 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:28.475064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d07b7-a0fd-4823-8520-a4eaa94642e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:28.476471 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d07b7-a0fd-4823-8520-a4eaa94642e5 None admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:28.477708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d07b7-a0fd-4823-8520-a4eaa94642e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:28.477708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d07b7-a0fd-4823-8520-a4eaa94642e5 None admin] PATH_INFO: `/v3/system/users/bd71bcb0cc1b40b2adcba2ffce886eea/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:28.479248 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d07b7-a0fd-4823-8520-a4eaa94642e5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bd71bcb0cc1b40b2adcba2ffce886eea, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:28.481028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d07b7-a0fd-4823-8520-a4eaa94642e5 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:28.530380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:28.572259 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 154/308] 10.222.0.13 () {58 vars in 1334 bytes} [Thu Jun 23 19:38:28 2022] PUT /identity/v3/system/users/bd71bcb0cc1b40b2adcba2ffce886eea/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:38:28.573679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53e3af-3d87-4926-9efc-68e9fc7dc98d None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:28.574144 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53e3af-3d87-4926-9efc-68e9fc7dc98d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:28.574565 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53e3af-3d87-4926-9efc-68e9fc7dc98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:28.582960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51aa2f-8733-463b-b370-1e37521496b1 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:28.593078 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-7b53e3af-3d87-4926-9efc-68e9fc7dc98d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:28.594392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-7b53e3af-3d87-4926-9efc-68e9fc7dc98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:28.631181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab809ad-d9ed-4371-90b8-89efb78d3a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:28.633418 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab809ad-d9ed-4371-90b8-89efb78d3a86 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:28.634180 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab809ad-d9ed-4371-90b8-89efb78d3a86 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:28.635095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab809ad-d9ed-4371-90b8-89efb78d3a86 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:28.636640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab809ad-d9ed-4371-90b8-89efb78d3a86 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:28.637311 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab809ad-d9ed-4371-90b8-89efb78d3a86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:28.639070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab809ad-d9ed-4371-90b8-89efb78d3a86 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:28.653320 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 155/309] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:28.658608 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab809ad-d9ed-4371-90b8-89efb78d3a86 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:28.674818 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:28.681005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 155/310] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:28.707931 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53e3af-3d87-4926-9efc-68e9fc7dc98d None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:28.802487 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab809ad-d9ed-4371-90b8-89efb78d3a86 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:28.825611 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53e3af-3d87-4926-9efc-68e9fc7dc98d None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:28.827079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:28.856287 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962b7cb-9c12-4af8-85bc-2a2ca533711e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:28.857176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962b7cb-9c12-4af8-85bc-2a2ca533711e None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:28.857486 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962b7cb-9c12-4af8-85bc-2a2ca533711e None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:28.857775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962b7cb-9c12-4af8-85bc-2a2ca533711e None admin] PATH_INFO: `/v3/users/5221a88d0dce4c0db8948bc9be77cde7` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:28.875247 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962b7cb-9c12-4af8-85bc-2a2ca533711e None admin] RBAC: Authorizing `identity:get_user(user_id=5221a88d0dce4c0db8948bc9be77cde7)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:28.876662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962b7cb-9c12-4af8-85bc-2a2ca533711e None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:28.878490 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 156/311] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:28 2022] GET /identity/v3/users/5221a88d0dce4c0db8948bc9be77cde7 => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:28.880377 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fec36-73b9-4ee4-97ad-462f59b2d4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:28.881397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fec36-73b9-4ee4-97ad-462f59b2d4c8 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:28.881846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fec36-73b9-4ee4-97ad-462f59b2d4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:28.883096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fec36-73b9-4ee4-97ad-462f59b2d4c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:28.885021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962b7cb-9c12-4af8-85bc-2a2ca533711e None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:28.897194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fec36-73b9-4ee4-97ad-462f59b2d4c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:28.908195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-e83fec36-73b9-4ee4-97ad-462f59b2d4c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 19:38:28.908195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:28.908195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:28.908195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:28.908195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:28.908195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:28.908195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:28.908195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:28.908195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:28.908195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:28.908195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:28.908195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:28.908195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:28.908195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:28.908195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:28.908195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:28.909295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:28.909295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:28.909295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:28.909295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:28.909295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:28.909295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:28.909295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:28.909295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:28.909295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:28.909295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:28.909295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:28.909295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:28.909295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:28.909295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:28.909295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:28.909295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:28.910115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:28.910115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:28.910115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:28.910115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:28.910115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:28.910115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:28.910115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:28.910115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:28.910115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:28.910115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:28.910115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 19:38:28.910115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:28.911559 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 156/312] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:28.917290 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fec36-73b9-4ee4-97ad-462f59b2d4c8 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:28.988314 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:29.009536 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962b7cb-9c12-4af8-85bc-2a2ca533711e None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:29.047307 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fec36-73b9-4ee4-97ad-462f59b2d4c8 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:29.065296 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c89b75-9de0-4106-8d0b-824ac2837a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:29.066625 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c89b75-9de0-4106-8d0b-824ac2837a8b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:29.066921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c89b75-9de0-4106-8d0b-824ac2837a8b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:29.067205 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c89b75-9de0-4106-8d0b-824ac2837a8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:29.068343 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c89b75-9de0-4106-8d0b-824ac2837a8b None admin] RBAC: Adding query filter params (role.id=d81add03275a412284f307885c341f6f, user.id=5221a88d0dce4c0db8948bc9be77cde7, scope.system=all) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:29.068658 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c89b75-9de0-4106-8d0b-824ac2837a8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:29.070760 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c89b75-9de0-4106-8d0b-824ac2837a8b None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:29.079363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 157/313] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Jun 23 19:38:28 2022] GET /identity/v3/role_assignments?user.id=5221a88d0dce4c0db8948bc9be77cde7&scope.system=all&role.id=d81add03275a412284f307885c341f6f => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:29.093340 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ab3bd-9928-4469-98b1-33d07a66130c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:29.094051 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ab3bd-9928-4469-98b1-33d07a66130c None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:29.094339 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ab3bd-9928-4469-98b1-33d07a66130c None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:29.094620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ab3bd-9928-4469-98b1-33d07a66130c None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:29.095443 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ab3bd-9928-4469-98b1-33d07a66130c None admin] RBAC: Adding query filter params (name=reader) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:29.095834 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ab3bd-9928-4469-98b1-33d07a66130c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:29.097361 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ab3bd-9928-4469-98b1-33d07a66130c None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:29.108093 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 157/314] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:29.114352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c89b75-9de0-4106-8d0b-824ac2837a8b None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:29.173983 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:29.243343 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c89b75-9de0-4106-8d0b-824ac2837a8b None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:29.282303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407ef52-72d4-4d7f-9fe0-d759d13de002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:29.283578 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407ef52-72d4-4d7f-9fe0-d759d13de002 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:29.284074 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407ef52-72d4-4d7f-9fe0-d759d13de002 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:29.284558 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407ef52-72d4-4d7f-9fe0-d759d13de002 None admin] PATH_INFO: `/v3/users/ee96faca63aa40caa22e08f48bfd09b2` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:29.286085 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407ef52-72d4-4d7f-9fe0-d759d13de002 None admin] RBAC: Authorizing `identity:get_user(user_id=ee96faca63aa40caa22e08f48bfd09b2)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:29.287751 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407ef52-72d4-4d7f-9fe0-d759d13de002 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:29.290398 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 158/315] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:29 2022] GET /identity/v3/users/ee96faca63aa40caa22e08f48bfd09b2 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:29.296096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ab3bd-9928-4469-98b1-33d07a66130c None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:29.410362 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ab3bd-9928-4469-98b1-33d07a66130c None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:29.432286 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:29.447383 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff392b-0895-4a7e-9593-d30126cdbac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:29.452927 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff392b-0895-4a7e-9593-d30126cdbac5 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:29.452927 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff392b-0895-4a7e-9593-d30126cdbac5 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:29.452927 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff392b-0895-4a7e-9593-d30126cdbac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:29.522727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff392b-0895-4a7e-9593-d30126cdbac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:29.524341 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff392b-0895-4a7e-9593-d30126cdbac5 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:29.627959 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 158/316] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:29.633218 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407ef52-72d4-4d7f-9fe0-d759d13de002 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:29.763601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407ef52-72d4-4d7f-9fe0-d759d13de002 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:29.786876 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:29.811216 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ed1c0-0934-4469-86e5-99145fad9d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:29.812607 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ed1c0-0934-4469-86e5-99145fad9d8f None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:29.812895 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ed1c0-0934-4469-86e5-99145fad9d8f None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:29.813198 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ed1c0-0934-4469-86e5-99145fad9d8f None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:29.814598 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ed1c0-0934-4469-86e5-99145fad9d8f None admin] RBAC: Authorizing `identity:get_project(project_id=3ffde5ab0f994cd5b8e67d5092a69564)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:29.816366 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ed1c0-0934-4469-86e5-99145fad9d8f None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:29.818850 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 159/317] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:29 2022] GET /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:29.825125 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff392b-0895-4a7e-9593-d30126cdbac5 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:29.853517 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:30.022379 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff392b-0895-4a7e-9593-d30126cdbac5 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:30.059721 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aceb191-a7c2-490b-9d5f-c184e401b898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:30.060789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aceb191-a7c2-490b-9d5f-c184e401b898 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:30.061328 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aceb191-a7c2-490b-9d5f-c184e401b898 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:30.061811 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aceb191-a7c2-490b-9d5f-c184e401b898 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:30.062860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aceb191-a7c2-490b-9d5f-c184e401b898 None admin] RBAC: Adding query filter params (role.id=d81add03275a412284f307885c341f6f, scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564, user.id=ee96faca63aa40caa22e08f48bfd09b2) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:30.063395 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aceb191-a7c2-490b-9d5f-c184e401b898 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:30.065052 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aceb191-a7c2-490b-9d5f-c184e401b898 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:30.072154 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 159/318] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:29 2022] GET /identity/v3/role_assignments?user.id=ee96faca63aa40caa22e08f48bfd09b2&scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564&role.id=d81add03275a412284f307885c341f6f => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:30.515934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f287d2c-9ba0-4e80-aff1-5690fd2120f4 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:30.516329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f287d2c-9ba0-4e80-aff1-5690fd2120f4 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:30.516514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f287d2c-9ba0-4e80-aff1-5690fd2120f4 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:30.518047 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 160/319] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:38:30.523017 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bde91e-7152-49aa-b40c-9e18271d70d2 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:30.523311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bde91e-7152-49aa-b40c-9e18271d70d2 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:30.523594 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bde91e-7152-49aa-b40c-9e18271d70d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:30.540403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-50bde91e-7152-49aa-b40c-9e18271d70d2 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:30.541616 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-50bde91e-7152-49aa-b40c-9e18271d70d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:30.610111 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 160/320] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:38:30.633699 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f287d2c-9ba0-4e80-aff1-5690fd2120f4 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:30.738363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f287d2c-9ba0-4e80-aff1-5690fd2120f4 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:30.772784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b469d-0f6a-44ed-9741-d9e90f624a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:30.774061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b469d-0f6a-44ed-9741-d9e90f624a22 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:30.774343 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b469d-0f6a-44ed-9741-d9e90f624a22 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:30.774619 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b469d-0f6a-44ed-9741-d9e90f624a22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:30.775784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b469d-0f6a-44ed-9741-d9e90f624a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:30.777257 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b469d-0f6a-44ed-9741-d9e90f624a22 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:30.779031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 161/321] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:30.784400 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bde91e-7152-49aa-b40c-9e18271d70d2 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:30.800161 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:30.883444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bde91e-7152-49aa-b40c-9e18271d70d2 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:30.919759 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9e701-cbe7-4558-8268-145134615144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:30.920429 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9e701-cbe7-4558-8268-145134615144 None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:30.920714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9e701-cbe7-4558-8268-145134615144 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:30.920991 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9e701-cbe7-4558-8268-145134615144 None admin] PATH_INFO: `/v3/groups` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:30.921716 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9e701-cbe7-4558-8268-145134615144 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:30.923166 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9e701-cbe7-4558-8268-145134615144 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:31.052292 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 161/322] 10.222.0.13 () {60 vars in 1134 bytes} [Thu Jun 23 19:38:30 2022] POST /identity/v3/groups => generated 226 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:38:31.072233 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7992e39-cc80-4c83-ba14-76d71b1d2843 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:31.072580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7992e39-cc80-4c83-ba14-76d71b1d2843 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:31.072871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7992e39-cc80-4c83-ba14-76d71b1d2843 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:31.074680 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 162/323] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:38:31.080529 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630ce7c-f340-482e-8444-2643581d9ada None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:31.080821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630ce7c-f340-482e-8444-2643581d9ada None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:31.081107 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630ce7c-f340-482e-8444-2643581d9ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:31.098915 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-9630ce7c-f340-482e-8444-2643581d9ada None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:31.100156 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-9630ce7c-f340-482e-8444-2643581d9ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:31.173928 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 162/324] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:31.199339 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7992e39-cc80-4c83-ba14-76d71b1d2843 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:31.251979 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:31.310946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7992e39-cc80-4c83-ba14-76d71b1d2843 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:31.350850 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169c26e-feda-4019-a78a-e7f91e2bdf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:31.352687 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169c26e-feda-4019-a78a-e7f91e2bdf73 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:31.352796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169c26e-feda-4019-a78a-e7f91e2bdf73 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:31.353087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169c26e-feda-4019-a78a-e7f91e2bdf73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:31.364528 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169c26e-feda-4019-a78a-e7f91e2bdf73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:31.372903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-7169c26e-feda-4019-a78a-e7f91e2bdf73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:31.372903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:31.372903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:31.372903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:31.372903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:31.372903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:31.372903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:31.372903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:31.372903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:31.372903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:31.372903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:31.372903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:31.372903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:31.372903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:31.372903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:31.372903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:31.373868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:31.373868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:31.373868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:31.373868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:31.373868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:31.373868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:31.373868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:31.373868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:31.373868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:31.373868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:31.373868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:31.373868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:31.373868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:31.373868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:31.373868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:31.373868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:31.374735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:31.374735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:31.374735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:31.374735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:31.374735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:31.374735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:31.374735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:31.374735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:31.374735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:31.374735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:31.374735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:31.374735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:31.374735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 163/325] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:31.381376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630ce7c-f340-482e-8444-2643581d9ada None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:31.386917 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:31.495308 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630ce7c-f340-482e-8444-2643581d9ada None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:31.539266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ff6d7-1756-4420-b1fd-7fce992dee5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:31.540071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ff6d7-1756-4420-b1fd-7fce992dee5b None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:31.540426 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ff6d7-1756-4420-b1fd-7fce992dee5b None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:31.540773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ff6d7-1756-4420-b1fd-7fce992dee5b None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:31.543655 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ff6d7-1756-4420-b1fd-7fce992dee5b None admin] RBAC: Adding query filter params (name=member) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:31.543655 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ff6d7-1756-4420-b1fd-7fce992dee5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:31.543655 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ff6d7-1756-4420-b1fd-7fce992dee5b None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:31.552718 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 163/326] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:31.558013 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169c26e-feda-4019-a78a-e7f91e2bdf73 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:31.568557 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60f0f1-c011-4c5f-8d8c-4d869287b195 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:31.568557 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60f0f1-c011-4c5f-8d8c-4d869287b195 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:31.568557 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60f0f1-c011-4c5f-8d8c-4d869287b195 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:31.570555 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 164/327] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:31.576213 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d452a9-b3ad-4c9e-8577-84a4a3e43d08 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:31.576213 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d452a9-b3ad-4c9e-8577-84a4a3e43d08 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:31.576452 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d452a9-b3ad-4c9e-8577-84a4a3e43d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:31.603841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-04d452a9-b3ad-4c9e-8577-84a4a3e43d08 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:31.605393 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-04d452a9-b3ad-4c9e-8577-84a4a3e43d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:31.684072 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:31.692021 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 165/328] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:38:31.701695 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169c26e-feda-4019-a78a-e7f91e2bdf73 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:31.704147 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:31.719776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d452a9-b3ad-4c9e-8577-84a4a3e43d08 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:31.751661 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6a0aa-1569-48fb-98fd-5da33232e4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:31.753456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6a0aa-1569-48fb-98fd-5da33232e4b0 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:31.753456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6a0aa-1569-48fb-98fd-5da33232e4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:31.753456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6a0aa-1569-48fb-98fd-5da33232e4b0 None admin] PATH_INFO: `/v3/users/bd71bcb0cc1b40b2adcba2ffce886eea` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:31.755189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6a0aa-1569-48fb-98fd-5da33232e4b0 None admin] RBAC: Authorizing `identity:get_user(user_id=bd71bcb0cc1b40b2adcba2ffce886eea)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:31.756713 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6a0aa-1569-48fb-98fd-5da33232e4b0 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:31.758978 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 164/329] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:31 2022] GET /identity/v3/users/bd71bcb0cc1b40b2adcba2ffce886eea => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:31.764562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6a0aa-1569-48fb-98fd-5da33232e4b0 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:31.847659 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d452a9-b3ad-4c9e-8577-84a4a3e43d08 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:31.902784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdc57c-252c-49ca-8cda-6138724d2d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:31.904117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdc57c-252c-49ca-8cda-6138724d2d24 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:31.904587 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdc57c-252c-49ca-8cda-6138724d2d24 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:31.905368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdc57c-252c-49ca-8cda-6138724d2d24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:31.914095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6a0aa-1569-48fb-98fd-5da33232e4b0 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:31.924598 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becdc57c-252c-49ca-8cda-6138724d2d24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:31.934770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-becdc57c-252c-49ca-8cda-6138724d2d24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 19:38:31.934770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:31.934770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:31.934770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:31.934770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:31.934770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:31.934770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:31.934770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:31.934770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:31.934770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:31.934770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:31.934770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:31.934770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:31.934770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:31.934770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:31.934770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:31.935689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:31.935689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:31.935689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:31.935689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:31.935689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:31.935689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:31.935689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:31.935689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:31.935689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:31.935689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:31.935689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:31.935689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:31.935689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:31.935689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:31.935689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:31.935689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:31.936484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:31.936484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:31.936484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:31.936484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:31.936484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:31.936484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:31.936484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:31.936484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:31.936484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:31.936484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:31.936484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 19:38:31.936484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:31.936484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 166/330] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:31.942571 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdc57c-252c-49ca-8cda-6138724d2d24 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:31.959394 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b18fa1-6a8c-43e4-8b08-467b54f3d094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:31.960701 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b18fa1-6a8c-43e4-8b08-467b54f3d094 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:31.960984 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b18fa1-6a8c-43e4-8b08-467b54f3d094 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:31.961443 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b18fa1-6a8c-43e4-8b08-467b54f3d094 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:31.962294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b18fa1-6a8c-43e4-8b08-467b54f3d094 None admin] RBAC: Adding query filter params (role.id=61895d866a7c44de8924486b8e5ec6e8, user.id=bd71bcb0cc1b40b2adcba2ffce886eea, scope.system=all) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:31.962621 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b18fa1-6a8c-43e4-8b08-467b54f3d094 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:31.964082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b18fa1-6a8c-43e4-8b08-467b54f3d094 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:31.980818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 165/331] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Jun 23 19:38:31 2022] GET /identity/v3/role_assignments?user.id=bd71bcb0cc1b40b2adcba2ffce886eea&scope.system=all&role.id=61895d866a7c44de8924486b8e5ec6e8 => generated 510 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:32.020580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:32.080121 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdc57c-252c-49ca-8cda-6138724d2d24 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:32.124224 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b28ff-03ac-433d-aae9-0f91385a05e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:32.124834 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b28ff-03ac-433d-aae9-0f91385a05e0 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:32.125122 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b28ff-03ac-433d-aae9-0f91385a05e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:32.125441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b28ff-03ac-433d-aae9-0f91385a05e0 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:32.126217 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b28ff-03ac-433d-aae9-0f91385a05e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:32.126529 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b28ff-03ac-433d-aae9-0f91385a05e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:32.127938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b28ff-03ac-433d-aae9-0f91385a05e0 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:32.138803 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 167/332] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:32.144136 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b18fa1-6a8c-43e4-8b08-467b54f3d094 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:32.181413 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:32.261604 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b18fa1-6a8c-43e4-8b08-467b54f3d094 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:32.300652 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e310b8-9044-4738-8b6a-eaaed2c7ad65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:32.301566 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e310b8-9044-4738-8b6a-eaaed2c7ad65 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:32.301860 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e310b8-9044-4738-8b6a-eaaed2c7ad65 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:32.302142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e310b8-9044-4738-8b6a-eaaed2c7ad65 None admin] PATH_INFO: `/v3/users/5221a88d0dce4c0db8948bc9be77cde7` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:32.303365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e310b8-9044-4738-8b6a-eaaed2c7ad65 None admin] RBAC: Authorizing `identity:get_user(user_id=5221a88d0dce4c0db8948bc9be77cde7)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:32.304943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e310b8-9044-4738-8b6a-eaaed2c7ad65 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:32.306934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 166/333] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:32 2022] GET /identity/v3/users/5221a88d0dce4c0db8948bc9be77cde7 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:32.312288 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b28ff-03ac-433d-aae9-0f91385a05e0 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:32.424511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b28ff-03ac-433d-aae9-0f91385a05e0 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:32.443324 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:32.469061 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec8921-2739-4c26-85ec-979e5d016b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:32.470035 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec8921-2739-4c26-85ec-979e5d016b46 None admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:32.470326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec8921-2739-4c26-85ec-979e5d016b46 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:32.470607 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec8921-2739-4c26-85ec-979e5d016b46 None admin] PATH_INFO: `/v3/system/users/5221a88d0dce4c0db8948bc9be77cde7/roles/d81add03275a412284f307885c341f6f` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:32.472228 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec8921-2739-4c26-85ec-979e5d016b46 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5221a88d0dce4c0db8948bc9be77cde7, role_id=d81add03275a412284f307885c341f6f)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:32.473716 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec8921-2739-4c26-85ec-979e5d016b46 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:32.544243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 168/334] 10.222.0.13 () {58 vars in 1334 bytes} [Thu Jun 23 19:38:32 2022] PUT /identity/v3/system/users/5221a88d0dce4c0db8948bc9be77cde7/roles/d81add03275a412284f307885c341f6f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:38:33.553307 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b7d45-1212-460b-9da7-0d4a869fcf75 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:33.553815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b7d45-1212-460b-9da7-0d4a869fcf75 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:33.553889 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b7d45-1212-460b-9da7-0d4a869fcf75 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:33.555464 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 167/335] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:33.560873 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02b03e-5016-495d-9385-cca3e9a8f7f9 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:33.561758 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02b03e-5016-495d-9385-cca3e9a8f7f9 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:33.562232 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02b03e-5016-495d-9385-cca3e9a8f7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:33.587077 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-6b02b03e-5016-495d-9385-cca3e9a8f7f9 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:33.588595 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-6b02b03e-5016-495d-9385-cca3e9a8f7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:33.667883 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 169/336] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:38:33.715145 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b7d45-1212-460b-9da7-0d4a869fcf75 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:33.845635 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:33.848638 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b7d45-1212-460b-9da7-0d4a869fcf75 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:33.936632 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4809ed1-f875-4dca-9f3e-515b85a3680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:33.937472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4809ed1-f875-4dca-9f3e-515b85a3680b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:33.937762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4809ed1-f875-4dca-9f3e-515b85a3680b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:33.938045 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4809ed1-f875-4dca-9f3e-515b85a3680b None admin] PATH_INFO: `/v3/roles/member` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:33.954557 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4809ed1-f875-4dca-9f3e-515b85a3680b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:33.962657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-f4809ed1-f875-4dca-9f3e-515b85a3680b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:33.962657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:33.962657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:33.962657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:33.962657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:33.962657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:33.962657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:33.962657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:33.962657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:33.962657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:33.962657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:33.962657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:33.962657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:33.962657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:33.962657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:33.962657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:33.963547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:33.963547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:33.963547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:33.963547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:33.963547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:33.963547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:33.963547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:33.963547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:33.963547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:33.963547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:33.963547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:33.963547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:33.963547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:33.963547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:33.963547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:33.963547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:33.964359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:33.964359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:33.964359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:33.964359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:33.964359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:33.964359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:33.964359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:33.964359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:33.964359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:33.964359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:33.964359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:33.964359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:33.964359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 168/337] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:33.971055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02b03e-5016-495d-9385-cca3e9a8f7f9 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:34.119175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02b03e-5016-495d-9385-cca3e9a8f7f9 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:34.141091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:34.163640 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee8648-46e2-4da0-aa19-1633736ea0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:34.164506 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee8648-46e2-4da0-aa19-1633736ea0b7 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:34.164781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee8648-46e2-4da0-aa19-1633736ea0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:34.165058 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee8648-46e2-4da0-aa19-1633736ea0b7 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:34.165888 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee8648-46e2-4da0-aa19-1633736ea0b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:34.166194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee8648-46e2-4da0-aa19-1633736ea0b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:34.167590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee8648-46e2-4da0-aa19-1633736ea0b7 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:34.181585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 170/338] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:34.187237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4809ed1-f875-4dca-9f3e-515b85a3680b None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:34.317264 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4809ed1-f875-4dca-9f3e-515b85a3680b None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:34.357785 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707679a-ac32-4000-8361-b5cf0fbd8c59 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:34.358129 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707679a-ac32-4000-8361-b5cf0fbd8c59 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:34.358345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707679a-ac32-4000-8361-b5cf0fbd8c59 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:34.365339 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 171/339] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:34.367117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1611190-38d1-4383-bc28-ccc63158e027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:34.368027 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1611190-38d1-4383-bc28-ccc63158e027 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:34.368533 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1611190-38d1-4383-bc28-ccc63158e027 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:34.369012 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1611190-38d1-4383-bc28-ccc63158e027 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:34.370453 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723f269-7a5c-4d40-a8dd-e2869427d672 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:34.370694 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723f269-7a5c-4d40-a8dd-e2869427d672 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:34.370977 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723f269-7a5c-4d40-a8dd-e2869427d672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:34.396966 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-e723f269-7a5c-4d40-a8dd-e2869427d672 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:34.405672 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e723f269-7a5c-4d40-a8dd-e2869427d672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:34.426454 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:34.468841 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1611190-38d1-4383-bc28-ccc63158e027 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:34.473089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1611190-38d1-4383-bc28-ccc63158e027 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:34.555691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 172/340] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:34.590515 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 169/341] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:34.595871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723f269-7a5c-4d40-a8dd-e2869427d672 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:34.598221 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1611190-38d1-4383-bc28-ccc63158e027 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:34.665891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:34.713049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1611190-38d1-4383-bc28-ccc63158e027 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:34.751931 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd0854-5af7-4d15-9ebb-2b44f8aeb356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:34.752796 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723f269-7a5c-4d40-a8dd-e2869427d672 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:34.753336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd0854-5af7-4d15-9ebb-2b44f8aeb356 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:34.753866 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd0854-5af7-4d15-9ebb-2b44f8aeb356 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:34.754462 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd0854-5af7-4d15-9ebb-2b44f8aeb356 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:34.756397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:34.771618 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd0854-5af7-4d15-9ebb-2b44f8aeb356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:34.780626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-10bd0854-5af7-4d15-9ebb-2b44f8aeb356 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:34.780626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:34.780626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:34.780626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:34.780626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:34.780626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:34.780626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:34.780626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:34.780626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:34.780626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:34.780626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:34.780626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:34.780626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:34.780626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:34.780626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:34.780626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:34.781593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:34.781593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:34.781593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:34.781593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:34.781593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:34.781593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:34.781593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:34.781593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:34.781593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:34.781593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:34.781593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:34.781593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:34.781593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:34.781593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:34.781593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:34.781593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:34.782388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:34.782388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:34.782388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:34.782388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:34.782388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:34.782388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:34.782388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:34.782388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:34.782388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:34.782388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:34.782388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:34.782388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:34.785137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 170/342] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:38:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:38:34.790583 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd0854-5af7-4d15-9ebb-2b44f8aeb356 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:34.837947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c8f9c-8906-4f93-8bb2-44f566976b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:34.838843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c8f9c-8906-4f93-8bb2-44f566976b41 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:34.839135 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c8f9c-8906-4f93-8bb2-44f566976b41 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:34.839421 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c8f9c-8906-4f93-8bb2-44f566976b41 None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:34.840909 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c8f9c-8906-4f93-8bb2-44f566976b41 None admin] RBAC: Authorizing `identity:get_project(project_id=deeac7725be842659d93e27cd19f954b)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:34.842313 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c8f9c-8906-4f93-8bb2-44f566976b41 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:34.844733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 173/343] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:34 2022] GET /identity/v3/projects/deeac7725be842659d93e27cd19f954b => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:34.849774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c8f9c-8906-4f93-8bb2-44f566976b41 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:34.936291 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd0854-5af7-4d15-9ebb-2b44f8aeb356 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:34.982875 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:35.023439 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c5f47-f001-49c6-8309-663cf2c585fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:35.024339 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c5f47-f001-49c6-8309-663cf2c585fe None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:35.024628 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c5f47-f001-49c6-8309-663cf2c585fe None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:35.024906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c5f47-f001-49c6-8309-663cf2c585fe None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:35.029798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c5f47-f001-49c6-8309-663cf2c585fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:35.030128 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c5f47-f001-49c6-8309-663cf2c585fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:35.031573 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c5f47-f001-49c6-8309-663cf2c585fe None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:35.045829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 171/344] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:38:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:35.053429 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c5f47-f001-49c6-8309-663cf2c585fe None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:35.083021 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c8f9c-8906-4f93-8bb2-44f566976b41 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:35.155622 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be85ee1-6fa9-4ee4-a228-05284dd289ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:35.156486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be85ee1-6fa9-4ee4-a228-05284dd289ca None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:35.156769 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be85ee1-6fa9-4ee4-a228-05284dd289ca None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:35.157043 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be85ee1-6fa9-4ee4-a228-05284dd289ca None admin] PATH_INFO: `/v3/groups/992b227cc746425c8ed0d87484b8ec37` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:35.167788 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be85ee1-6fa9-4ee4-a228-05284dd289ca None admin] RBAC: Authorizing `identity:get_group(group_id=992b227cc746425c8ed0d87484b8ec37)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:35.169268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be85ee1-6fa9-4ee4-a228-05284dd289ca None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:35.172428 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 174/345] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 19:38:34 2022] GET /identity/v3/groups/992b227cc746425c8ed0d87484b8ec37 => generated 226 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:35.180284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be85ee1-6fa9-4ee4-a228-05284dd289ca None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:35.247010 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:35.253817 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c5f47-f001-49c6-8309-663cf2c585fe None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:35.297451 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb9fbd-21a4-4a09-903d-7c556fc6c64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:35.298172 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb9fbd-21a4-4a09-903d-7c556fc6c64c None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:35.298457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb9fbd-21a4-4a09-903d-7c556fc6c64c None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:35.298731 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb9fbd-21a4-4a09-903d-7c556fc6c64c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:35.351317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be85ee1-6fa9-4ee4-a228-05284dd289ca None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:35.356288 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:35.378529 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb9fbd-21a4-4a09-903d-7c556fc6c64c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:35.379994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb9fbd-21a4-4a09-903d-7c556fc6c64c None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:35.406980 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b91007-c56f-4530-843a-8847db275a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:35.407721 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b91007-c56f-4530-843a-8847db275a0a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:35.408017 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b91007-c56f-4530-843a-8847db275a0a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:35.408300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b91007-c56f-4530-843a-8847db275a0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:35.409234 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b91007-c56f-4530-843a-8847db275a0a None admin] RBAC: Adding query filter params (group.id=992b227cc746425c8ed0d87484b8ec37, role.id=61895d866a7c44de8924486b8e5ec6e8, scope.project.id=deeac7725be842659d93e27cd19f954b) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:35.409549 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b91007-c56f-4530-843a-8847db275a0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:35.411025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b91007-c56f-4530-843a-8847db275a0a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:35.417471 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 175/346] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 23 19:38:35 2022] GET /identity/v3/role_assignments?group.id=992b227cc746425c8ed0d87484b8ec37&scope.project.id=deeac7725be842659d93e27cd19f954b&role.id=61895d866a7c44de8924486b8e5ec6e8 => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:35.418844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966352e-996f-48ce-8cbc-f5bfcd349013 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:35.419136 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966352e-996f-48ce-8cbc-f5bfcd349013 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:35.419418 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966352e-996f-48ce-8cbc-f5bfcd349013 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:35.420943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 176/347] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:35.426231 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55e9a3-e67c-4f02-a5c0-3453e1a986a9 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:35.426511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55e9a3-e67c-4f02-a5c0-3453e1a986a9 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:35.426801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55e9a3-e67c-4f02-a5c0-3453e1a986a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:35.457575 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-5b55e9a3-e67c-4f02-a5c0-3453e1a986a9 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:35.458922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-5b55e9a3-e67c-4f02-a5c0-3453e1a986a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:35.582859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 177/348] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:35.584271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f0e5e-8c56-4844-a484-18f99a5111af None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:35.584567 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f0e5e-8c56-4844-a484-18f99a5111af None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:35.584851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f0e5e-8c56-4844-a484-18f99a5111af None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:35.587287 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 178/349] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:35.589043 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 172/350] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:35.593354 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cea239-debf-4680-9349-2a453609c9d7 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:35.593759 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cea239-debf-4680-9349-2a453609c9d7 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:35.593932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cea239-debf-4680-9349-2a453609c9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:35.596394 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb9fbd-21a4-4a09-903d-7c556fc6c64c None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:35.637920 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-d7cea239-debf-4680-9349-2a453609c9d7 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:35.639142 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d7cea239-debf-4680-9349-2a453609c9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:35.678884 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:35.725575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:35.750741 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 179/351] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:35.751410 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb9fbd-21a4-4a09-903d-7c556fc6c64c None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:35.751620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cea239-debf-4680-9349-2a453609c9d7 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:35.791721 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a110e6c-0bfe-42cd-b384-82580da01792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:35.792626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a110e6c-0bfe-42cd-b384-82580da01792 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:35.792949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a110e6c-0bfe-42cd-b384-82580da01792 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:35.793322 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a110e6c-0bfe-42cd-b384-82580da01792 None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:35.794531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a110e6c-0bfe-42cd-b384-82580da01792 None admin] RBAC: Authorizing `identity:get_project(project_id=deeac7725be842659d93e27cd19f954b)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:35.796185 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a110e6c-0bfe-42cd-b384-82580da01792 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:35.798050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 173/352] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:35 2022] GET /identity/v3/projects/deeac7725be842659d93e27cd19f954b => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:35.799524 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a110e6c-0bfe-42cd-b384-82580da01792 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:35.895983 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cea239-debf-4680-9349-2a453609c9d7 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:35.910210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a110e6c-0bfe-42cd-b384-82580da01792 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:35.950603 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16926a-3514-4114-899b-dbfe3c4e4623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:35.951387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16926a-3514-4114-899b-dbfe3c4e4623 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:35.951671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16926a-3514-4114-899b-dbfe3c4e4623 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:35.952051 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16926a-3514-4114-899b-dbfe3c4e4623 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:35.952438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24086610-3ffa-4fbd-bfae-7db6b75ddef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:35.953439 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24086610-3ffa-4fbd-bfae-7db6b75ddef9 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:35.953720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24086610-3ffa-4fbd-bfae-7db6b75ddef9 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:35.954098 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24086610-3ffa-4fbd-bfae-7db6b75ddef9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:35.965443 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16926a-3514-4114-899b-dbfe3c4e4623 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:35.967781 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24086610-3ffa-4fbd-bfae-7db6b75ddef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:35.973591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-aa16926a-3514-4114-899b-dbfe3c4e4623 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:35.973591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:35.973591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:35.973591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:35.973591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:35.973591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:35.973591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:35.973591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:35.973591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:35.973591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:35.973591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:35.973591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:35.973591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:35.973591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:35.973591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:35.973591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:35.974509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:35.974509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:35.974509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:35.974509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:35.974509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:35.974509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:35.974509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:35.974509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:35.974509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:35.974509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:35.974509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:35.974509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:35.974509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:35.974509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:35.974509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:35.974509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:35.975317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:35.975317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:35.975317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:35.975317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:35.975317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:35.975317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:35.975317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:35.975317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:35.975317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:35.975317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:35.975317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:35.975317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:35.975317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 180/353] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:35.976544 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16926a-3514-4114-899b-dbfe3c4e4623 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:35.981250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-24086610-3ffa-4fbd-bfae-7db6b75ddef9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:35.981250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:35.981250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:35.981250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:35.981250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:35.981250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:35.981250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:35.981250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:35.981250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:35.981250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:35.981250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:35.981250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:35.981250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:35.981250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:35.981250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:35.981250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:35.983372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:35.983372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:35.983372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:35.983372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:35.983372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:35.983372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:35.983372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:35.983372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:35.983372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:35.983372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:35.983372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:35.983372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:35.983372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:35.983372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:35.983372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:35.983372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:35.985620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:35.985620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:35.985620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:35.985620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:35.985620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:35.985620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:35.985620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:35.985620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:35.985620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:35.985620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:35.985620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:35.985620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:35.985620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 174/354] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:38:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:35.985620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d10b3f-6e5c-4a78-a469-9c3734793144 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:35.987442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d10b3f-6e5c-4a78-a469-9c3734793144 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:35.987442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d10b3f-6e5c-4a78-a469-9c3734793144 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:35.987442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 175/355] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:35.987442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01c265-3ce9-4ac1-97ab-6c9725e84904 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:35.987442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01c265-3ce9-4ac1-97ab-6c9725e84904 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:35.987442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01c265-3ce9-4ac1-97ab-6c9725e84904 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:35.987442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 176/356] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:35.993459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e7ea3-773f-4a23-bb2c-4dfe45ed1f40 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:35.993459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e7ea3-773f-4a23-bb2c-4dfe45ed1f40 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:35.993459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e7ea3-773f-4a23-bb2c-4dfe45ed1f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:36.000441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:36.011207 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-d34e7ea3-773f-4a23-bb2c-4dfe45ed1f40 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:36.012413 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d34e7ea3-773f-4a23-bb2c-4dfe45ed1f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:36.014914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:36.106738 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 177/357] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:38:36.107951 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e7ea3-773f-4a23-bb2c-4dfe45ed1f40 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:36.116897 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16926a-3514-4114-899b-dbfe3c4e4623 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:36.168737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba067e-c165-4b91-83c1-79f139bcf3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:36.170255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba067e-c165-4b91-83c1-79f139bcf3ea None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:36.170963 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba067e-c165-4b91-83c1-79f139bcf3ea None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:36.171254 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba067e-c165-4b91-83c1-79f139bcf3ea None admin] PATH_INFO: `/v3/groups/992b227cc746425c8ed0d87484b8ec37` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:36.172739 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba067e-c165-4b91-83c1-79f139bcf3ea None admin] RBAC: Authorizing `identity:get_group(group_id=992b227cc746425c8ed0d87484b8ec37)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:36.176108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba067e-c165-4b91-83c1-79f139bcf3ea None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:36.176587 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 181/358] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 19:38:35 2022] GET /identity/v3/groups/992b227cc746425c8ed0d87484b8ec37 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:36.180735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa493a-93e2-4ce1-a711-7a433ceea0a2 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:36.180735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa493a-93e2-4ce1-a711-7a433ceea0a2 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:36.181527 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa493a-93e2-4ce1-a711-7a433ceea0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:36.201562 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-95fa493a-93e2-4ce1-a711-7a433ceea0a2 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:36.202755 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-95fa493a-93e2-4ce1-a711-7a433ceea0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:36.239731 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e7ea3-773f-4a23-bb2c-4dfe45ed1f40 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:36.285513 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 182/359] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:36.286705 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa493a-93e2-4ce1-a711-7a433ceea0a2 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:36.288691 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486fe75-2c6c-4c58-80ab-6ddc48d54ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:36.289651 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486fe75-2c6c-4c58-80ab-6ddc48d54ad7 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:36.290142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486fe75-2c6c-4c58-80ab-6ddc48d54ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:36.290616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486fe75-2c6c-4c58-80ab-6ddc48d54ad7 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:36.291554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486fe75-2c6c-4c58-80ab-6ddc48d54ad7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:36.292039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486fe75-2c6c-4c58-80ab-6ddc48d54ad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:36.293644 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486fe75-2c6c-4c58-80ab-6ddc48d54ad7 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:36.302425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:36.307344 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 178/360] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:38:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:36.308374 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486fe75-2c6c-4c58-80ab-6ddc48d54ad7 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:36.311035 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:36.409025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa493a-93e2-4ce1-a711-7a433ceea0a2 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:36.448170 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486fe75-2c6c-4c58-80ab-6ddc48d54ad7 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:36.452240 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf8cb1-6b1d-417d-bf55-7d637b8c5391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:36.452907 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf8cb1-6b1d-417d-bf55-7d637b8c5391 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:36.453218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf8cb1-6b1d-417d-bf55-7d637b8c5391 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:36.453507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf8cb1-6b1d-417d-bf55-7d637b8c5391 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:36.454281 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf8cb1-6b1d-417d-bf55-7d637b8c5391 None admin] RBAC: Adding query filter params (name=member) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:36.454579 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf8cb1-6b1d-417d-bf55-7d637b8c5391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:36.455973 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf8cb1-6b1d-417d-bf55-7d637b8c5391 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:36.466347 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 183/361] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:36.467179 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf8cb1-6b1d-417d-bf55-7d637b8c5391 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:36.493077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8eca9-637b-445e-9301-be614645f88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:36.494270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8eca9-637b-445e-9301-be614645f88a None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:36.494564 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8eca9-637b-445e-9301-be614645f88a None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:36.494850 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8eca9-637b-445e-9301-be614645f88a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:36.505707 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8eca9-637b-445e-9301-be614645f88a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:36.513455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-75d8eca9-637b-445e-9301-be614645f88a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:38:36.513455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:36.513455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:36.513455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:36.513455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:36.513455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:36.513455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:36.513455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:36.513455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:36.513455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:36.513455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:36.513455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:36.513455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:36.513455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:36.513455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:36.513455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:36.514363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:36.514363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:36.514363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:36.514363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:36.514363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:36.514363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:36.514363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:36.514363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:36.514363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:36.514363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:36.514363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:36.514363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:36.514363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:36.514363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:36.514363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:36.514363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:36.515165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:36.515165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:36.515165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:36.515165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:36.515165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:36.515165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:36.515165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:36.515165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:36.515165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:36.515165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:36.515165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:38:36.515165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:36.515165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 179/362] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:38:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:36.515829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8eca9-637b-445e-9301-be614645f88a None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:36.579658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:36.589219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:36.606352 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf8cb1-6b1d-417d-bf55-7d637b8c5391 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:36.643393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8eca9-637b-445e-9301-be614645f88a None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:36.661698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e08c6-c554-402d-9f70-43ec21c46aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:36.662906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e08c6-c554-402d-9f70-43ec21c46aa4 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:36.663194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e08c6-c554-402d-9f70-43ec21c46aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:36.664680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e08c6-c554-402d-9f70-43ec21c46aa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:36.666289 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e08c6-c554-402d-9f70-43ec21c46aa4 None admin] RBAC: Adding query filter params (group.id=992b227cc746425c8ed0d87484b8ec37, role.id=f0bb7fa65c8545699b60f857f930b078, scope.project.id=deeac7725be842659d93e27cd19f954b) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:36.666607 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e08c6-c554-402d-9f70-43ec21c46aa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:36.668055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e08c6-c554-402d-9f70-43ec21c46aa4 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:36.676177 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 184/363] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 23 19:38:36 2022] GET /identity/v3/role_assignments?group.id=992b227cc746425c8ed0d87484b8ec37&scope.project.id=deeac7725be842659d93e27cd19f954b&role.id=f0bb7fa65c8545699b60f857f930b078 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:36.677067 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e08c6-c554-402d-9f70-43ec21c46aa4 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:36.696824 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17a346-708a-4d05-abda-0c0593ef095b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:36.697566 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17a346-708a-4d05-abda-0c0593ef095b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:36.697850 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17a346-708a-4d05-abda-0c0593ef095b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:36.698127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17a346-708a-4d05-abda-0c0593ef095b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:36.794312 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17a346-708a-4d05-abda-0c0593ef095b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:36.795823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17a346-708a-4d05-abda-0c0593ef095b None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:36.831646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e08c6-c554-402d-9f70-43ec21c46aa4 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:36.878874 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:36.884713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70776741-e36d-437f-916c-bf0dc8cce8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:36.886019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70776741-e36d-437f-916c-bf0dc8cce8c9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:36.886556 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70776741-e36d-437f-916c-bf0dc8cce8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:36.887047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70776741-e36d-437f-916c-bf0dc8cce8c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:36.904331 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70776741-e36d-437f-916c-bf0dc8cce8c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:36.913752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-70776741-e36d-437f-916c-bf0dc8cce8c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 19:38:36.913752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:36.913752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:36.913752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:36.913752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:36.913752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:36.913752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:36.913752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:36.913752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:36.913752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:36.913752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:36.913752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:36.913752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:36.913752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:36.913752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:36.913752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:36.915470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:36.915470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:36.915470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:36.915470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:36.915470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:36.915470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:36.915470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:36.915470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:36.915470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:36.915470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:36.915470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:36.915470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:36.915470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:36.915470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:36.915470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:36.915470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:36.916948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:36.916948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:36.916948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:36.916948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:36.916948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:36.916948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:36.916948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:36.916948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:36.916948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:36.916948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:36.916948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 19:38:36.916948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:36.916948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 185/364] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:36.916948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70776741-e36d-437f-916c-bf0dc8cce8c9 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:36.922065 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:36.951590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 180/365] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:36.952917 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17a346-708a-4d05-abda-0c0593ef095b None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:37.030531 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70776741-e36d-437f-916c-bf0dc8cce8c9 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:37.064881 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20591a77-6698-430e-b4ce-d0f070a900a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:37.065489 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20591a77-6698-430e-b4ce-d0f070a900a5 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:37.065778 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20591a77-6698-430e-b4ce-d0f070a900a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:37.066038 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20591a77-6698-430e-b4ce-d0f070a900a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:37.072638 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17a346-708a-4d05-abda-0c0593ef095b None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:37.121068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722650c-d100-430f-8078-f71e60cba223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:37.122162 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722650c-d100-430f-8078-f71e60cba223 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:37.122727 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722650c-d100-430f-8078-f71e60cba223 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:37.123211 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722650c-d100-430f-8078-f71e60cba223 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:37.124157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722650c-d100-430f-8078-f71e60cba223 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:37.124659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722650c-d100-430f-8078-f71e60cba223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:37.126492 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722650c-d100-430f-8078-f71e60cba223 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:37.138243 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 181/366] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:37.139462 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722650c-d100-430f-8078-f71e60cba223 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:37.139683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20591a77-6698-430e-b4ce-d0f070a900a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:37.143159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20591a77-6698-430e-b4ce-d0f070a900a5 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:37.148775 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:37.171817 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:37.254183 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 186/367] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:37.255048 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20591a77-6698-430e-b4ce-d0f070a900a5 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:37.262811 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722650c-d100-430f-8078-f71e60cba223 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:37.307826 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9983b4-11d4-469d-aa3d-bafc33cbf66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:37.308900 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9983b4-11d4-469d-aa3d-bafc33cbf66d None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:37.309451 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9983b4-11d4-469d-aa3d-bafc33cbf66d None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:37.309923 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9983b4-11d4-469d-aa3d-bafc33cbf66d None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:37.310972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9983b4-11d4-469d-aa3d-bafc33cbf66d None admin] RBAC: Adding query filter params (name=reader) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:37.311476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9983b4-11d4-469d-aa3d-bafc33cbf66d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:37.313049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9983b4-11d4-469d-aa3d-bafc33cbf66d None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:37.324759 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 182/368] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:37.326070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9983b4-11d4-469d-aa3d-bafc33cbf66d None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:37.362474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20591a77-6698-430e-b4ce-d0f070a900a5 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:37.364828 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:37.415343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023b31f-0408-4087-a615-6e6ad39bcc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:37.415709 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023b31f-0408-4087-a615-6e6ad39bcc72 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:37.415897 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023b31f-0408-4087-a615-6e6ad39bcc72 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:37.416175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023b31f-0408-4087-a615-6e6ad39bcc72 None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:37.417414 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023b31f-0408-4087-a615-6e6ad39bcc72 None admin] RBAC: Authorizing `identity:get_project(project_id=3ffde5ab0f994cd5b8e67d5092a69564)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:37.418905 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023b31f-0408-4087-a615-6e6ad39bcc72 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:37.420594 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 187/369] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:37 2022] GET /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:37.421385 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023b31f-0408-4087-a615-6e6ad39bcc72 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:37.432320 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:37.451200 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9983b4-11d4-469d-aa3d-bafc33cbf66d None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:37.490331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899b4c3-2a54-4dac-a503-bee6cbd01f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:37.491338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899b4c3-2a54-4dac-a503-bee6cbd01f59 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:37.492501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899b4c3-2a54-4dac-a503-bee6cbd01f59 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:37.492977 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899b4c3-2a54-4dac-a503-bee6cbd01f59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:37.533875 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023b31f-0408-4087-a615-6e6ad39bcc72 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:37.569231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899b4c3-2a54-4dac-a503-bee6cbd01f59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:37.572367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899b4c3-2a54-4dac-a503-bee6cbd01f59 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:37.572673 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a641f-10af-4c52-83b4-dfa070789d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:37.573581 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a641f-10af-4c52-83b4-dfa070789d24 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:37.573998 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a641f-10af-4c52-83b4-dfa070789d24 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:37.574286 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a641f-10af-4c52-83b4-dfa070789d24 None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:37.575612 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a641f-10af-4c52-83b4-dfa070789d24 None admin] RBAC: Authorizing `identity:get_project(project_id=3ffde5ab0f994cd5b8e67d5092a69564)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:37.577531 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a641f-10af-4c52-83b4-dfa070789d24 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:37.578684 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 188/370] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:37 2022] GET /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:37.579441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a641f-10af-4c52-83b4-dfa070789d24 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:37.625525 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:37.669585 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:37.691054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 183/371] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:37.691867 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a641f-10af-4c52-83b4-dfa070789d24 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:37.693173 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899b4c3-2a54-4dac-a503-bee6cbd01f59 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:37.745001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38c239-bd59-4bfd-8b4e-d2937e3a2724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:37.746038 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38c239-bd59-4bfd-8b4e-d2937e3a2724 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:37.746218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38c239-bd59-4bfd-8b4e-d2937e3a2724 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:37.746499 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38c239-bd59-4bfd-8b4e-d2937e3a2724 None admin] PATH_INFO: `/v3/users/5221a88d0dce4c0db8948bc9be77cde7` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:37.747767 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38c239-bd59-4bfd-8b4e-d2937e3a2724 None admin] RBAC: Authorizing `identity:get_user(user_id=5221a88d0dce4c0db8948bc9be77cde7)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:37.749256 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38c239-bd59-4bfd-8b4e-d2937e3a2724 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:37.751205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 189/372] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:38:37 2022] GET /identity/v3/users/5221a88d0dce4c0db8948bc9be77cde7 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:37.752034 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38c239-bd59-4bfd-8b4e-d2937e3a2724 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:37.812064 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899b4c3-2a54-4dac-a503-bee6cbd01f59 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:37.853092 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69a0e7-dab1-4a38-906c-bcc3ac3870cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:37.854682 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69a0e7-dab1-4a38-906c-bcc3ac3870cc None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:37.855415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69a0e7-dab1-4a38-906c-bcc3ac3870cc None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:37.856267 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69a0e7-dab1-4a38-906c-bcc3ac3870cc None admin] PATH_INFO: `/v3/groups/992b227cc746425c8ed0d87484b8ec37` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:37.857948 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69a0e7-dab1-4a38-906c-bcc3ac3870cc None admin] RBAC: Authorizing `identity:get_group(group_id=992b227cc746425c8ed0d87484b8ec37)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:37.858627 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38c239-bd59-4bfd-8b4e-d2937e3a2724 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:37.859835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69a0e7-dab1-4a38-906c-bcc3ac3870cc None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:37.863248 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 184/373] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 19:38:37 2022] GET /identity/v3/groups/992b227cc746425c8ed0d87484b8ec37 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:37.864254 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69a0e7-dab1-4a38-906c-bcc3ac3870cc None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:37.879267 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:37.913181 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64847905-4a2a-4546-a1b5-a328660ffd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:37.914331 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64847905-4a2a-4546-a1b5-a328660ffd42 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:37.914688 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64847905-4a2a-4546-a1b5-a328660ffd42 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:37.915050 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64847905-4a2a-4546-a1b5-a328660ffd42 None admin] PATH_INFO: `/v3/groups/992b227cc746425c8ed0d87484b8ec37` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:37.916349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64847905-4a2a-4546-a1b5-a328660ffd42 None admin] RBAC: Authorizing `identity:get_group(group_id=992b227cc746425c8ed0d87484b8ec37)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:37.917995 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64847905-4a2a-4546-a1b5-a328660ffd42 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:37.919976 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 190/374] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 19:38:37 2022] GET /identity/v3/groups/992b227cc746425c8ed0d87484b8ec37 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:37.920623 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64847905-4a2a-4546-a1b5-a328660ffd42 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:37.943221 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:38.012955 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69a0e7-dab1-4a38-906c-bcc3ac3870cc None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:38.042751 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64847905-4a2a-4546-a1b5-a328660ffd42 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:38.062109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a50ac9-4c80-4002-ac61-46c10b066a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:38.063308 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a50ac9-4c80-4002-ac61-46c10b066a53 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:38.064747 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a50ac9-4c80-4002-ac61-46c10b066a53 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:38.065029 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a50ac9-4c80-4002-ac61-46c10b066a53 None admin] PATH_INFO: `/v3/projects/50703062c6ac410a8cc7e1c87c4ecbac` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:38.066978 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a50ac9-4c80-4002-ac61-46c10b066a53 None admin] RBAC: Authorizing `identity:get_project(project_id=50703062c6ac410a8cc7e1c87c4ecbac)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:38.068348 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a50ac9-4c80-4002-ac61-46c10b066a53 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:38.072414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 185/375] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:37 2022] GET /identity/v3/projects/50703062c6ac410a8cc7e1c87c4ecbac => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:38.073066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a50ac9-4c80-4002-ac61-46c10b066a53 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:38.090189 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563f93d-01b9-492a-8f32-2ada8738a753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:38.091111 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563f93d-01b9-492a-8f32-2ada8738a753 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:38.091403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563f93d-01b9-492a-8f32-2ada8738a753 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:38.091759 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563f93d-01b9-492a-8f32-2ada8738a753 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:38.093400 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563f93d-01b9-492a-8f32-2ada8738a753 None admin] RBAC: Adding query filter params (role.id=d81add03275a412284f307885c341f6f, user.id=5221a88d0dce4c0db8948bc9be77cde7, scope.system=all) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:38.093733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563f93d-01b9-492a-8f32-2ada8738a753 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:38.095814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563f93d-01b9-492a-8f32-2ada8738a753 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:38.114275 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 191/376] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Jun 23 19:38:37 2022] GET /identity/v3/role_assignments?user.id=5221a88d0dce4c0db8948bc9be77cde7&scope.system=all&role.id=d81add03275a412284f307885c341f6f => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:38.115629 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc3140-1c85-4d38-94c3-9a722f1ef8ba None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:38.115882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc3140-1c85-4d38-94c3-9a722f1ef8ba None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:38.116168 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc3140-1c85-4d38-94c3-9a722f1ef8ba None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:38.120151 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 192/377] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:38.121323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc3140-1c85-4d38-94c3-9a722f1ef8ba None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:38.179539 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:38.277879 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc3140-1c85-4d38-94c3-9a722f1ef8ba None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:38.328832 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475c4cc-a5de-459b-9d9a-6c22c8cebc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:38.330894 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475c4cc-a5de-459b-9d9a-6c22c8cebc83 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:38.331413 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475c4cc-a5de-459b-9d9a-6c22c8cebc83 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:38.331887 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475c4cc-a5de-459b-9d9a-6c22c8cebc83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:38.332941 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475c4cc-a5de-459b-9d9a-6c22c8cebc83 None admin] RBAC: Adding query filter params (group.id=992b227cc746425c8ed0d87484b8ec37, role.id=61895d866a7c44de8924486b8e5ec6e8, scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:38.333787 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475c4cc-a5de-459b-9d9a-6c22c8cebc83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:38.336730 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475c4cc-a5de-459b-9d9a-6c22c8cebc83 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:38.342651 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a50ac9-4c80-4002-ac61-46c10b066a53 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:38.344576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 193/378] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 23 19:38:38 2022] GET /identity/v3/role_assignments?group.id=992b227cc746425c8ed0d87484b8ec37&scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564&role.id=61895d866a7c44de8924486b8e5ec6e8 => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:38.345858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475c4cc-a5de-459b-9d9a-6c22c8cebc83 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:38.410343 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:38.453563 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c6db9-8c24-431f-b4aa-36d701ae3fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:38.454241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c6db9-8c24-431f-b4aa-36d701ae3fe9 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:38.454529 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c6db9-8c24-431f-b4aa-36d701ae3fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:38.454809 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c6db9-8c24-431f-b4aa-36d701ae3fe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:38.455659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c6db9-8c24-431f-b4aa-36d701ae3fe9 None admin] RBAC: Adding query filter params (group.id=992b227cc746425c8ed0d87484b8ec37, role.id=f0bb7fa65c8545699b60f857f930b078, scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:38.455976 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c6db9-8c24-431f-b4aa-36d701ae3fe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:38.468440 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c6db9-8c24-431f-b4aa-36d701ae3fe9 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:38.484660 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 186/379] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 23 19:38:38 2022] GET /identity/v3/role_assignments?group.id=992b227cc746425c8ed0d87484b8ec37&scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564&role.id=f0bb7fa65c8545699b60f857f930b078 => generated 260 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:38.485988 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b5395-3190-4cbe-ac2e-6fe3e18b7e2b None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:38.486287 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b5395-3190-4cbe-ac2e-6fe3e18b7e2b None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:38.486568 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b5395-3190-4cbe-ac2e-6fe3e18b7e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:38.497315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:38.503179 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475c4cc-a5de-459b-9d9a-6c22c8cebc83 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:38.517475 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-849b5395-3190-4cbe-ac2e-6fe3e18b7e2b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:38.519743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-849b5395-3190-4cbe-ac2e-6fe3e18b7e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:38.558759 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5c282-37a4-4fdb-acf3-69ff90e4f468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:38.560024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5c282-37a4-4fdb-acf3-69ff90e4f468 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:38.560508 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5c282-37a4-4fdb-acf3-69ff90e4f468 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:38.560983 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5c282-37a4-4fdb-acf3-69ff90e4f468 None admin] PATH_INFO: `/v3/groups/f6147af4c4954719b96cd2a4812d5056` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:38.568780 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5c282-37a4-4fdb-acf3-69ff90e4f468 None admin] RBAC: Authorizing `identity:get_group(group_id=f6147af4c4954719b96cd2a4812d5056)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:38.572113 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5c282-37a4-4fdb-acf3-69ff90e4f468 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:38.577305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 194/380] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 19:38:38 2022] GET /identity/v3/groups/f6147af4c4954719b96cd2a4812d5056 => generated 229 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:38.580525 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5c282-37a4-4fdb-acf3-69ff90e4f468 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:38.688626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 187/381] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:38.719834 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b5395-3190-4cbe-ac2e-6fe3e18b7e2b None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:38.767311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5c282-37a4-4fdb-acf3-69ff90e4f468 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:38.816530 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44570a6a-b551-4707-9367-3bdd572a8e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:38.817289 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44570a6a-b551-4707-9367-3bdd572a8e12 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:38.817582 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44570a6a-b551-4707-9367-3bdd572a8e12 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:38.818116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44570a6a-b551-4707-9367-3bdd572a8e12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:38.818960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44570a6a-b551-4707-9367-3bdd572a8e12 None admin] RBAC: Adding query filter params (group.id=f6147af4c4954719b96cd2a4812d5056, role.id=76bd0cf7bf094e4fa3db121b96215004, scope.project.id=50703062c6ac410a8cc7e1c87c4ecbac) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:38.819277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44570a6a-b551-4707-9367-3bdd572a8e12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:38.825182 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44570a6a-b551-4707-9367-3bdd572a8e12 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:38.828931 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 195/382] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 23 19:38:38 2022] GET /identity/v3/role_assignments?group.id=f6147af4c4954719b96cd2a4812d5056&scope.project.id=50703062c6ac410a8cc7e1c87c4ecbac&role.id=76bd0cf7bf094e4fa3db121b96215004 => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:38.907738 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b5395-3190-4cbe-ac2e-6fe3e18b7e2b None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:38.934865 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:38.958688 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa19d6-bbc4-4392-bd61-55f58e83176d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:38.959399 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa19d6-bbc4-4392-bd61-55f58e83176d None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:38.959680 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa19d6-bbc4-4392-bd61-55f58e83176d None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:38.959956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa19d6-bbc4-4392-bd61-55f58e83176d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:38.978283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa19d6-bbc4-4392-bd61-55f58e83176d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:38.986622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-d4aa19d6-bbc4-4392-bd61-55f58e83176d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:38.986622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:38.986622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:38.986622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:38.986622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:38.986622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:38.986622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:38.986622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:38.986622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:38.986622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:38.986622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:38.986622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:38.986622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:38.986622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:38.986622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:38.986622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:38.987605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:38.987605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:38.987605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:38.987605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:38.987605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:38.987605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:38.987605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:38.987605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:38.987605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:38.987605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:38.987605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:38.987605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:38.987605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:38.987605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:38.987605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:38.987605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:38.988380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:38.988380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:38.988380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:38.988380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:38.988380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:38.988380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:38.988380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:38.988380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:38.988380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:38.988380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:38.988380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:38.988380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:38.988989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 188/383] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:38.999219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44570a6a-b551-4707-9367-3bdd572a8e12 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:39.039011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:39.133762 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44570a6a-b551-4707-9367-3bdd572a8e12 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:39.184218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af6389-20ef-450c-b759-20c577080d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:39.184901 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af6389-20ef-450c-b759-20c577080d9b None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:39.185417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af6389-20ef-450c-b759-20c577080d9b None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:39.185703 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af6389-20ef-450c-b759-20c577080d9b None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:39.186453 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af6389-20ef-450c-b759-20c577080d9b None admin] RBAC: Adding query filter params (name=member) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:39.186762 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af6389-20ef-450c-b759-20c577080d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:39.188147 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af6389-20ef-450c-b759-20c577080d9b None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:39.201598 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 196/384] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:39.206815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa19d6-bbc4-4392-bd61-55f58e83176d None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:39.337500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9fe45-727a-4f25-b1be-ced7537c3050 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:39.337793 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9fe45-727a-4f25-b1be-ced7537c3050 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:39.337974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa19d6-bbc4-4392-bd61-55f58e83176d None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:39.338092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9fe45-727a-4f25-b1be-ced7537c3050 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:39.339601 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 197/385] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:39.345906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9158785-85d7-4dba-a2d5-1b68b7050afa None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:39.346199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9158785-85d7-4dba-a2d5-1b68b7050afa None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:39.346488 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9158785-85d7-4dba-a2d5-1b68b7050afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:39.365664 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-d9158785-85d7-4dba-a2d5-1b68b7050afa None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:39.366905 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d9158785-85d7-4dba-a2d5-1b68b7050afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:39.388519 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88041cc4-9410-4334-bef9-8695093ecc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:39.389428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041cc4-9410-4334-bef9-8695093ecc8a None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:39.389716 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041cc4-9410-4334-bef9-8695093ecc8a None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:39.390001 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041cc4-9410-4334-bef9-8695093ecc8a None admin] PATH_INFO: `/v3/groups/992b227cc746425c8ed0d87484b8ec37` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:39.393184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88041cc4-9410-4334-bef9-8695093ecc8a None admin] RBAC: Authorizing `identity:get_group(group_id=992b227cc746425c8ed0d87484b8ec37)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:39.394683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88041cc4-9410-4334-bef9-8695093ecc8a None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:39.396352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 189/386] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 19:38:39 2022] GET /identity/v3/groups/992b227cc746425c8ed0d87484b8ec37 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:39.406207 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88041cc4-9410-4334-bef9-8695093ecc8a None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:39.459774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 198/387] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:39.472463 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:39.536953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9158785-85d7-4dba-a2d5-1b68b7050afa None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:39.542383 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88041cc4-9410-4334-bef9-8695093ecc8a None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:39.579253 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc414b-b79f-412a-8707-7e24a958df8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:39.579778 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:39.581470 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc414b-b79f-412a-8707-7e24a958df8d None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:39.581909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc414b-b79f-412a-8707-7e24a958df8d None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:39.582332 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc414b-b79f-412a-8707-7e24a958df8d None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:39.583734 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc414b-b79f-412a-8707-7e24a958df8d None admin] RBAC: Authorizing `identity:get_project(project_id=deeac7725be842659d93e27cd19f954b)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:39.585605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc414b-b79f-412a-8707-7e24a958df8d None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:39.587914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 190/388] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:39 2022] GET /identity/v3/projects/deeac7725be842659d93e27cd19f954b => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:39.593701 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc414b-b79f-412a-8707-7e24a958df8d None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:39.711456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc414b-b79f-412a-8707-7e24a958df8d None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:39.729637 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:39.750339 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8ce68-995c-40d0-8cc2-76aa32014188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:39.751675 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8ce68-995c-40d0-8cc2-76aa32014188 None admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:39.752240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8ce68-995c-40d0-8cc2-76aa32014188 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:39.753097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8ce68-995c-40d0-8cc2-76aa32014188 None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b/groups/992b227cc746425c8ed0d87484b8ec37/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:39.755660 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8ce68-995c-40d0-8cc2-76aa32014188 None admin] RBAC: Authorizing `identity:create_grant(project_id=deeac7725be842659d93e27cd19f954b, group_id=992b227cc746425c8ed0d87484b8ec37, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:39.757992 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8ce68-995c-40d0-8cc2-76aa32014188 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:39.758795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9158785-85d7-4dba-a2d5-1b68b7050afa None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:39.824405 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f01d5-ae95-4153-a6c7-5288830631d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:39.825988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f01d5-ae95-4153-a6c7-5288830631d2 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:39.826439 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f01d5-ae95-4153-a6c7-5288830631d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:39.826876 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f01d5-ae95-4153-a6c7-5288830631d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:39.840327 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f01d5-ae95-4153-a6c7-5288830631d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:39.849222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-f10f01d5-ae95-4153-a6c7-5288830631d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:39.849222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:39.849222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:39.849222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:39.849222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:39.849222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:39.849222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:39.849222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:39.849222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:39.849222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:39.849222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:39.849222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:39.849222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:39.849222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:39.849222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:39.849222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:39.851138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:39.851138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:39.851138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:39.851138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:39.851138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:39.851138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:39.851138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:39.851138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:39.851138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:39.851138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:39.851138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:39.851138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:39.851138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:39.851138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:39.851138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:39.851138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:39.852130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:39.852130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:39.852130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:39.852130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:39.852130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:39.852130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:39.852130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:39.852130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:39.852130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:39.852130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:39.852130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:39.852130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:39.853947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 199/389] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:38:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:39.859552 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f01d5-ae95-4153-a6c7-5288830631d2 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:39.897730 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 191/390] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Jun 23 19:38:39 2022] PUT /identity/v3/projects/deeac7725be842659d93e27cd19f954b/groups/992b227cc746425c8ed0d87484b8ec37/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:38:39.972701 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:39.999582 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f01d5-ae95-4153-a6c7-5288830631d2 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:40.037508 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e0839-c03d-4ef7-b370-e39e938850a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:40.038195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e0839-c03d-4ef7-b370-e39e938850a6 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:40.038521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e0839-c03d-4ef7-b370-e39e938850a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:40.038819 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e0839-c03d-4ef7-b370-e39e938850a6 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:40.039568 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e0839-c03d-4ef7-b370-e39e938850a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:40.039880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e0839-c03d-4ef7-b370-e39e938850a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:40.041318 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e0839-c03d-4ef7-b370-e39e938850a6 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:40.050625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 200/391] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:38:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:40.058150 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8ce68-995c-40d0-8cc2-76aa32014188 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:40.182197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8ce68-995c-40d0-8cc2-76aa32014188 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:40.226941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe156e-f595-4c8c-bb66-992ffebf8a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:40.227895 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe156e-f595-4c8c-bb66-992ffebf8a29 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:40.228189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe156e-f595-4c8c-bb66-992ffebf8a29 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:40.228469 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe156e-f595-4c8c-bb66-992ffebf8a29 None admin] PATH_INFO: `/v3/groups/992b227cc746425c8ed0d87484b8ec37` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:40.229841 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe156e-f595-4c8c-bb66-992ffebf8a29 None admin] RBAC: Authorizing `identity:get_group(group_id=992b227cc746425c8ed0d87484b8ec37)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:40.231356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe156e-f595-4c8c-bb66-992ffebf8a29 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:40.233210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 192/392] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 19:38:40 2022] GET /identity/v3/groups/992b227cc746425c8ed0d87484b8ec37 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:40.239260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e0839-c03d-4ef7-b370-e39e938850a6 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:40.348584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e0839-c03d-4ef7-b370-e39e938850a6 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:40.384152 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21806f10-fb1b-4734-8a86-51a1faed9788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:40.385017 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21806f10-fb1b-4734-8a86-51a1faed9788 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:40.385337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21806f10-fb1b-4734-8a86-51a1faed9788 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:40.385623 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21806f10-fb1b-4734-8a86-51a1faed9788 None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:40.386821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21806f10-fb1b-4734-8a86-51a1faed9788 None admin] RBAC: Authorizing `identity:get_project(project_id=deeac7725be842659d93e27cd19f954b)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:40.388298 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21806f10-fb1b-4734-8a86-51a1faed9788 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:40.390311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 201/393] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:40 2022] GET /identity/v3/projects/deeac7725be842659d93e27cd19f954b => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:40.396224 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe156e-f595-4c8c-bb66-992ffebf8a29 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:40.439441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:40.521865 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe156e-f595-4c8c-bb66-992ffebf8a29 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:40.566966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f9210-6d75-4631-ad0a-942da928ae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:40.567856 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f9210-6d75-4631-ad0a-942da928ae31 None admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:40.568394 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f9210-6d75-4631-ad0a-942da928ae31 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:40.568675 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f9210-6d75-4631-ad0a-942da928ae31 None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b/groups/992b227cc746425c8ed0d87484b8ec37/roles/f0bb7fa65c8545699b60f857f930b078` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:40.571903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f9210-6d75-4631-ad0a-942da928ae31 None admin] RBAC: Authorizing `identity:create_grant(project_id=deeac7725be842659d93e27cd19f954b, group_id=992b227cc746425c8ed0d87484b8ec37, role_id=f0bb7fa65c8545699b60f857f930b078)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:40.573408 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f9210-6d75-4631-ad0a-942da928ae31 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:40.647170 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 193/394] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Jun 23 19:38:40 2022] PUT /identity/v3/projects/deeac7725be842659d93e27cd19f954b/groups/992b227cc746425c8ed0d87484b8ec37/roles/f0bb7fa65c8545699b60f857f930b078 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:38:41.223705 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb5bab-0c5f-4404-9075-e87d46a782c9 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:41.224675 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb5bab-0c5f-4404-9075-e87d46a782c9 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:41.225201 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb5bab-0c5f-4404-9075-e87d46a782c9 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:41.227313 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 202/395] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:41.232774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff9bcb-c533-4932-846f-098896807675 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:41.233612 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff9bcb-c533-4932-846f-098896807675 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:41.234098 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff9bcb-c533-4932-846f-098896807675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:41.255424 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-62ff9bcb-c533-4932-846f-098896807675 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:41.256925 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-62ff9bcb-c533-4932-846f-098896807675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:41.359042 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 194/396] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:41.377447 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4041990-bbf8-4ec7-bd3e-c6ee93acae6a None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:41.377744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4041990-bbf8-4ec7-bd3e-c6ee93acae6a None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:41.378032 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4041990-bbf8-4ec7-bd3e-c6ee93acae6a None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:41.379678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 203/397] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:41.385567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea67c8-8130-48a8-bd9b-e0d90c947be0 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:41.385866 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea67c8-8130-48a8-bd9b-e0d90c947be0 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:41.386154 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea67c8-8130-48a8-bd9b-e0d90c947be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:41.404984 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-b9ea67c8-8130-48a8-bd9b-e0d90c947be0 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:41.405186 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4041990-bbf8-4ec7-bd3e-c6ee93acae6a None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:41.406224 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-b9ea67c8-8130-48a8-bd9b-e0d90c947be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:41.419551 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:41.444069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:41.495971 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 195/398] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:41.497275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668d01c-7d3f-4b27-a86e-a6e7c6599138 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:41.497570 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668d01c-7d3f-4b27-a86e-a6e7c6599138 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:41.497854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668d01c-7d3f-4b27-a86e-a6e7c6599138 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:41.503438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 196/399] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:41.505815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2e1a1-1969-4cc6-8eb4-6f3046276ca2 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:41.506101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2e1a1-1969-4cc6-8eb4-6f3046276ca2 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:41.506376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2e1a1-1969-4cc6-8eb4-6f3046276ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:41.526071 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-45d2e1a1-1969-4cc6-8eb4-6f3046276ca2 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:41.527684 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-45d2e1a1-1969-4cc6-8eb4-6f3046276ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:41.546198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4041990-bbf8-4ec7-bd3e-c6ee93acae6a None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:41.584877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f29dbe-31a5-4a0c-9f9c-0fcd928bc3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:41.586683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f29dbe-31a5-4a0c-9f9c-0fcd928bc3d2 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:41.586972 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f29dbe-31a5-4a0c-9f9c-0fcd928bc3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:41.587256 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f29dbe-31a5-4a0c-9f9c-0fcd928bc3d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:41.602747 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f29dbe-31a5-4a0c-9f9c-0fcd928bc3d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:41.613172 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 197/400] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:38:41.613172 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2e1a1-1969-4cc6-8eb4-6f3046276ca2 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:41.624257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-72f29dbe-31a5-4a0c-9f9c-0fcd928bc3d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:41.624257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:41.624257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:41.624257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:41.624257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:41.624257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:41.624257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:41.624257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:41.624257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:41.624257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:41.624257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:41.624257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:41.624257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:41.624257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:41.624257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:41.624257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:41.625250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:41.625250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:41.625250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:41.625250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:41.625250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:41.625250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:41.625250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:41.625250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:41.625250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:41.625250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:41.625250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:41.625250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:41.625250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:41.625250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:41.625250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:41.625250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:41.626036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:41.626036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:41.626036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:41.626036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:41.626036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:41.626036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:41.626036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:41.626036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:41.626036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:41.626036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:41.626036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:41.626036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:41.629127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 204/401] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:38:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:38:41.633765 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f29dbe-31a5-4a0c-9f9c-0fcd928bc3d2 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:41.702986 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:41.721034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:41.734633 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2e1a1-1969-4cc6-8eb4-6f3046276ca2 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:41.738948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f29dbe-31a5-4a0c-9f9c-0fcd928bc3d2 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:41.775141 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2413d-d5ef-425d-87a1-e4da5138d700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:41.775342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea13599-25ca-42af-8740-c15ebdf6bb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:41.775734 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2413d-d5ef-425d-87a1-e4da5138d700 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:41.776023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2413d-d5ef-425d-87a1-e4da5138d700 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:41.776371 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2413d-d5ef-425d-87a1-e4da5138d700 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:41.777109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2413d-d5ef-425d-87a1-e4da5138d700 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:41.777448 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2413d-d5ef-425d-87a1-e4da5138d700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:41.778441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea13599-25ca-42af-8740-c15ebdf6bb3a None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:41.778833 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2413d-d5ef-425d-87a1-e4da5138d700 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:41.779166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea13599-25ca-42af-8740-c15ebdf6bb3a None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:41.779629 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea13599-25ca-42af-8740-c15ebdf6bb3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:41.787643 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 205/402] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:38:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:41.788862 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2413d-d5ef-425d-87a1-e4da5138d700 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:41.792078 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea13599-25ca-42af-8740-c15ebdf6bb3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:41.800476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-5ea13599-25ca-42af-8740-c15ebdf6bb3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:41.800476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:41.800476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:41.800476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:41.800476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:41.800476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:41.800476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:41.800476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:41.800476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:41.800476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:41.800476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:41.800476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:41.800476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:41.800476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:41.800476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:41.800476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:41.801442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:41.801442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:41.801442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:41.801442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:41.801442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:41.801442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:41.801442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:41.801442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:41.801442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:41.801442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:41.801442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:41.801442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:41.801442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:41.801442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:41.801442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:41.801442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:41.802225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:41.802225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:41.802225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:41.802225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:41.802225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:41.802225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:41.802225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:41.802225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:41.802225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:41.802225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:41.802225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:41.802225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:41.805544 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 198/403] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:41.806660 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea13599-25ca-42af-8740-c15ebdf6bb3a None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:41.898448 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2413d-d5ef-425d-87a1-e4da5138d700 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:41.927576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:41.934076 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5391fb9-a032-4ab1-8db2-2ad7d2a509a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:41.934875 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5391fb9-a032-4ab1-8db2-2ad7d2a509a2 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:41.935167 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5391fb9-a032-4ab1-8db2-2ad7d2a509a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:41.935506 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5391fb9-a032-4ab1-8db2-2ad7d2a509a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:41.936364 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea13599-25ca-42af-8740-c15ebdf6bb3a None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:41.947425 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5391fb9-a032-4ab1-8db2-2ad7d2a509a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:41.956271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-b5391fb9-a032-4ab1-8db2-2ad7d2a509a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:38:41.956271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:41.956271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:41.956271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:41.956271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:41.956271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:41.956271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:41.956271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:41.956271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:41.956271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:41.956271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:41.956271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:41.956271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:41.956271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:41.956271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:41.956271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:41.957143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:41.957143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:41.957143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:41.957143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:41.957143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:41.957143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:41.957143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:41.957143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:41.957143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:41.957143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:41.957143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:41.957143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:41.957143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:41.957143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:41.957143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:41.957143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:41.958041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:41.958041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:41.958041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:41.958041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:41.958041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:41.958041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:41.958041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:41.958041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:41.958041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:41.958041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:41.958041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:38:41.958041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:41.958041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 206/404] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:38:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:41.959310 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5391fb9-a032-4ab1-8db2-2ad7d2a509a2 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:41.979301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38cefc-a7a7-41ae-9692-c7fb46654dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:41.980680 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38cefc-a7a7-41ae-9692-c7fb46654dca None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:41.981201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38cefc-a7a7-41ae-9692-c7fb46654dca None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:41.981671 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38cefc-a7a7-41ae-9692-c7fb46654dca None admin] PATH_INFO: `/v3/groups/992b227cc746425c8ed0d87484b8ec37` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:41.983111 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38cefc-a7a7-41ae-9692-c7fb46654dca None admin] RBAC: Authorizing `identity:get_group(group_id=992b227cc746425c8ed0d87484b8ec37)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:41.984860 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38cefc-a7a7-41ae-9692-c7fb46654dca None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:41.987025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 199/405] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 19:38:41 2022] GET /identity/v3/groups/992b227cc746425c8ed0d87484b8ec37 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:41.988081 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38cefc-a7a7-41ae-9692-c7fb46654dca None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:42.009028 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:42.068246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5391fb9-a032-4ab1-8db2-2ad7d2a509a2 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:42.102436 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38cefc-a7a7-41ae-9692-c7fb46654dca None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:42.103937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd4ca7-e3a6-46fd-9d24-53cc8914e00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:42.104690 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd4ca7-e3a6-46fd-9d24-53cc8914e00a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:42.105076 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd4ca7-e3a6-46fd-9d24-53cc8914e00a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:42.105470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd4ca7-e3a6-46fd-9d24-53cc8914e00a None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:42.106788 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd4ca7-e3a6-46fd-9d24-53cc8914e00a None admin] RBAC: Adding query filter params (name=member) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:42.106788 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd4ca7-e3a6-46fd-9d24-53cc8914e00a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:42.107981 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd4ca7-e3a6-46fd-9d24-53cc8914e00a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:42.123150 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 207/406] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:42.124030 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd4ca7-e3a6-46fd-9d24-53cc8914e00a None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:42.138898 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c31a45-6751-4063-ae9b-17f39e5f667e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:42.139598 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c31a45-6751-4063-ae9b-17f39e5f667e None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:42.139883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c31a45-6751-4063-ae9b-17f39e5f667e None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:42.140164 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c31a45-6751-4063-ae9b-17f39e5f667e None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:42.140913 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c31a45-6751-4063-ae9b-17f39e5f667e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:42.141243 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c31a45-6751-4063-ae9b-17f39e5f667e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:42.142613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c31a45-6751-4063-ae9b-17f39e5f667e None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:42.152086 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 200/407] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:42.152916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c31a45-6751-4063-ae9b-17f39e5f667e None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:42.187721 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:42.233796 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd4ca7-e3a6-46fd-9d24-53cc8914e00a None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:42.238935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:42.263284 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c31a45-6751-4063-ae9b-17f39e5f667e None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:42.270133 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1525d4-55ee-4e8a-a605-c891550d0f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:42.271014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1525d4-55ee-4e8a-a605-c891550d0f71 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:42.271310 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1525d4-55ee-4e8a-a605-c891550d0f71 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:42.271602 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1525d4-55ee-4e8a-a605-c891550d0f71 None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:42.272893 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1525d4-55ee-4e8a-a605-c891550d0f71 None admin] RBAC: Authorizing `identity:get_project(project_id=3ffde5ab0f994cd5b8e67d5092a69564)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:42.276481 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1525d4-55ee-4e8a-a605-c891550d0f71 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:42.276589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 208/408] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:42 2022] GET /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:42.277490 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1525d4-55ee-4e8a-a605-c891550d0f71 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:42.300288 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebba7b-9d5e-4a7f-911a-6f79986ccfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:42.301473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebba7b-9d5e-4a7f-911a-6f79986ccfc2 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:42.302930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebba7b-9d5e-4a7f-911a-6f79986ccfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:42.303353 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebba7b-9d5e-4a7f-911a-6f79986ccfc2 None admin] PATH_INFO: `/v3/groups/992b227cc746425c8ed0d87484b8ec37` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:42.305476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ebba7b-9d5e-4a7f-911a-6f79986ccfc2 None admin] RBAC: Authorizing `identity:get_group(group_id=992b227cc746425c8ed0d87484b8ec37)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:42.307060 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ebba7b-9d5e-4a7f-911a-6f79986ccfc2 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:42.309102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 201/409] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 19:38:42 2022] GET /identity/v3/groups/992b227cc746425c8ed0d87484b8ec37 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:42.310009 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebba7b-9d5e-4a7f-911a-6f79986ccfc2 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:42.386947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1525d4-55ee-4e8a-a605-c891550d0f71 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:42.415168 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebba7b-9d5e-4a7f-911a-6f79986ccfc2 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:42.417532 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:42.422125 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910504e0-c534-4cb6-9cdc-7c91ec2150e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:42.422998 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910504e0-c534-4cb6-9cdc-7c91ec2150e9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:42.423288 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910504e0-c534-4cb6-9cdc-7c91ec2150e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:42.423573 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910504e0-c534-4cb6-9cdc-7c91ec2150e9 None admin] PATH_INFO: `/v3/groups/f6147af4c4954719b96cd2a4812d5056` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:42.424784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910504e0-c534-4cb6-9cdc-7c91ec2150e9 None admin] RBAC: Authorizing `identity:get_group(group_id=f6147af4c4954719b96cd2a4812d5056)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:42.426281 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910504e0-c534-4cb6-9cdc-7c91ec2150e9 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:42.433017 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 209/410] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 19:38:42 2022] GET /identity/v3/groups/f6147af4c4954719b96cd2a4812d5056 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:42.433913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910504e0-c534-4cb6-9cdc-7c91ec2150e9 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:42.454904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0d4da-e034-4789-8393-77f5b7c90364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:42.455908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0d4da-e034-4789-8393-77f5b7c90364 None admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:42.456196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0d4da-e034-4789-8393-77f5b7c90364 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:42.456473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0d4da-e034-4789-8393-77f5b7c90364 None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564/groups/992b227cc746425c8ed0d87484b8ec37/roles/f0bb7fa65c8545699b60f857f930b078` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:42.458697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0d4da-e034-4789-8393-77f5b7c90364 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ffde5ab0f994cd5b8e67d5092a69564, group_id=992b227cc746425c8ed0d87484b8ec37, role_id=f0bb7fa65c8545699b60f857f930b078)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:42.460358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0d4da-e034-4789-8393-77f5b7c90364 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:42.531780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 202/411] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Jun 23 19:38:42 2022] PUT /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564/groups/992b227cc746425c8ed0d87484b8ec37/roles/f0bb7fa65c8545699b60f857f930b078 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:38:42.533560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b0536-5a4a-4731-a40f-ee85c579aabb None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:42.533934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b0536-5a4a-4731-a40f-ee85c579aabb None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:42.534307 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b0536-5a4a-4731-a40f-ee85c579aabb None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:42.535841 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 203/412] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:42.540835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b0536-5a4a-4731-a40f-ee85c579aabb None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:42.543271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910504e0-c534-4cb6-9cdc-7c91ec2150e9 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:42.551195 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:42.585118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924919f-f9f1-427b-9e60-ceada479d46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:42.586297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924919f-f9f1-427b-9e60-ceada479d46d None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:42.586826 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924919f-f9f1-427b-9e60-ceada479d46d None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:42.587368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924919f-f9f1-427b-9e60-ceada479d46d None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:42.589060 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924919f-f9f1-427b-9e60-ceada479d46d None admin] RBAC: Authorizing `identity:get_project(project_id=3ffde5ab0f994cd5b8e67d5092a69564)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:42.590812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924919f-f9f1-427b-9e60-ceada479d46d None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:42.592818 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 210/413] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:42 2022] GET /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:42.594323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a67d00-d3ba-4ad8-a2c0-4a0016f6db79 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:42.594794 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a67d00-d3ba-4ad8-a2c0-4a0016f6db79 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:42.595236 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a67d00-d3ba-4ad8-a2c0-4a0016f6db79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:42.618751 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-06a67d00-d3ba-4ad8-a2c0-4a0016f6db79 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:42.620243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-06a67d00-d3ba-4ad8-a2c0-4a0016f6db79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:42.681014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:42.684712 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b0536-5a4a-4731-a40f-ee85c579aabb None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:42.700471 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 211/414] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:42.710949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a67d00-d3ba-4ad8-a2c0-4a0016f6db79 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:42.728402 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18391e27-0139-4033-bc7e-7842e19e08f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:42.729752 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18391e27-0139-4033-bc7e-7842e19e08f1 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:42.730209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18391e27-0139-4033-bc7e-7842e19e08f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:42.730640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18391e27-0139-4033-bc7e-7842e19e08f1 None admin] PATH_INFO: `/v3/projects/50703062c6ac410a8cc7e1c87c4ecbac` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:42.732081 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18391e27-0139-4033-bc7e-7842e19e08f1 None admin] RBAC: Authorizing `identity:get_project(project_id=50703062c6ac410a8cc7e1c87c4ecbac)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:42.733640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18391e27-0139-4033-bc7e-7842e19e08f1 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:42.735661 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 204/415] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:42 2022] GET /identity/v3/projects/50703062c6ac410a8cc7e1c87c4ecbac => generated 344 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:42.736448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18391e27-0139-4033-bc7e-7842e19e08f1 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:42.833443 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:42.840011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a67d00-d3ba-4ad8-a2c0-4a0016f6db79 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:42.865036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18391e27-0139-4033-bc7e-7842e19e08f1 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:42.882563 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04393399-a26c-4b6c-bc48-2f838d1d3bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:42.884323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04393399-a26c-4b6c-bc48-2f838d1d3bda None admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:42.884765 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04393399-a26c-4b6c-bc48-2f838d1d3bda None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:42.885218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04393399-a26c-4b6c-bc48-2f838d1d3bda None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564/groups/992b227cc746425c8ed0d87484b8ec37/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:42.887393 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04393399-a26c-4b6c-bc48-2f838d1d3bda None admin] RBAC: Authorizing `identity:create_grant(project_id=3ffde5ab0f994cd5b8e67d5092a69564, group_id=992b227cc746425c8ed0d87484b8ec37, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:42.889060 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04393399-a26c-4b6c-bc48-2f838d1d3bda None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:42.907161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fc5a6-74d9-42ce-a61c-791074425d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:42.908173 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fc5a6-74d9-42ce-a61c-791074425d31 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:42.908579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fc5a6-74d9-42ce-a61c-791074425d31 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:42.909025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fc5a6-74d9-42ce-a61c-791074425d31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:42.919661 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fc5a6-74d9-42ce-a61c-791074425d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:42.927761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-7a0fc5a6-74d9-42ce-a61c-791074425d31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:42.927761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:42.927761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:42.927761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:42.927761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:42.927761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:42.927761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:42.927761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:42.927761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:42.927761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:42.927761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:42.927761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:42.927761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:42.927761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:42.927761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:42.927761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:42.938304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:42.938304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:42.938304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:42.938304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:42.938304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:42.938304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:42.938304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:42.938304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:42.938304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:42.938304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:42.938304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:42.938304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:42.938304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:42.938304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:42.938304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:42.938304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:42.939357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:42.939357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:42.939357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:42.939357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:42.939357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:42.939357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:42.939357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:42.939357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:42.939357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:42.939357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:42.939357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:42.939357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:42.939357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 205/416] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:42.939357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fc5a6-74d9-42ce-a61c-791074425d31 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:43.036703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fc5a6-74d9-42ce-a61c-791074425d31 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:43.062555 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 212/417] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Jun 23 19:38:42 2022] PUT /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564/groups/992b227cc746425c8ed0d87484b8ec37/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:38:43.064542 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04393399-a26c-4b6c-bc48-2f838d1d3bda None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:43.101689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4276d18-c5d7-4712-9871-295682fc0723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:43.102377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4276d18-c5d7-4712-9871-295682fc0723 None admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:43.102662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4276d18-c5d7-4712-9871-295682fc0723 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:43.102938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4276d18-c5d7-4712-9871-295682fc0723 None admin] PATH_INFO: `/v3/projects/50703062c6ac410a8cc7e1c87c4ecbac/groups/f6147af4c4954719b96cd2a4812d5056/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:43.107576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4276d18-c5d7-4712-9871-295682fc0723 None admin] RBAC: Authorizing `identity:create_grant(project_id=50703062c6ac410a8cc7e1c87c4ecbac, group_id=f6147af4c4954719b96cd2a4812d5056, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:43.107576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4276d18-c5d7-4712-9871-295682fc0723 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:43.109290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:43.153866 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:43.188022 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 206/418] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Jun 23 19:38:42 2022] PUT /identity/v3/projects/50703062c6ac410a8cc7e1c87c4ecbac/groups/f6147af4c4954719b96cd2a4812d5056/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:38:43.193829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c8de0-aeb3-4d04-b1e8-aac70da3d280 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:43.195563 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c8de0-aeb3-4d04-b1e8-aac70da3d280 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:43.196029 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c8de0-aeb3-4d04-b1e8-aac70da3d280 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:43.204810 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 207/419] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:43 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:43.206758 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2c54c-3cac-40f9-ba8f-3ebd6cc49c6f None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:43.208119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2c54c-3cac-40f9-ba8f-3ebd6cc49c6f None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:43.209732 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2c54c-3cac-40f9-ba8f-3ebd6cc49c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:43.239908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-61b2c54c-3cac-40f9-ba8f-3ebd6cc49c6f None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:43.243611 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-61b2c54c-3cac-40f9-ba8f-3ebd6cc49c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:43.248069 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04393399-a26c-4b6c-bc48-2f838d1d3bda None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:43.297871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c086d3-c4ee-407c-9326-e5016e8239b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:43.298563 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c086d3-c4ee-407c-9326-e5016e8239b1 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:43.298852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c086d3-c4ee-407c-9326-e5016e8239b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:43.299134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c086d3-c4ee-407c-9326-e5016e8239b1 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:43.300316 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c086d3-c4ee-407c-9326-e5016e8239b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:43.300316 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c086d3-c4ee-407c-9326-e5016e8239b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:43.301642 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c086d3-c4ee-407c-9326-e5016e8239b1 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:43.315488 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 213/420] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:43.327606 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c086d3-c4ee-407c-9326-e5016e8239b1 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:43.355650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 208/421] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:43.379588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2c54c-3cac-40f9-ba8f-3ebd6cc49c6f None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:43.472699 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c086d3-c4ee-407c-9326-e5016e8239b1 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:43.485043 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:43.507769 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2c54c-3cac-40f9-ba8f-3ebd6cc49c6f None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:43.526664 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6701a4-a2ad-4c0e-92b4-cea2678cd8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:43.527703 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6701a4-a2ad-4c0e-92b4-cea2678cd8c4 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:43.528215 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6701a4-a2ad-4c0e-92b4-cea2678cd8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:43.528704 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6701a4-a2ad-4c0e-92b4-cea2678cd8c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:43.561935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:43.587199 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da889533-5af0-41e1-8e8b-8eaa836026e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:43.588497 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da889533-5af0-41e1-8e8b-8eaa836026e9 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:43.588995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da889533-5af0-41e1-8e8b-8eaa836026e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:43.589555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da889533-5af0-41e1-8e8b-8eaa836026e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:43.609635 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da889533-5af0-41e1-8e8b-8eaa836026e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:43.623879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-da889533-5af0-41e1-8e8b-8eaa836026e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:43.623879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:43.623879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:43.623879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:43.623879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:43.623879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:43.623879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:43.623879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:43.623879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:43.623879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:43.623879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:43.623879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:43.623879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:43.623879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:43.623879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:43.623879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:43.624819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:43.624819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:43.624819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:43.624819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:43.624819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:43.624819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:43.624819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:43.624819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:43.624819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:43.624819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:43.624819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:43.624819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:43.624819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:43.624819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:43.624819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:43.624819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:43.625683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:43.625683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:43.625683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:43.625683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:43.625683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:43.625683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:43.625683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:43.625683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:43.625683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:43.625683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:43.625683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:43.625683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:43.626297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6701a4-a2ad-4c0e-92b4-cea2678cd8c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:43.626297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6701a4-a2ad-4c0e-92b4-cea2678cd8c4 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:43.627618 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 209/422] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:38:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:43.631749 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da889533-5af0-41e1-8e8b-8eaa836026e9 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:43.782262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da889533-5af0-41e1-8e8b-8eaa836026e9 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:43.822208 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2525ab3-0e53-4aea-bf74-a559a3395d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:43.823208 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2525ab3-0e53-4aea-bf74-a559a3395d1f None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:43.823820 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2525ab3-0e53-4aea-bf74-a559a3395d1f None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:43.825379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2525ab3-0e53-4aea-bf74-a559a3395d1f None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:43.826152 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2525ab3-0e53-4aea-bf74-a559a3395d1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:43.826469 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2525ab3-0e53-4aea-bf74-a559a3395d1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:43.827919 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2525ab3-0e53-4aea-bf74-a559a3395d1f None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:43.840411 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 214/423] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:43.844155 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6701a4-a2ad-4c0e-92b4-cea2678cd8c4 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:43.845484 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 210/424] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:38:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:43.850602 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2525ab3-0e53-4aea-bf74-a559a3395d1f None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:43.858640 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:43.923078 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:43.981283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2525ab3-0e53-4aea-bf74-a559a3395d1f None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:44.009433 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6701a4-a2ad-4c0e-92b4-cea2678cd8c4 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:44.022083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06132f-fcc0-44bf-8bd7-d70f44699a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:44.022083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06132f-fcc0-44bf-8bd7-d70f44699a15 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:44.022083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06132f-fcc0-44bf-8bd7-d70f44699a15 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:44.022083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06132f-fcc0-44bf-8bd7-d70f44699a15 None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:44.022561 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06132f-fcc0-44bf-8bd7-d70f44699a15 None admin] RBAC: Authorizing `identity:get_project(project_id=deeac7725be842659d93e27cd19f954b)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:44.025602 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06132f-fcc0-44bf-8bd7-d70f44699a15 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:44.025602 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 211/425] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:43 2022] GET /identity/v3/projects/deeac7725be842659d93e27cd19f954b => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:44.032215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06132f-fcc0-44bf-8bd7-d70f44699a15 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:44.076925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e24c68-df86-4635-9ccb-fb623e6d7b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:44.077757 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e24c68-df86-4635-9ccb-fb623e6d7b5a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:44.079055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e24c68-df86-4635-9ccb-fb623e6d7b5a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:44.079589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e24c68-df86-4635-9ccb-fb623e6d7b5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:44.207827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e24c68-df86-4635-9ccb-fb623e6d7b5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:44.210015 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e24c68-df86-4635-9ccb-fb623e6d7b5a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:44.227665 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06132f-fcc0-44bf-8bd7-d70f44699a15 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:44.231458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:44.256416 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:44.293687 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ff352-8d19-452b-99b2-01a42f2dc761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:44.294558 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ff352-8d19-452b-99b2-01a42f2dc761 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:44.294838 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ff352-8d19-452b-99b2-01a42f2dc761 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:44.295112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ff352-8d19-452b-99b2-01a42f2dc761 None admin] PATH_INFO: `/v3/groups/992b227cc746425c8ed0d87484b8ec37` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:44.297236 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ff352-8d19-452b-99b2-01a42f2dc761 None admin] RBAC: Authorizing `identity:get_group(group_id=992b227cc746425c8ed0d87484b8ec37)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:44.298675 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ff352-8d19-452b-99b2-01a42f2dc761 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:44.301519 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 212/426] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 19:38:44 2022] GET /identity/v3/groups/992b227cc746425c8ed0d87484b8ec37 => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:44.309054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ff352-8d19-452b-99b2-01a42f2dc761 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:44.396888 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 215/427] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:44.405037 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e24c68-df86-4635-9ccb-fb623e6d7b5a None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:44.506439 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ff352-8d19-452b-99b2-01a42f2dc761 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:44.565028 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922dac9-fc0e-4517-a56c-3d1c5615b73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:44.565711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922dac9-fc0e-4517-a56c-3d1c5615b73a None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:44.565992 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922dac9-fc0e-4517-a56c-3d1c5615b73a None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:44.566268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922dac9-fc0e-4517-a56c-3d1c5615b73a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:44.567102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922dac9-fc0e-4517-a56c-3d1c5615b73a None admin] RBAC: Adding query filter params (group.id=992b227cc746425c8ed0d87484b8ec37, role.id=61895d866a7c44de8924486b8e5ec6e8, scope.project.id=deeac7725be842659d93e27cd19f954b) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:44.567414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922dac9-fc0e-4517-a56c-3d1c5615b73a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:44.569248 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922dac9-fc0e-4517-a56c-3d1c5615b73a None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:44.582016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e24c68-df86-4635-9ccb-fb623e6d7b5a None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:44.584552 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 213/428] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 23 19:38:44 2022] GET /identity/v3/role_assignments?group.id=992b227cc746425c8ed0d87484b8ec37&scope.project.id=deeac7725be842659d93e27cd19f954b&role.id=61895d866a7c44de8924486b8e5ec6e8 => generated 611 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:44.601755 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:44.645994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f40111-d0b5-45fc-88be-42edaa5f7b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:44.647005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f40111-d0b5-45fc-88be-42edaa5f7b34 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:44.647239 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f40111-d0b5-45fc-88be-42edaa5f7b34 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:44.647527 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f40111-d0b5-45fc-88be-42edaa5f7b34 None admin] PATH_INFO: `/v3/projects/deeac7725be842659d93e27cd19f954b` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:44.651447 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f40111-d0b5-45fc-88be-42edaa5f7b34 None admin] RBAC: Authorizing `identity:get_project(project_id=deeac7725be842659d93e27cd19f954b)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:44.653000 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f40111-d0b5-45fc-88be-42edaa5f7b34 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:44.654891 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 216/429] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:44 2022] GET /identity/v3/projects/deeac7725be842659d93e27cd19f954b => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:44.660683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922dac9-fc0e-4517-a56c-3d1c5615b73a None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:44.749698 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:44.808254 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922dac9-fc0e-4517-a56c-3d1c5615b73a None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:44.840518 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae5057-ad27-410e-a206-86738feafde6 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:44.840812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae5057-ad27-410e-a206-86738feafde6 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:44.841107 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae5057-ad27-410e-a206-86738feafde6 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:44.842646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 217/430] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:38:44.847709 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b637f8-f830-44fc-b4d1-4a7ea2ef6e28 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:44.848002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b637f8-f830-44fc-b4d1-4a7ea2ef6e28 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:44.848285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b637f8-f830-44fc-b4d1-4a7ea2ef6e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:44.848832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd50a0-7edc-427c-894f-1e60512abe07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:44.849725 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd50a0-7edc-427c-894f-1e60512abe07 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:44.850056 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd50a0-7edc-427c-894f-1e60512abe07 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:44.850332 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd50a0-7edc-427c-894f-1e60512abe07 None admin] PATH_INFO: `/v3/groups/992b227cc746425c8ed0d87484b8ec37` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:44.852671 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd50a0-7edc-427c-894f-1e60512abe07 None admin] RBAC: Authorizing `identity:get_group(group_id=992b227cc746425c8ed0d87484b8ec37)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:44.854379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd50a0-7edc-427c-894f-1e60512abe07 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:44.856385 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 214/431] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 19:38:44 2022] GET /identity/v3/groups/992b227cc746425c8ed0d87484b8ec37 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:44.862004 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd50a0-7edc-427c-894f-1e60512abe07 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:44.874212 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-00b637f8-f830-44fc-b4d1-4a7ea2ef6e28 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:44.875929 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-00b637f8-f830-44fc-b4d1-4a7ea2ef6e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:44.982663 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 218/432] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:38:45.002868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd50a0-7edc-427c-894f-1e60512abe07 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:45.009757 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b637f8-f830-44fc-b4d1-4a7ea2ef6e28 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:45.020186 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:45.047505 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a21802-7c89-406c-af5c-b7a604683f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:45.048308 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a21802-7c89-406c-af5c-b7a604683f71 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:45.048602 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a21802-7c89-406c-af5c-b7a604683f71 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:45.048879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a21802-7c89-406c-af5c-b7a604683f71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:45.050612 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a21802-7c89-406c-af5c-b7a604683f71 None admin] RBAC: Adding query filter params (group.id=992b227cc746425c8ed0d87484b8ec37, role.id=f0bb7fa65c8545699b60f857f930b078, scope.project.id=deeac7725be842659d93e27cd19f954b) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:45.050935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a21802-7c89-406c-af5c-b7a604683f71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:45.052390 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a21802-7c89-406c-af5c-b7a604683f71 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:45.059866 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 215/433] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 23 19:38:44 2022] GET /identity/v3/role_assignments?group.id=992b227cc746425c8ed0d87484b8ec37&scope.project.id=deeac7725be842659d93e27cd19f954b&role.id=f0bb7fa65c8545699b60f857f930b078 => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:45.142113 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b637f8-f830-44fc-b4d1-4a7ea2ef6e28 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:45.151682 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:45.180986 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93165ca0-8880-4216-9f3e-1f8f37555fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:45.181859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93165ca0-8880-4216-9f3e-1f8f37555fb5 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:45.182147 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93165ca0-8880-4216-9f3e-1f8f37555fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:45.182428 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93165ca0-8880-4216-9f3e-1f8f37555fb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:45.196111 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93165ca0-8880-4216-9f3e-1f8f37555fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:45.204970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-93165ca0-8880-4216-9f3e-1f8f37555fb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:45.204970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:45.204970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:45.204970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:45.204970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:45.204970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:45.204970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:45.204970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:45.204970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:45.204970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:45.204970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:45.204970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:45.204970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:45.204970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:45.204970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:45.204970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:45.206064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:45.206064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:45.206064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:45.206064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:45.206064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:45.206064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:45.206064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:45.206064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:45.206064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:45.206064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:45.206064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:45.206064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:45.206064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:45.206064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:45.206064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:45.206064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:45.206849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:45.206849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:45.206849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:45.206849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:45.206849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:45.206849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:45.206849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:45.206849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:45.206849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:45.206849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:45.206849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:45.206849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:45.206849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 219/434] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:38:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:45.214255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a21802-7c89-406c-af5c-b7a604683f71 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:45.325978 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a21802-7c89-406c-af5c-b7a604683f71 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:45.363865 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d6f2b-6a5c-43b3-88a0-10ac4892a8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:45.364545 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d6f2b-6a5c-43b3-88a0-10ac4892a8a8 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:45.364827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d6f2b-6a5c-43b3-88a0-10ac4892a8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:45.365105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d6f2b-6a5c-43b3-88a0-10ac4892a8a8 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:45.365886 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d6f2b-6a5c-43b3-88a0-10ac4892a8a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:45.366189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d6f2b-6a5c-43b3-88a0-10ac4892a8a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:45.367715 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d6f2b-6a5c-43b3-88a0-10ac4892a8a8 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:45.376952 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 216/435] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:38:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:45.382454 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93165ca0-8880-4216-9f3e-1f8f37555fb5 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:45.495171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93165ca0-8880-4216-9f3e-1f8f37555fb5 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:45.533705 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b72d0-5cc0-4e49-8744-8901bd59cd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:45.534418 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b72d0-5cc0-4e49-8744-8901bd59cd26 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:45.534709 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b72d0-5cc0-4e49-8744-8901bd59cd26 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:45.534991 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b72d0-5cc0-4e49-8744-8901bd59cd26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:45.548945 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f628e7c-f1a3-4c5a-b0f7-266f089184a4 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:45.548945 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f628e7c-f1a3-4c5a-b0f7-266f089184a4 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:45.549402 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f628e7c-f1a3-4c5a-b0f7-266f089184a4 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:45.550935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 217/436] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:38:45.556600 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27593a6-405c-4b90-8335-12eaa194fa3b None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:45.556895 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27593a6-405c-4b90-8335-12eaa194fa3b None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:45.557213 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27593a6-405c-4b90-8335-12eaa194fa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:45.577799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:45.583506 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-d27593a6-405c-4b90-8335-12eaa194fa3b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:45.584895 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d27593a6-405c-4b90-8335-12eaa194fa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:45.620025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b72d0-5cc0-4e49-8744-8901bd59cd26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:45.620025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b72d0-5cc0-4e49-8744-8901bd59cd26 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:45.634739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:45.683293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 218/437] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:38:45.709395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27593a6-405c-4b90-8335-12eaa194fa3b None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:45.738935 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 220/438] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:45.744427 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b72d0-5cc0-4e49-8744-8901bd59cd26 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:45.808986 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:45.815860 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27593a6-405c-4b90-8335-12eaa194fa3b None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:45.842627 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b72d0-5cc0-4e49-8744-8901bd59cd26 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:45.850498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f32fb9-c774-406d-bf3a-6615b164c3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:45.851630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f32fb9-c774-406d-bf3a-6615b164c3ba None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:45.851917 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f32fb9-c774-406d-bf3a-6615b164c3ba None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:45.852196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f32fb9-c774-406d-bf3a-6615b164c3ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:45.862159 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f32fb9-c774-406d-bf3a-6615b164c3ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:45.870088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-75f32fb9-c774-406d-bf3a-6615b164c3ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:45.870088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:45.870088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:45.870088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:45.870088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:45.870088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:45.870088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:45.870088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:45.870088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:45.870088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:45.870088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:45.870088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:45.870088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:45.870088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:45.870088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:45.870088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:45.871149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:45.871149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:45.871149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:45.871149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:45.871149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:45.871149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:45.871149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:45.871149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:45.871149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:45.871149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:45.871149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:45.871149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:45.871149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:45.871149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:45.871149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:45.871149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:45.871974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:45.871974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:45.871974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:45.871974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:45.871974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:45.871974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:45.871974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:45.871974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:45.871974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:45.871974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:45.871974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 19:38:45.871974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:45.871974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 219/439] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:38:45.872632 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7a502-4e7d-4d87-8a01-200aa89f47c0 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:45.872824 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7a502-4e7d-4d87-8a01-200aa89f47c0 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:45.873104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7a502-4e7d-4d87-8a01-200aa89f47c0 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:45.874625 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 220/440] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:45.878112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7a502-4e7d-4d87-8a01-200aa89f47c0 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:45.882868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42415c28-c66a-4eb8-a4f1-d2334565dce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:45.883738 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42415c28-c66a-4eb8-a4f1-d2334565dce2 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:45.884026 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42415c28-c66a-4eb8-a4f1-d2334565dce2 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:45.884323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42415c28-c66a-4eb8-a4f1-d2334565dce2 None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:45.885536 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42415c28-c66a-4eb8-a4f1-d2334565dce2 None admin] RBAC: Authorizing `identity:get_project(project_id=3ffde5ab0f994cd5b8e67d5092a69564)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:45.886982 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42415c28-c66a-4eb8-a4f1-d2334565dce2 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:45.892995 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 221/441] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:45 2022] GET /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:45.892995 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8a052-7848-49d3-a150-268d2beda8f8 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:45.892995 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8a052-7848-49d3-a150-268d2beda8f8 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:45.892995 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8a052-7848-49d3-a150-268d2beda8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:45.908060 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-95a8a052-7848-49d3-a150-268d2beda8f8 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:45.909280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-95a8a052-7848-49d3-a150-268d2beda8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:45.911684 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:45.974663 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 222/442] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:45.975498 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8a052-7848-49d3-a150-268d2beda8f8 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:45.989691 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7a502-4e7d-4d87-8a01-200aa89f47c0 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:46.024930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3d224-5078-4acf-b0d2-684f41cafc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:46.025634 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3d224-5078-4acf-b0d2-684f41cafc39 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:46.025916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3d224-5078-4acf-b0d2-684f41cafc39 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:46.026194 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3d224-5078-4acf-b0d2-684f41cafc39 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:46.026941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3d224-5078-4acf-b0d2-684f41cafc39 None admin] RBAC: Adding query filter params (name=member) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:46.027245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3d224-5078-4acf-b0d2-684f41cafc39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:46.028633 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3d224-5078-4acf-b0d2-684f41cafc39 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:46.036887 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 221/443] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:38:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:46.037682 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3d224-5078-4acf-b0d2-684f41cafc39 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:46.039080 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:46.077871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8a052-7848-49d3-a150-268d2beda8f8 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:46.111636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec2154-c0e5-44ef-bcb0-df47b7050103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:46.112480 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec2154-c0e5-44ef-bcb0-df47b7050103 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:46.112768 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec2154-c0e5-44ef-bcb0-df47b7050103 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:46.113043 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec2154-c0e5-44ef-bcb0-df47b7050103 None admin] PATH_INFO: `/v3/groups/992b227cc746425c8ed0d87484b8ec37` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:46.114237 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec2154-c0e5-44ef-bcb0-df47b7050103 None admin] RBAC: Authorizing `identity:get_group(group_id=992b227cc746425c8ed0d87484b8ec37)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:46.115668 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec2154-c0e5-44ef-bcb0-df47b7050103 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:46.117809 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 223/444] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 19:38:45 2022] GET /identity/v3/groups/992b227cc746425c8ed0d87484b8ec37 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:46.118563 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec2154-c0e5-44ef-bcb0-df47b7050103 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:46.129847 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:46.138943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3d224-5078-4acf-b0d2-684f41cafc39 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:46.173073 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943be2d-556d-4555-853f-f2d13700b1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:46.173878 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943be2d-556d-4555-853f-f2d13700b1b7 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:46.174388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943be2d-556d-4555-853f-f2d13700b1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:46.174498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943be2d-556d-4555-853f-f2d13700b1b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:46.184935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943be2d-556d-4555-853f-f2d13700b1b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:46.192514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-2943be2d-556d-4555-853f-f2d13700b1b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:38:46.192514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:46.192514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:46.192514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:46.192514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:46.192514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:46.192514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:46.192514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:46.192514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:46.192514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:46.192514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:46.192514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:46.192514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:46.192514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:46.192514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:46.192514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:46.193673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:46.193673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:46.193673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:46.193673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:46.193673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:46.193673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:46.193673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:46.193673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:46.193673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:46.193673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:46.193673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:46.193673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:46.193673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:46.193673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:46.193673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:46.193673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:46.194538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:46.194538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:46.194538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:46.194538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:46.194538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:46.194538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:46.194538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:46.194538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:46.194538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:46.194538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:46.194538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:38:46.194538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:46.194538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 222/445] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:38:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:46.196275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943be2d-556d-4555-853f-f2d13700b1b7 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:46.222063 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec2154-c0e5-44ef-bcb0-df47b7050103 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:46.252363 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:46.257689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297424d-ca61-4093-9169-221418521ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:46.258347 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297424d-ca61-4093-9169-221418521ed8 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:46.258633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297424d-ca61-4093-9169-221418521ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:46.258913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297424d-ca61-4093-9169-221418521ed8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:46.293621 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943be2d-556d-4555-853f-f2d13700b1b7 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:46.325722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297424d-ca61-4093-9169-221418521ed8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:46.327197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297424d-ca61-4093-9169-221418521ed8 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:46.327504 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2b844-4f1e-48cf-8c84-211ee3411642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:46.328206 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2b844-4f1e-48cf-8c84-211ee3411642 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:46.328452 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2b844-4f1e-48cf-8c84-211ee3411642 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:46.328730 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2b844-4f1e-48cf-8c84-211ee3411642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:46.329604 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2b844-4f1e-48cf-8c84-211ee3411642 None admin] RBAC: Adding query filter params (group.id=992b227cc746425c8ed0d87484b8ec37, role.id=f0bb7fa65c8545699b60f857f930b078, scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:46.329919 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2b844-4f1e-48cf-8c84-211ee3411642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:46.331337 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2b844-4f1e-48cf-8c84-211ee3411642 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:46.337544 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 223/446] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 23 19:38:46 2022] GET /identity/v3/role_assignments?group.id=992b227cc746425c8ed0d87484b8ec37&scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564&role.id=f0bb7fa65c8545699b60f857f930b078 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:46.338460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2b844-4f1e-48cf-8c84-211ee3411642 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:46.361306 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:46.446477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 224/447] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:46.452148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297424d-ca61-4093-9169-221418521ed8 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:46.462872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2b844-4f1e-48cf-8c84-211ee3411642 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:46.484421 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:46.505140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba412e-18c3-4ecc-b233-39fc0c4c6401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:46.505140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba412e-18c3-4ecc-b233-39fc0c4c6401 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:46.505443 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba412e-18c3-4ecc-b233-39fc0c4c6401 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:46.505617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba412e-18c3-4ecc-b233-39fc0c4c6401 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:46.506379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba412e-18c3-4ecc-b233-39fc0c4c6401 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:46.506694 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba412e-18c3-4ecc-b233-39fc0c4c6401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:46.509053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba412e-18c3-4ecc-b233-39fc0c4c6401 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:46.517783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 224/448] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:46.525116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba412e-18c3-4ecc-b233-39fc0c4c6401 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:46.565450 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297424d-ca61-4093-9169-221418521ed8 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:46.600514 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bc61c-50a8-4727-a207-6248e6a72d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:46.602029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bc61c-50a8-4727-a207-6248e6a72d4b None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:46.602313 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bc61c-50a8-4727-a207-6248e6a72d4b None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:46.602589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bc61c-50a8-4727-a207-6248e6a72d4b None admin] PATH_INFO: `/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:46.603768 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bc61c-50a8-4727-a207-6248e6a72d4b None admin] RBAC: Authorizing `identity:get_project(project_id=3ffde5ab0f994cd5b8e67d5092a69564)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:46.605228 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bc61c-50a8-4727-a207-6248e6a72d4b None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:46.606921 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 225/449] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:46 2022] GET /identity/v3/projects/3ffde5ab0f994cd5b8e67d5092a69564 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:46.608875 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:46.612310 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bc61c-50a8-4727-a207-6248e6a72d4b None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:46.629789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba412e-18c3-4ecc-b233-39fc0c4c6401 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:46.664941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c9ff4-8a54-40c1-9215-bbde05d625a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:46.665610 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c9ff4-8a54-40c1-9215-bbde05d625a5 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:46.665893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c9ff4-8a54-40c1-9215-bbde05d625a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:46.666167 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c9ff4-8a54-40c1-9215-bbde05d625a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:46.711483 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:46.714467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bc61c-50a8-4727-a207-6248e6a72d4b None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:46.734253 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c9ff4-8a54-40c1-9215-bbde05d625a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:46.735700 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c9ff4-8a54-40c1-9215-bbde05d625a5 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:46.747386 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb9b44-e5bc-41c4-bc12-adc76cd80718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:46.748281 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb9b44-e5bc-41c4-bc12-adc76cd80718 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:46.748754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb9b44-e5bc-41c4-bc12-adc76cd80718 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:46.749098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb9b44-e5bc-41c4-bc12-adc76cd80718 None admin] PATH_INFO: `/v3/groups/992b227cc746425c8ed0d87484b8ec37` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:46.750745 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb9b44-e5bc-41c4-bc12-adc76cd80718 None admin] RBAC: Authorizing `identity:get_group(group_id=992b227cc746425c8ed0d87484b8ec37)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:46.752207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb9b44-e5bc-41c4-bc12-adc76cd80718 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:46.754032 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 226/450] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 19:38:46 2022] GET /identity/v3/groups/992b227cc746425c8ed0d87484b8ec37 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:46.760089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb9b44-e5bc-41c4-bc12-adc76cd80718 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:46.813176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:46.836517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 225/451] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 19:38:46.841980 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c9ff4-8a54-40c1-9215-bbde05d625a5 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:46.859285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb9b44-e5bc-41c4-bc12-adc76cd80718 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:46.894823 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10eb1b2-8e02-4899-91f7-6ddec37765d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:46.897722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10eb1b2-8e02-4899-91f7-6ddec37765d1 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:46.897722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10eb1b2-8e02-4899-91f7-6ddec37765d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:46.897722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10eb1b2-8e02-4899-91f7-6ddec37765d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:46.897722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10eb1b2-8e02-4899-91f7-6ddec37765d1 None admin] RBAC: Adding query filter params (group.id=992b227cc746425c8ed0d87484b8ec37, role.id=61895d866a7c44de8924486b8e5ec6e8, scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:46.897722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10eb1b2-8e02-4899-91f7-6ddec37765d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:46.898841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10eb1b2-8e02-4899-91f7-6ddec37765d1 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:46.904682 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 227/452] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 23 19:38:46 2022] GET /identity/v3/role_assignments?group.id=992b227cc746425c8ed0d87484b8ec37&scope.project.id=3ffde5ab0f994cd5b8e67d5092a69564&role.id=61895d866a7c44de8924486b8e5ec6e8 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:46.946134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c9ff4-8a54-40c1-9215-bbde05d625a5 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:46.981849 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54aa1d-9a1d-4b8b-b62f-492bce6cd78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:46.982745 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54aa1d-9a1d-4b8b-b62f-492bce6cd78c None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:46.983017 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54aa1d-9a1d-4b8b-b62f-492bce6cd78c None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:46.983294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54aa1d-9a1d-4b8b-b62f-492bce6cd78c None admin] PATH_INFO: `/v3/projects/50703062c6ac410a8cc7e1c87c4ecbac` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:46.984549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54aa1d-9a1d-4b8b-b62f-492bce6cd78c None admin] RBAC: Authorizing `identity:get_project(project_id=50703062c6ac410a8cc7e1c87c4ecbac)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:46.986065 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54aa1d-9a1d-4b8b-b62f-492bce6cd78c None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:46.987820 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 226/453] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:38:46 2022] GET /identity/v3/projects/50703062c6ac410a8cc7e1c87c4ecbac => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:46.994033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10eb1b2-8e02-4899-91f7-6ddec37765d1 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:47.026258 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:47.097990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10eb1b2-8e02-4899-91f7-6ddec37765d1 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:47.132653 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e2c7b-ccd2-4f1d-a8b3-dd447683f7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:47.133516 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e2c7b-ccd2-4f1d-a8b3-dd447683f7bc None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:47.133802 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e2c7b-ccd2-4f1d-a8b3-dd447683f7bc None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:47.134075 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e2c7b-ccd2-4f1d-a8b3-dd447683f7bc None admin] PATH_INFO: `/v3/groups/f6147af4c4954719b96cd2a4812d5056` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:47.135230 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e2c7b-ccd2-4f1d-a8b3-dd447683f7bc None admin] RBAC: Authorizing `identity:get_group(group_id=f6147af4c4954719b96cd2a4812d5056)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:47.136659 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e2c7b-ccd2-4f1d-a8b3-dd447683f7bc None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:47.138305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 228/454] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 19:38:46 2022] GET /identity/v3/groups/f6147af4c4954719b96cd2a4812d5056 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:47.144338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54aa1d-9a1d-4b8b-b62f-492bce6cd78c None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:47.198273 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:47.253459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54aa1d-9a1d-4b8b-b62f-492bce6cd78c None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:47.287931 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d50a01-8e7e-42ed-83af-24188d084aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:47.288616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d50a01-8e7e-42ed-83af-24188d084aa3 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:47.289082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d50a01-8e7e-42ed-83af-24188d084aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:47.289395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d50a01-8e7e-42ed-83af-24188d084aa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:47.290232 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d50a01-8e7e-42ed-83af-24188d084aa3 None admin] RBAC: Adding query filter params (group.id=f6147af4c4954719b96cd2a4812d5056, role.id=76bd0cf7bf094e4fa3db121b96215004, scope.project.id=50703062c6ac410a8cc7e1c87c4ecbac) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:47.290546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d50a01-8e7e-42ed-83af-24188d084aa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:47.291998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d50a01-8e7e-42ed-83af-24188d084aa3 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:47.297907 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 227/455] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 23 19:38:47 2022] GET /identity/v3/role_assignments?group.id=f6147af4c4954719b96cd2a4812d5056&scope.project.id=50703062c6ac410a8cc7e1c87c4ecbac&role.id=76bd0cf7bf094e4fa3db121b96215004 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:49.864999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39d61d-4e1c-4d3b-80d7-02337ff7aa2c None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:49.866068 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39d61d-4e1c-4d3b-80d7-02337ff7aa2c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:49.867156 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39d61d-4e1c-4d3b-80d7-02337ff7aa2c None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:49.869028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 229/456] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:49.880313 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8bec3-eddf-4274-b9b1-cd3e1ef74878 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:49.881218 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8bec3-eddf-4274-b9b1-cd3e1ef74878 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:49.881723 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8bec3-eddf-4274-b9b1-cd3e1ef74878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:49.914173 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-c2c8bec3-eddf-4274-b9b1-cd3e1ef74878 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:49.915714 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c2c8bec3-eddf-4274-b9b1-cd3e1ef74878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:49.952555 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20eee4-2236-4a8f-a31d-9f1a132e09b2 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:49.953215 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20eee4-2236-4a8f-a31d-9f1a132e09b2 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:49.953696 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20eee4-2236-4a8f-a31d-9f1a132e09b2 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:49.955533 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 230/457] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:49.960141 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dc994-61b3-428f-956c-e4bdbd1e75b4 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:49.960575 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dc994-61b3-428f-956c-e4bdbd1e75b4 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:49.961212 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dc994-61b3-428f-956c-e4bdbd1e75b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:49.988222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-8f2dc994-61b3-428f-956c-e4bdbd1e75b4 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:49.989462 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-8f2dc994-61b3-428f-956c-e4bdbd1e75b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:50.030710 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 228/458] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:38:50.081786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8bec3-eddf-4274-b9b1-cd3e1ef74878 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:50.122442 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 231/459] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:50.146584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dc994-61b3-428f-956c-e4bdbd1e75b4 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:50.164591 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:50.198604 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:50.287338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8bec3-eddf-4274-b9b1-cd3e1ef74878 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:50.313547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dc994-61b3-428f-956c-e4bdbd1e75b4 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:50.339776 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5d2a3-33de-4d8b-b9c0-ab0ce75751fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:50.340581 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5d2a3-33de-4d8b-b9c0-ab0ce75751fe None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:50.340843 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5d2a3-33de-4d8b-b9c0-ab0ce75751fe None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:50.341300 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5d2a3-33de-4d8b-b9c0-ab0ce75751fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:50.352421 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935638bf-c82d-4e38-bbc4-781181deef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:50.352628 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5d2a3-33de-4d8b-b9c0-ab0ce75751fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:50.353699 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935638bf-c82d-4e38-bbc4-781181deef71 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:50.354027 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5d2a3-33de-4d8b-b9c0-ab0ce75751fe None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:50.354501 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935638bf-c82d-4e38-bbc4-781181deef71 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:50.355047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935638bf-c82d-4e38-bbc4-781181deef71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:50.366005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935638bf-c82d-4e38-bbc4-781181deef71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:50.367766 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935638bf-c82d-4e38-bbc4-781181deef71 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:50.373019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-1bd5d2a3-33de-4d8b-b9c0-ab0ce75751fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:50.373019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:50.373019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:50.373019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:50.373019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:50.373019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:50.373019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:50.373019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:50.373019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:50.373019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:50.373019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:50.373019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:50.373019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:38:50.373019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:38:50.373019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:38:50.373893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:38:50.373893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:50.373893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:50.373893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:50.373893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:50.373893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:50.373893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:50.373893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:50.373893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:50.373893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:50.373893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:50.373893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:50.373893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:50.373893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:50.373893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:50.373893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:50.373893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:50.374741 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:38:50.374741 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:38:50.374741 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:50.374741 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:50.374741 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 229/460] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:38:50.375898 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43264b8-9f70-4e94-aa2e-d6f9307734ab None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:50.376178 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43264b8-9f70-4e94-aa2e-d6f9307734ab None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:50.376454 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43264b8-9f70-4e94-aa2e-d6f9307734ab None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:50.377959 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 230/461] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:50.379795 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43264b8-9f70-4e94-aa2e-d6f9307734ab None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:50.390681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-935638bf-c82d-4e38-bbc4-781181deef71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:50.390681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:50.390681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:50.390681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:50.390681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:50.390681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:50.390681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:50.390681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:50.390681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:50.390681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:50.390681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:50.390681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:50.390681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:38:50.390681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:38:50.390681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:38:50.391776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:38:50.391776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:50.391776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:50.391776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:50.391776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:50.391776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:50.391776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:50.391776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:50.391776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:50.391776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:50.391776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:50.391776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:50.391776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:50.391776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:50.391776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:50.391776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:50.391776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:50.392654 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:38:50.392654 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:38:50.392654 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:50.392654 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:50.394853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 232/462] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:50.396251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095ad78-2a1b-4281-bd91-ed3b3d33cc00 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:50.396743 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095ad78-2a1b-4281-bd91-ed3b3d33cc00 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:50.397219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095ad78-2a1b-4281-bd91-ed3b3d33cc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:50.415064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-2095ad78-2a1b-4281-bd91-ed3b3d33cc00 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:50.416538 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-2095ad78-2a1b-4281-bd91-ed3b3d33cc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:50.482964 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:50.487774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 233/463] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:50.488968 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095ad78-2a1b-4281-bd91-ed3b3d33cc00 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:50.494267 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43264b8-9f70-4e94-aa2e-d6f9307734ab None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:50.505408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:50.533353 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01e0e2-8b20-4135-a551-9b61c24e009c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:50.534016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01e0e2-8b20-4135-a551-9b61c24e009c None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:50.534300 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01e0e2-8b20-4135-a551-9b61c24e009c None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:50.534576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01e0e2-8b20-4135-a551-9b61c24e009c None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:50.535338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01e0e2-8b20-4135-a551-9b61c24e009c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:50.535646 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01e0e2-8b20-4135-a551-9b61c24e009c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:50.537008 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01e0e2-8b20-4135-a551-9b61c24e009c None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:50.548895 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 231/464] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:50.550634 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1d3e0-e48b-478d-bf8d-c21cc8d59f7c None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:50.550932 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1d3e0-e48b-478d-bf8d-c21cc8d59f7c None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:50.551220 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1d3e0-e48b-478d-bf8d-c21cc8d59f7c None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:50.552454 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 232/465] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:50.553475 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1d3e0-e48b-478d-bf8d-c21cc8d59f7c None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:50.599872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095ad78-2a1b-4281-bd91-ed3b3d33cc00 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:50.637434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0531b-eaf2-48e7-96df-9fe810634a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:50.638111 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0531b-eaf2-48e7-96df-9fe810634a7b None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:50.638512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0531b-eaf2-48e7-96df-9fe810634a7b None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:50.638791 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0531b-eaf2-48e7-96df-9fe810634a7b None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:50.639632 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0531b-eaf2-48e7-96df-9fe810634a7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:50.639940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0531b-eaf2-48e7-96df-9fe810634a7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:50.641337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0531b-eaf2-48e7-96df-9fe810634a7b None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:50.654336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 234/466] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:50.658882 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1d3e0-e48b-478d-bf8d-c21cc8d59f7c None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:50.659629 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0531b-eaf2-48e7-96df-9fe810634a7b None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:50.703255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8167e-fc1b-4c3a-80cc-01ffc46d750d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:50.704574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8167e-fc1b-4c3a-80cc-01ffc46d750d None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:50.705052 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8167e-fc1b-4c3a-80cc-01ffc46d750d None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:50.705561 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8167e-fc1b-4c3a-80cc-01ffc46d750d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:50.716954 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8167e-fc1b-4c3a-80cc-01ffc46d750d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:50.718452 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8167e-fc1b-4c3a-80cc-01ffc46d750d None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:50.733815 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:50.736290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-e1b8167e-fc1b-4c3a-80cc-01ffc46d750d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:50.736290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:50.736290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:50.736290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:50.736290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:50.736290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:50.736290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:50.736290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:50.736290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:50.736290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:50.736290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:50.736290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:50.736290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:38:50.736290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:38:50.736290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:38:50.737117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:38:50.737117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:50.737117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:50.737117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:50.737117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:50.737117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:50.737117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:50.737117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:50.737117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:50.737117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:50.737117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:50.737117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:50.737117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:50.737117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:50.737117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:50.737117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:50.737117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:50.747943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:38:50.747943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:38:50.747943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:50.747943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:50.747943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 233/467] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:50.747943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9806b4-8c59-4580-87f6-873f8e6d9196 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:50.747943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9806b4-8c59-4580-87f6-873f8e6d9196 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:50.747943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9806b4-8c59-4580-87f6-873f8e6d9196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:50.747943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:50.759317 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-bc9806b4-8c59-4580-87f6-873f8e6d9196 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:50.760520 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-bc9806b4-8c59-4580-87f6-873f8e6d9196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:50.770286 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0531b-eaf2-48e7-96df-9fe810634a7b None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:50.809198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf5ea7-a0ad-4926-a3c2-596607c55396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:50.809865 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf5ea7-a0ad-4926-a3c2-596607c55396 None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:50.810157 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf5ea7-a0ad-4926-a3c2-596607c55396 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:50.810448 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf5ea7-a0ad-4926-a3c2-596607c55396 None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:50.811119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf5ea7-a0ad-4926-a3c2-596607c55396 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:50.812644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf5ea7-a0ad-4926-a3c2-596607c55396 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:50.829713 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 234/468] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:50.833355 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9806b4-8c59-4580-87f6-873f8e6d9196 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:50.931100 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9806b4-8c59-4580-87f6-873f8e6d9196 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:50.944941 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 235/469] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 19:38:50 2022] POST /identity/v3/users => generated 246 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:38:50.944941 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf5ea7-a0ad-4926-a3c2-596607c55396 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:50.984849 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397ff60-77a6-45c4-a7fd-c509be5ee48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:50.985574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397ff60-77a6-45c4-a7fd-c509be5ee48b None admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:50.986151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397ff60-77a6-45c4-a7fd-c509be5ee48b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:50.986515 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397ff60-77a6-45c4-a7fd-c509be5ee48b None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:50.988284 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397ff60-77a6-45c4-a7fd-c509be5ee48b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:50.989840 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397ff60-77a6-45c4-a7fd-c509be5ee48b None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:50.999250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:51.064714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf5ea7-a0ad-4926-a3c2-596607c55396 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:51.094828 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:51.102935 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996da49-cd56-4940-b5ba-671096fb9f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:51.103609 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996da49-cd56-4940-b5ba-671096fb9f02 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:51.103895 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996da49-cd56-4940-b5ba-671096fb9f02 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:51.104176 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996da49-cd56-4940-b5ba-671096fb9f02 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:51.104931 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996da49-cd56-4940-b5ba-671096fb9f02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:51.105249 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996da49-cd56-4940-b5ba-671096fb9f02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:51.106654 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996da49-cd56-4940-b5ba-671096fb9f02 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:51.125585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 236/470] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:51.125784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 235/471] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 19:38:50 2022] POST /identity/v3/users => generated 248 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:38:51.125937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996da49-cd56-4940-b5ba-671096fb9f02 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:51.132704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db4add-a055-4dad-aa71-a1cd818f8be6 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:51.132994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db4add-a055-4dad-aa71-a1cd818f8be6 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:51.133356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db4add-a055-4dad-aa71-a1cd818f8be6 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:51.142107 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 236/472] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:51 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:51.142952 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db4add-a055-4dad-aa71-a1cd818f8be6 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:51.285431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996da49-cd56-4940-b5ba-671096fb9f02 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:51.286805 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db4add-a055-4dad-aa71-a1cd818f8be6 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:51.330766 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bdd23-50e1-49ce-a1c2-620c7c6024ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:51.331440 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bdd23-50e1-49ce-a1c2-620c7c6024ed None admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:51.331722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bdd23-50e1-49ce-a1c2-620c7c6024ed None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:51.331998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bdd23-50e1-49ce-a1c2-620c7c6024ed None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:51.332702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bdd23-50e1-49ce-a1c2-620c7c6024ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:51.332941 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c9743-d1cc-4ca7-9da3-edc7e5f003a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:51.333984 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c9743-d1cc-4ca7-9da3-edc7e5f003a0 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:51.334322 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bdd23-50e1-49ce-a1c2-620c7c6024ed None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:51.335734 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c9743-d1cc-4ca7-9da3-edc7e5f003a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:51.335734 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c9743-d1cc-4ca7-9da3-edc7e5f003a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:51.347312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c9743-d1cc-4ca7-9da3-edc7e5f003a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:51.348965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c9743-d1cc-4ca7-9da3-edc7e5f003a0 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:51.368698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-9f5c9743-d1cc-4ca7-9da3-edc7e5f003a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:51.368698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:51.368698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:51.368698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:51.368698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:51.368698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:51.368698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:51.368698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:51.368698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:51.368698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:51.368698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:51.368698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:51.368698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:38:51.368698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:38:51.368698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:38:51.369652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:38:51.369652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:51.369652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:51.369652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:51.369652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:51.369652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:51.369652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:51.369652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:51.369652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:51.369652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:51.369652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:51.369652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:51.369652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:51.369652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:51.369652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:51.369652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:51.369652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:51.370483 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:38:51.370483 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:38:51.370483 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:51.370483 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:51.370483 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 237/473] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:51.372013 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe846f-3203-4367-89e7-8857ebb1b2c7 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:51.372370 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe846f-3203-4367-89e7-8857ebb1b2c7 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:51.372709 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe846f-3203-4367-89e7-8857ebb1b2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:51.391862 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-2dfe846f-3203-4367-89e7-8857ebb1b2c7 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:51.393083 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-2dfe846f-3203-4367-89e7-8857ebb1b2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:51.431107 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:51.446639 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 237/474] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 19:38:51 2022] POST /identity/v3/users => generated 248 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:38:51.447539 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bdd23-50e1-49ce-a1c2-620c7c6024ed None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:51.482317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 238/475] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:51.521087 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe846f-3203-4367-89e7-8857ebb1b2c7 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:51.523789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:51.625917 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bdd23-50e1-49ce-a1c2-620c7c6024ed None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:51.672506 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34341851-992b-42c4-ac31-d414d5932bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:51.673467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34341851-992b-42c4-ac31-d414d5932bb7 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:51.675100 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34341851-992b-42c4-ac31-d414d5932bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:51.675530 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34341851-992b-42c4-ac31-d414d5932bb7 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:51.677556 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34341851-992b-42c4-ac31-d414d5932bb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:51.678456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34341851-992b-42c4-ac31-d414d5932bb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:51.681610 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34341851-992b-42c4-ac31-d414d5932bb7 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:51.696183 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 238/476] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:51.702999 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34341851-992b-42c4-ac31-d414d5932bb7 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:51.740452 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe846f-3203-4367-89e7-8857ebb1b2c7 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:51.791296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c7975-ec38-47e8-b222-82994e63bb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:51.791978 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c7975-ec38-47e8-b222-82994e63bb25 None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:51.792259 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c7975-ec38-47e8-b222-82994e63bb25 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:51.792596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c7975-ec38-47e8-b222-82994e63bb25 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:51.793650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c7975-ec38-47e8-b222-82994e63bb25 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:51.795894 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c7975-ec38-47e8-b222-82994e63bb25 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:51.833582 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34341851-992b-42c4-ac31-d414d5932bb7 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:51.834589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.sql.core [None req-5c6c7975-ec38-47e8-b222-82994e63bb25 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 19:38:51.834589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 19:38:51.834589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [parameters: {'id': '826b0876cbe9479e9e242de459d755a4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 19:38:51.834589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91966) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 19:38:51.842786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:51.856852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-5c6c7975-ec38-47e8-b222-82994e63bb25 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 19:38:51.856852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:51.856852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 19:38:51.856852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 19:38:51.856852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 19:38:51.856852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 19:38:51.856852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 19:38:51.856852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 19:38:51.856852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 19:38:51.856852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application conn.query(q) Jun 23 19:38:51.856852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 19:38:51.856852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 19:38:51.856852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 19:38:51.856852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application result.read() Jun 23 19:38:51.856852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 19:38:51.857795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 19:38:51.857795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 19:38:51.857795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 19:38:51.857795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 19:38:51.857795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 19:38:51.857795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 19:38:51.857795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 19:38:51.857795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 19:38:51.857795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:51.857795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 19:38:51.857795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:51.857795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:51.857795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 19:38:51.857795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 19:38:51.857795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 23 19:38:51.857795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return ref.to_dict() Jun 23 19:38:51.857795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 19:38:51.857795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application next(self.gen) Jun 23 19:38:51.858727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 19:38:51.858727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application yield resource Jun 23 19:38:51.858727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 19:38:51.858727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application next(self.gen) Jun 23 19:38:51.858727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 19:38:51.858727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 19:38:51.858727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 19:38:51.858727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 19:38:51.858727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 19:38:51.858727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise self.value Jun 23 19:38:51.858727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 19:38:51.858727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 19:38:51.858727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 19:38:51.858727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application session.commit() Jun 23 19:38:51.858727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 19:38:51.858727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 19:38:51.858727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 19:38:51.859566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 19:38:51.859566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 19:38:51.859566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self.session.flush() Jun 23 19:38:51.859566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 19:38:51.859566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 19:38:51.859566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 19:38:51.859566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 19:38:51.859566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 19:38:51.859566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application compat.raise_( Jun 23 19:38:51.859566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 19:38:51.859566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception Jun 23 19:38:51.859566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 19:38:51.859566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 19:38:51.859566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 19:38:51.859566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 19:38:51.859566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 19:38:51.859566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 19:38:51.860445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 19:38:51.860445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 19:38:51.860445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 19:38:51.860445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 19:38:51.860445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 19:38:51.860445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 19:38:51.860445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 19:38:51.860445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 19:38:51.860445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 19:38:51.860445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 19:38:51.860445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 19:38:51.860445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 19:38:51.860445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 19:38:51.860445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 19:38:51.860445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 19:38:51.860445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception Jun 23 19:38:51.861280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 19:38:51.861280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 19:38:51.861280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 19:38:51.861280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 19:38:51.861280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 19:38:51.861280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 19:38:51.861280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 19:38:51.861280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application conn.query(q) Jun 23 19:38:51.861280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 19:38:51.861280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 19:38:51.861280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 19:38:51.861280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application result.read() Jun 23 19:38:51.861280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 19:38:51.861280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 19:38:51.861280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 19:38:51.861280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 19:38:51.862511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 19:38:51.862511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 19:38:51.862511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 19:38:51.862511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 19:38:51.862511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 19:38:51.862511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 19:38:51.862511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [parameters: {'id': '826b0876cbe9479e9e242de459d755a4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 19:38:51.862511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 19:38:51.862511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:51.862511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:38:51.862511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:51.862511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:51.862511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:51.862511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:51.862511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:51.862511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:51.864431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:51.864431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:51.864431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:51.864431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:51.864431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:51.864431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:51.864431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 23 19:38:51.864431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 23 19:38:51.864431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:51.864431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:51.864431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 23 19:38:51.864431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 23 19:38:51.864431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 19:38:51.864431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 19:38:51.864431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 19:38:51.864431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:51.867018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 239/477] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Jun 23 19:38:51 2022] POST /identity/v3/roles => generated 144 bytes in 338 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:38:51.873291 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c7975-ec38-47e8-b222-82994e63bb25 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:51.890787 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03caa5c6-0c76-4392-8b08-b3fcfa1cb125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:51.891480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caa5c6-0c76-4392-8b08-b3fcfa1cb125 None admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:51.891781 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caa5c6-0c76-4392-8b08-b3fcfa1cb125 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:51.892068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caa5c6-0c76-4392-8b08-b3fcfa1cb125 None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:51.893785 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03caa5c6-0c76-4392-8b08-b3fcfa1cb125 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:51.894550 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03caa5c6-0c76-4392-8b08-b3fcfa1cb125 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:51.987227 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:52.047863 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 239/478] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 19:38:51 2022] POST /identity/v3/users => generated 249 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:38:52.055608 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c7975-ec38-47e8-b222-82994e63bb25 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:52.093510 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a63433-1f72-4a2b-80d5-51115051f250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:52.094651 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a63433-1f72-4a2b-80d5-51115051f250 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:52.095096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a63433-1f72-4a2b-80d5-51115051f250 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:52.095638 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a63433-1f72-4a2b-80d5-51115051f250 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:52.107657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a63433-1f72-4a2b-80d5-51115051f250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:52.116066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-26a63433-1f72-4a2b-80d5-51115051f250 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:52.116066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:52.116066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:52.116066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:52.116066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:52.116066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:52.116066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:52.116066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:52.116066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:52.116066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:52.116066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:52.116066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:52.116066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:52.116066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:52.116066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:52.116066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:52.117521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:52.117521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:52.117521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:52.117521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:52.117521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:52.117521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:52.117521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:52.117521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:52.117521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:52.117521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:52.117521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:52.117521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:52.117521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:52.117521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:52.117521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:52.117521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:52.118315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:52.118315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:52.118315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:52.118315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:52.118315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:52.118315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:52.118315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:52.118315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:52.118315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:52.118315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:52.118315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 19:38:52.118315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:52.121196 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 240/479] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:38:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:52.126834 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03caa5c6-0c76-4392-8b08-b3fcfa1cb125 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:52.294160 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03caa5c6-0c76-4392-8b08-b3fcfa1cb125 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:52.332400 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3c97a-4237-4318-a8e4-54d10b9cddaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:52.333475 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3c97a-4237-4318-a8e4-54d10b9cddaa None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:52.333956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3c97a-4237-4318-a8e4-54d10b9cddaa None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:52.334425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3c97a-4237-4318-a8e4-54d10b9cddaa None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:52.335459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3c97a-4237-4318-a8e4-54d10b9cddaa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:52.335968 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3c97a-4237-4318-a8e4-54d10b9cddaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:52.337575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3c97a-4237-4318-a8e4-54d10b9cddaa None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:52.346624 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 240/480] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:38:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:53.383901 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e6b38-4db0-4657-950a-0c293042b228 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:53.384472 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e6b38-4db0-4657-950a-0c293042b228 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:53.384472 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e6b38-4db0-4657-950a-0c293042b228 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:53.386028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 241/481] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:53.391492 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b6916-b2e5-4897-babf-0fc19530e6fa None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:53.391915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b6916-b2e5-4897-babf-0fc19530e6fa None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:53.392096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b6916-b2e5-4897-babf-0fc19530e6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:53.418145 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-2b9b6916-b2e5-4897-babf-0fc19530e6fa None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:53.419355 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-2b9b6916-b2e5-4897-babf-0fc19530e6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:53.441623 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:53.520924 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 241/482] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:38:53.558064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9c9ae-3f62-47c4-8b1e-23c4e6ed0162 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:53.558354 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9c9ae-3f62-47c4-8b1e-23c4e6ed0162 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:53.558641 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9c9ae-3f62-47c4-8b1e-23c4e6ed0162 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:53.560225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 242/483] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:53.561259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b6916-b2e5-4897-babf-0fc19530e6fa None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:53.574627 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcb905-b2b4-4804-8683-14d287e2e19a None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:53.575142 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcb905-b2b4-4804-8683-14d287e2e19a None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:53.575570 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcb905-b2b4-4804-8683-14d287e2e19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:53.608813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-24fcb905-b2b4-4804-8683-14d287e2e19a None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:53.610368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-24fcb905-b2b4-4804-8683-14d287e2e19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:53.706489 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b6916-b2e5-4897-babf-0fc19530e6fa None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:53.738916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 243/484] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:53.760588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d7618-692b-4687-8e5d-4f2d7f98fbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:53.761694 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d7618-692b-4687-8e5d-4f2d7f98fbb5 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:53.762118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d7618-692b-4687-8e5d-4f2d7f98fbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:53.762532 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d7618-692b-4687-8e5d-4f2d7f98fbb5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:53.774157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d7618-692b-4687-8e5d-4f2d7f98fbb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:53.783268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-d79d7618-692b-4687-8e5d-4f2d7f98fbb5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:38:53.783268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:53.783268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:53.783268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:53.783268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:53.783268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:53.783268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:53.783268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:53.783268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:53.783268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:53.783268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:53.783268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:53.783268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:53.783268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:53.783268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:53.783268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:53.784409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:53.784409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:53.784409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:53.784409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:53.784409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:53.784409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:53.784409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:53.784409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:53.784409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:53.784409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:53.784409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:53.784409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:53.784409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:53.784409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:53.784409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:53.784409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:53.785214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:53.785214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:53.785214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:53.785214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:53.785214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:53.785214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:53.785214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:53.785214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:53.785214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:53.785214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:53.785214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:38:53.785214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:53.787694 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcb905-b2b4-4804-8683-14d287e2e19a None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:53.803089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 242/485] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:38:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:53.805400 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d7618-692b-4687-8e5d-4f2d7f98fbb5 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:53.832079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:53.840265 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:53.993108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcb905-b2b4-4804-8683-14d287e2e19a None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:53.995504 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d7618-692b-4687-8e5d-4f2d7f98fbb5 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:54.032640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a8373-aea1-4efa-b38f-e901cc7b64c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:54.033350 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a8373-aea1-4efa-b38f-e901cc7b64c4 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:54.033634 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a8373-aea1-4efa-b38f-e901cc7b64c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:54.033911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a8373-aea1-4efa-b38f-e901cc7b64c4 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:54.034648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a8373-aea1-4efa-b38f-e901cc7b64c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:54.034956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a8373-aea1-4efa-b38f-e901cc7b64c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:54.036342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a8373-aea1-4efa-b38f-e901cc7b64c4 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:54.045259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 243/486] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:38:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:54.050326 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a8373-aea1-4efa-b38f-e901cc7b64c4 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:54.073866 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019697a-5924-47db-9f2e-9c0a22c71ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:54.074675 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019697a-5924-47db-9f2e-9c0a22c71ff9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:54.074961 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019697a-5924-47db-9f2e-9c0a22c71ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:54.075238 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019697a-5924-47db-9f2e-9c0a22c71ff9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:54.103165 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019697a-5924-47db-9f2e-9c0a22c71ff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:54.110900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-5019697a-5924-47db-9f2e-9c0a22c71ff9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:38:54.110900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:54.110900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:54.110900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:54.110900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:54.110900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:54.110900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:54.110900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:54.110900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:54.110900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:54.110900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:54.110900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:54.110900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:54.110900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:54.110900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:54.110900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:54.111790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:54.111790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:54.111790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:54.111790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:54.111790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:54.111790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:54.111790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:54.111790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:54.111790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:54.111790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:54.111790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:54.111790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:54.111790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:54.111790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:54.111790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:54.111790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:54.112588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:54.112588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:54.112588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:54.112588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:54.112588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:54.112588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:54.112588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:54.112588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:54.112588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:54.112588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:54.112588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:38:54.112588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:54.116994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 244/487] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:38:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:54.118220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019697a-5924-47db-9f2e-9c0a22c71ff9 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:54.135556 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:54.166620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a8373-aea1-4efa-b38f-e901cc7b64c4 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:54.228603 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a1097-a44f-4166-91e3-0f37859c575d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:54.230386 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a1097-a44f-4166-91e3-0f37859c575d None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:54.230386 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a1097-a44f-4166-91e3-0f37859c575d None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:54.230386 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a1097-a44f-4166-91e3-0f37859c575d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:54.248102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a1097-a44f-4166-91e3-0f37859c575d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:54.248989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a1097-a44f-4166-91e3-0f37859c575d None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:54.262593 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:54.267871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-3c2a1097-a44f-4166-91e3-0f37859c575d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:54.267871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:54.267871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:54.267871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:54.267871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:54.267871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:54.267871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:54.267871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:54.267871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:54.267871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:54.267871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:54.267871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:54.267871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:38:54.267871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:38:54.267871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:38:54.268720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:38:54.268720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:54.268720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:54.268720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:54.268720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:54.268720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:54.268720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:54.268720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:54.268720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:54.268720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:54.268720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:54.268720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:54.268720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:54.268720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:54.268720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:54.268720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:54.268720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:54.269601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:38:54.269601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:38:54.269601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:54.269601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:54.269601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 244/488] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:38:54.270625 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d5784-4ff1-4aa3-83e3-de379a9d4d45 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:54.270911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d5784-4ff1-4aa3-83e3-de379a9d4d45 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:54.271189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d5784-4ff1-4aa3-83e3-de379a9d4d45 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:54.277137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 245/489] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:54.280035 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d5784-4ff1-4aa3-83e3-de379a9d4d45 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:54.284218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019697a-5924-47db-9f2e-9c0a22c71ff9 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:54.321462 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7916f8a-5beb-4716-969f-863dc932e858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:54.322466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7916f8a-5beb-4716-969f-863dc932e858 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:54.322933 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7916f8a-5beb-4716-969f-863dc932e858 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:54.323390 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7916f8a-5beb-4716-969f-863dc932e858 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:54.324320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7916f8a-5beb-4716-969f-863dc932e858 None admin] RBAC: Adding query filter params (name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:54.324805 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7916f8a-5beb-4716-969f-863dc932e858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:54.326415 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7916f8a-5beb-4716-969f-863dc932e858 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:54.335704 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 245/490] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:38:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:54.337218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a7faf-ec96-481c-990e-628603135ac5 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:54.337688 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a7faf-ec96-481c-990e-628603135ac5 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:54.338143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a7faf-ec96-481c-990e-628603135ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:54.355180 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-141a7faf-ec96-481c-990e-628603135ac5 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:54.356638 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-141a7faf-ec96-481c-990e-628603135ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:54.422626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d5784-4ff1-4aa3-83e3-de379a9d4d45 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:54.432641 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 246/491] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:54.433659 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a7faf-ec96-481c-990e-628603135ac5 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:54.461754 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:54.470939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89c9bd-173a-45d0-af5d-3a778d6ace71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:54.472089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89c9bd-173a-45d0-af5d-3a778d6ace71 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:54.473414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89c9bd-173a-45d0-af5d-3a778d6ace71 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:54.473868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89c9bd-173a-45d0-af5d-3a778d6ace71 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:54.474772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89c9bd-173a-45d0-af5d-3a778d6ace71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:54.478983 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89c9bd-173a-45d0-af5d-3a778d6ace71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:54.478983 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89c9bd-173a-45d0-af5d-3a778d6ace71 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:54.493021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 246/492] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:54.494609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89c9bd-173a-45d0-af5d-3a778d6ace71 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:54.520947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:54.546336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a7faf-ec96-481c-990e-628603135ac5 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:54.588322 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb862bc3-7c9b-4ea8-bf5f-90534865fe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:54.589114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb862bc3-7c9b-4ea8-bf5f-90534865fe96 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:54.589427 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb862bc3-7c9b-4ea8-bf5f-90534865fe96 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:54.589704 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb862bc3-7c9b-4ea8-bf5f-90534865fe96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:54.600663 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb862bc3-7c9b-4ea8-bf5f-90534865fe96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:54.602968 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb862bc3-7c9b-4ea8-bf5f-90534865fe96 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:54.621678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-bb862bc3-7c9b-4ea8-bf5f-90534865fe96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:54.621678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:54.621678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:54.621678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:54.621678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:54.621678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:54.621678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:54.621678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:54.621678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:54.621678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:54.621678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:54.621678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:54.621678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:38:54.621678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:38:54.621678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:38:54.622584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:38:54.622584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:54.622584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:54.622584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:54.622584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:54.622584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:54.622584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:54.622584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:54.622584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:54.622584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:54.622584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:54.622584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:54.622584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:54.622584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:54.622584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:54.622584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:54.622584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:54.623441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:38:54.623441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:38:54.623441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:54.623441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:54.623441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 247/493] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:54.624170 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb862bc3-7c9b-4ea8-bf5f-90534865fe96 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:54.624646 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89c9bd-173a-45d0-af5d-3a778d6ace71 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:54.668267 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fb186-5ffa-4a8d-92ef-98346acf9727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:54.669647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fb186-5ffa-4a8d-92ef-98346acf9727 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:54.669933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fb186-5ffa-4a8d-92ef-98346acf9727 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:54.670206 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fb186-5ffa-4a8d-92ef-98346acf9727 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:54.691734 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fb186-5ffa-4a8d-92ef-98346acf9727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:54.703315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-662fb186-5ffa-4a8d-92ef-98346acf9727 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:38:54.703315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:54.703315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:54.703315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:54.703315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:54.703315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:54.703315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:54.703315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:54.703315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:54.703315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:54.703315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:54.703315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:54.703315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:54.703315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:54.703315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:54.703315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:54.704203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:54.704203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:54.704203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:54.704203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:54.704203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:54.704203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:54.704203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:54.704203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:54.704203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:54.704203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:54.704203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:54.704203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:54.704203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:54.704203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:54.704203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:54.704203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:54.704995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:54.704995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:54.704995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:54.704995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:54.704995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:54.704995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:54.704995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:54.704995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:54.704995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:54.704995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:54.704995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:38:54.704995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:54.706517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 247/494] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:38:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:54.708033 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fb186-5ffa-4a8d-92ef-98346acf9727 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:54.746853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb862bc3-7c9b-4ea8-bf5f-90534865fe96 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:54.761177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:54.781117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:54.791391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37981a6-fc8a-451d-a3ec-9477f925bc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:54.793014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37981a6-fc8a-451d-a3ec-9477f925bc38 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:54.793530 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37981a6-fc8a-451d-a3ec-9477f925bc38 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:54.794036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37981a6-fc8a-451d-a3ec-9477f925bc38 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:54.803758 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37981a6-fc8a-451d-a3ec-9477f925bc38 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:54.805977 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37981a6-fc8a-451d-a3ec-9477f925bc38 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:54.821011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fb186-5ffa-4a8d-92ef-98346acf9727 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:54.827932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-c37981a6-fc8a-451d-a3ec-9477f925bc38 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 19:38:54.827932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:54.827932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:54.827932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:54.827932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:54.827932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:54.827932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:54.827932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:54.827932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:54.827932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:54.827932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:54.827932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:54.827932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:38:54.827932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:38:54.827932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:38:54.827932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:38:54.828869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:54.828869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:54.828869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:38:54.828869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:38:54.828869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:38:54.828869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:38:54.828869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:54.828869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:54.828869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:54.828869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:54.828869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:54.828869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:54.828869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:54.828869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:54.828869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:54.828869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:54.828869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:54.828869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:54.830263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:54.830263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:54.830263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:38:54.830263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:38:54.830263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:38:54.830263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:38:54.830263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:38:54.830263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:38:54.830263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 19:38:54.830263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:54.830263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 248/495] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 23 19:38:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:54.830263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37981a6-fc8a-451d-a3ec-9477f925bc38 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:54.863442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec1bf2-7522-49b4-b72f-91f3cf059ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:54.864106 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec1bf2-7522-49b4-b72f-91f3cf059ea2 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:54.864390 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec1bf2-7522-49b4-b72f-91f3cf059ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:54.864927 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec1bf2-7522-49b4-b72f-91f3cf059ea2 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:54.865440 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec1bf2-7522-49b4-b72f-91f3cf059ea2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:54.865745 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec1bf2-7522-49b4-b72f-91f3cf059ea2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:54.867153 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec1bf2-7522-49b4-b72f-91f3cf059ea2 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:54.885441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 248/496] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:54.885441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c30290-1046-45c2-befd-dac4a7e40966 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:54.885441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c30290-1046-45c2-befd-dac4a7e40966 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:54.885441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c30290-1046-45c2-befd-dac4a7e40966 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:54.885441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 249/497] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:54.885441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c30290-1046-45c2-befd-dac4a7e40966 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:54.953187 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37981a6-fc8a-451d-a3ec-9477f925bc38 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:54.987731 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b99eac-ae65-4c28-8aad-104489e17aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:54.988393 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b99eac-ae65-4c28-8aad-104489e17aa3 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:54.988676 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b99eac-ae65-4c28-8aad-104489e17aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:54.988951 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b99eac-ae65-4c28-8aad-104489e17aa3 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:54.989733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b99eac-ae65-4c28-8aad-104489e17aa3 None admin] RBAC: Adding query filter params (name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:54.990046 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b99eac-ae65-4c28-8aad-104489e17aa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:54.992267 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b99eac-ae65-4c28-8aad-104489e17aa3 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:54.994828 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c30290-1046-45c2-befd-dac4a7e40966 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:55.000052 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 249/498] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:38:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:55.000839 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b99eac-ae65-4c28-8aad-104489e17aa3 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:55.004072 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:55.028678 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b86d73-a7f3-4915-a1b6-523c10373d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:55.029380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b86d73-a7f3-4915-a1b6-523c10373d99 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:55.029664 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b86d73-a7f3-4915-a1b6-523c10373d99 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:55.029945 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b86d73-a7f3-4915-a1b6-523c10373d99 None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:55.030779 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b86d73-a7f3-4915-a1b6-523c10373d99 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:55.031093 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b86d73-a7f3-4915-a1b6-523c10373d99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:55.032569 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b86d73-a7f3-4915-a1b6-523c10373d99 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:55.051774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:55.068785 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 250/499] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 23 19:38:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:55.070129 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae765-f5aa-4724-8350-a2bea64ed3ac None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:55.070426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae765-f5aa-4724-8350-a2bea64ed3ac None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:55.070710 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae765-f5aa-4724-8350-a2bea64ed3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:55.088401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-580ae765-f5aa-4724-8350-a2bea64ed3ac None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:55.089616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-580ae765-f5aa-4724-8350-a2bea64ed3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:55.102118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b99eac-ae65-4c28-8aad-104489e17aa3 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:55.148017 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c42af8-4e4f-40fc-b111-8d7163d83de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:55.148806 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c42af8-4e4f-40fc-b111-8d7163d83de9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:55.149087 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c42af8-4e4f-40fc-b111-8d7163d83de9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:55.152261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c42af8-4e4f-40fc-b111-8d7163d83de9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:55.154469 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 251/500] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:55.155776 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035b69d-2b81-4d83-a7c5-880ffce234e6 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:55.156066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035b69d-2b81-4d83-a7c5-880ffce234e6 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:55.156348 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035b69d-2b81-4d83-a7c5-880ffce234e6 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:55.157768 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 252/501] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:55.158440 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035b69d-2b81-4d83-a7c5-880ffce234e6 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:55.165899 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c42af8-4e4f-40fc-b111-8d7163d83de9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:55.167531 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c42af8-4e4f-40fc-b111-8d7163d83de9 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:55.182159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-74c42af8-4e4f-40fc-b111-8d7163d83de9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 19:38:55.182159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:55.182159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:55.182159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:55.182159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:55.182159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:55.182159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:55.182159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:55.182159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:55.182159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:55.182159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:55.182159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:55.182159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:38:55.182159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:38:55.182159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:38:55.182159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:38:55.183268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:55.183268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:55.183268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:38:55.183268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:38:55.183268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:38:55.183268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:38:55.183268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:55.183268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:55.183268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:55.183268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:55.183268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:55.183268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:55.183268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:55.183268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:55.183268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:55.183268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:55.183268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:55.183268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:55.184207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:55.184207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:55.184207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:38:55.184207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:38:55.184207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:38:55.184207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:38:55.184207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:38:55.184207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:38:55.184207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 19:38:55.184207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:55.184207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 250/502] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:55.184207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c42af8-4e4f-40fc-b111-8d7163d83de9 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:55.263115 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:55.269558 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035b69d-2b81-4d83-a7c5-880ffce234e6 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:55.285212 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c42af8-4e4f-40fc-b111-8d7163d83de9 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:55.296366 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:55.302958 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f154ec-54c2-48f3-af93-c93d55b875ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:55.303865 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f154ec-54c2-48f3-af93-c93d55b875ca None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:55.303865 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f154ec-54c2-48f3-af93-c93d55b875ca None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:55.304385 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f154ec-54c2-48f3-af93-c93d55b875ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:55.314356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f154ec-54c2-48f3-af93-c93d55b875ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:55.315821 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f154ec-54c2-48f3-af93-c93d55b875ca None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:55.318874 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee18f7-4c7b-49e7-aec8-b532713c29a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:55.319666 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee18f7-4c7b-49e7-aec8-b532713c29a7 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:55.320092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee18f7-4c7b-49e7-aec8-b532713c29a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:55.320178 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee18f7-4c7b-49e7-aec8-b532713c29a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:55.333872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-77f154ec-54c2-48f3-af93-c93d55b875ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:55.333872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:55.333872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:55.333872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:55.333872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:55.333872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:55.333872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:55.333872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:55.333872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:55.333872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:55.333872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:55.333872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:55.333872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:38:55.333872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:38:55.333872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:38:55.340947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:38:55.340947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:55.340947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:55.340947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:55.340947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:55.340947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:55.340947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:55.340947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:55.340947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:55.340947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:55.340947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:55.340947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:55.340947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:55.340947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:55.340947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:55.340947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:55.340947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:55.342108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:38:55.342108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:38:55.342108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:55.342108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:55.342108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 253/503] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:55.342108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4bc17-c1fa-4d65-9e2a-819a9c537597 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:55.342108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4bc17-c1fa-4d65-9e2a-819a9c537597 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:55.342108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4bc17-c1fa-4d65-9e2a-819a9c537597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:55.354203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-aaa4bc17-c1fa-4d65-9e2a-819a9c537597 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:55.355380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-aaa4bc17-c1fa-4d65-9e2a-819a9c537597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:55.388229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee18f7-4c7b-49e7-aec8-b532713c29a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:55.389724 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee18f7-4c7b-49e7-aec8-b532713c29a7 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:55.421062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 254/504] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:55.421905 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4bc17-c1fa-4d65-9e2a-819a9c537597 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:55.487487 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 251/505] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:55.488329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee18f7-4c7b-49e7-aec8-b532713c29a7 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:55.499667 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:55.514993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:55.536522 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4bc17-c1fa-4d65-9e2a-819a9c537597 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:55.570832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce130e5-2178-4d5e-be09-1b1cde5bddc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:55.571631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce130e5-2178-4d5e-be09-1b1cde5bddc6 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:55.571913 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce130e5-2178-4d5e-be09-1b1cde5bddc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:55.572187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce130e5-2178-4d5e-be09-1b1cde5bddc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:55.582283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce130e5-2178-4d5e-be09-1b1cde5bddc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:55.584807 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee18f7-4c7b-49e7-aec8-b532713c29a7 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:55.591176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-2ce130e5-2178-4d5e-be09-1b1cde5bddc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:38:55.591176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:55.591176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:55.591176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:55.591176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:55.591176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:55.591176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:55.591176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:55.591176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:55.591176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:55.591176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:55.591176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:55.591176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:55.591176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:55.591176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:55.591176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:55.592034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:55.592034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:55.592034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:55.592034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:55.592034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:55.592034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:55.592034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:55.592034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:55.592034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:55.592034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:55.592034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:55.592034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:55.592034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:55.592034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:55.592034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:55.592034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:55.592829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:55.592829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:55.592829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:55.592829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:55.592829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:55.592829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:55.592829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:55.592829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:55.592829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:55.592829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:55.592829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:38:55.592829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:55.592829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 255/506] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:38:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:55.593763 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce130e5-2178-4d5e-be09-1b1cde5bddc6 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:55.624283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e7e03-043d-4ac9-8d23-7884344b801b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:55.624949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e7e03-043d-4ac9-8d23-7884344b801b None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:55.625274 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e7e03-043d-4ac9-8d23-7884344b801b None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:55.625556 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e7e03-043d-4ac9-8d23-7884344b801b None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:55.626387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e7e03-043d-4ac9-8d23-7884344b801b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:55.626704 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e7e03-043d-4ac9-8d23-7884344b801b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:55.628137 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e7e03-043d-4ac9-8d23-7884344b801b None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:55.665296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 252/507] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Jun 23 19:38:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:55.666126 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e7e03-043d-4ac9-8d23-7884344b801b None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:55.692264 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce130e5-2178-4d5e-be09-1b1cde5bddc6 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:55.725398 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b076cd-10a0-48bc-86b1-c33b7c3b470f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:55.726297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b076cd-10a0-48bc-86b1-c33b7c3b470f None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:55.726579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b076cd-10a0-48bc-86b1-c33b7c3b470f None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:55.726860 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b076cd-10a0-48bc-86b1-c33b7c3b470f None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:55.727576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b076cd-10a0-48bc-86b1-c33b7c3b470f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:55.727880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b076cd-10a0-48bc-86b1-c33b7c3b470f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:55.729292 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b076cd-10a0-48bc-86b1-c33b7c3b470f None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:55.731130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:55.736161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:55.741062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 256/508] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:55.742748 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b076cd-10a0-48bc-86b1-c33b7c3b470f None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:55.768114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e7e03-043d-4ac9-8d23-7884344b801b None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:55.802386 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f08e7-0645-4598-bfc0-d3c8232eeb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:55.802917 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f08e7-0645-4598-bfc0-d3c8232eeb70 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:55.803204 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f08e7-0645-4598-bfc0-d3c8232eeb70 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:55.803482 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f08e7-0645-4598-bfc0-d3c8232eeb70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:55.814582 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f08e7-0645-4598-bfc0-d3c8232eeb70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:55.816042 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f08e7-0645-4598-bfc0-d3c8232eeb70 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:55.834821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-357f08e7-0645-4598-bfc0-d3c8232eeb70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:55.834821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:55.834821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:55.834821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:55.834821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:55.834821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:55.834821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:55.834821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:55.834821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:55.834821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:55.834821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:55.834821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:55.834821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:38:55.834821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:38:55.834821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:38:55.835841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:38:55.835841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:55.835841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:55.835841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:55.835841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:55.835841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:55.835841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:55.835841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:55.835841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:55.835841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:55.835841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:55.835841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:55.835841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:55.835841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:55.835841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:55.835841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:55.835841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:55.836773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:38:55.836773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:38:55.836773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:55.836773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:55.836773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 253/509] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:55.837054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f08e7-0645-4598-bfc0-d3c8232eeb70 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:55.847746 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b076cd-10a0-48bc-86b1-c33b7c3b470f None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:55.882634 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89a23f-5abe-4e5e-bd41-d28eb8f83540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:55.883425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89a23f-5abe-4e5e-bd41-d28eb8f83540 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:55.883702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89a23f-5abe-4e5e-bd41-d28eb8f83540 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:55.883978 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89a23f-5abe-4e5e-bd41-d28eb8f83540 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:55.894191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89a23f-5abe-4e5e-bd41-d28eb8f83540 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:55.895640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89a23f-5abe-4e5e-bd41-d28eb8f83540 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:55.913104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-1a89a23f-5abe-4e5e-bd41-d28eb8f83540 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:55.913104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:55.913104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:55.913104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:55.913104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:55.913104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:55.913104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:55.913104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:55.913104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:55.913104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:55.913104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:55.913104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:55.913104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:38:55.913104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:38:55.913104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:38:55.914137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:38:55.914137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:55.914137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:55.914137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:55.914137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:55.914137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:55.914137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:55.914137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:55.914137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:55.914137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:55.914137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:55.914137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:55.914137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:55.914137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:55.914137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:55.914137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:55.914137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:55.915002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:38:55.915002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:38:55.915002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:55.915002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:55.915002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 257/510] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:55.915343 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89a23f-5abe-4e5e-bd41-d28eb8f83540 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:55.942690 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f08e7-0645-4598-bfc0-d3c8232eeb70 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:55.965215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:55.965669 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:55.979164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d66ab-66d3-46da-938e-33796c576f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:55.979829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d66ab-66d3-46da-938e-33796c576f0d None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:55.980113 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d66ab-66d3-46da-938e-33796c576f0d None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:55.980425 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d66ab-66d3-46da-938e-33796c576f0d None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:55.981130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d66ab-66d3-46da-938e-33796c576f0d None admin] RBAC: Adding query filter params (name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:55.981467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d66ab-66d3-46da-938e-33796c576f0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:55.982843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d66ab-66d3-46da-938e-33796c576f0d None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:55.992301 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 254/511] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:38:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:55.993993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d66ab-66d3-46da-938e-33796c576f0d None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:56.013890 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89a23f-5abe-4e5e-bd41-d28eb8f83540 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:56.047227 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1230ab-a102-4cd2-8cb2-4b71b5940824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:56.047881 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1230ab-a102-4cd2-8cb2-4b71b5940824 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:56.048167 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1230ab-a102-4cd2-8cb2-4b71b5940824 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:56.048444 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1230ab-a102-4cd2-8cb2-4b71b5940824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:56.092835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d66ab-66d3-46da-938e-33796c576f0d None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:56.118484 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1230ab-a102-4cd2-8cb2-4b71b5940824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:56.119966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1230ab-a102-4cd2-8cb2-4b71b5940824 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:56.129417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3709e45-53b2-493c-8521-7fc3397dd90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:56.130216 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3709e45-53b2-493c-8521-7fc3397dd90c None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:56.130503 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3709e45-53b2-493c-8521-7fc3397dd90c None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:56.130784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3709e45-53b2-493c-8521-7fc3397dd90c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:56.138008 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3709e45-53b2-493c-8521-7fc3397dd90c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:56.139451 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3709e45-53b2-493c-8521-7fc3397dd90c None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:56.154134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-c3709e45-53b2-493c-8521-7fc3397dd90c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 19:38:56.154134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:56.154134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:56.154134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:56.154134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:56.154134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:56.154134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:56.154134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:56.154134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:56.154134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:56.154134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:56.154134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:56.154134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:38:56.154134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:38:56.154134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:38:56.154134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:38:56.155195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:56.155195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:56.155195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:38:56.155195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:38:56.155195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:38:56.155195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:38:56.155195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:56.155195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:56.155195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:56.155195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:56.155195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:56.155195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:56.155195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:56.155195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:56.155195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:56.155195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:56.155195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:56.155195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:56.156092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:56.156092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:56.156092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:38:56.156092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:38:56.156092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:38:56.156092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:38:56.156092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:38:56.156092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:38:56.156092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 19:38:56.156092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:56.156092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 255/512] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:38:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:56.156092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3709e45-53b2-493c-8521-7fc3397dd90c None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:56.167494 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:56.203597 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:56.220383 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 258/513] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:56.221234 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1230ab-a102-4cd2-8cb2-4b71b5940824 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:56.258950 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3709e45-53b2-493c-8521-7fc3397dd90c None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:56.292754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6d953-8070-4d01-a4a8-974562e6db9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:56.293444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6d953-8070-4d01-a4a8-974562e6db9f None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:56.293731 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6d953-8070-4d01-a4a8-974562e6db9f None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:56.294010 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6d953-8070-4d01-a4a8-974562e6db9f None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:56.294726 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6d953-8070-4d01-a4a8-974562e6db9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:56.295028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6d953-8070-4d01-a4a8-974562e6db9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:56.296415 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6d953-8070-4d01-a4a8-974562e6db9f None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:56.307901 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 256/514] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:56.308810 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6d953-8070-4d01-a4a8-974562e6db9f None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:56.319197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1230ab-a102-4cd2-8cb2-4b71b5940824 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:56.356163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6187368-b787-4058-81fd-c0a7f3d02dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:56.356840 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6187368-b787-4058-81fd-c0a7f3d02dae None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:56.357122 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6187368-b787-4058-81fd-c0a7f3d02dae None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:56.357426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6187368-b787-4058-81fd-c0a7f3d02dae None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:56.358144 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6187368-b787-4058-81fd-c0a7f3d02dae None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:56.358449 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6187368-b787-4058-81fd-c0a7f3d02dae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:56.359837 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6187368-b787-4058-81fd-c0a7f3d02dae None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:56.371855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 259/515] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:56.376789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6187368-b787-4058-81fd-c0a7f3d02dae None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:56.388880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:56.409660 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6d953-8070-4d01-a4a8-974562e6db9f None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:56.411147 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:56.442563 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecddff-4f2a-4696-a990-b11b800fda02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:56.443661 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecddff-4f2a-4696-a990-b11b800fda02 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:56.443951 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecddff-4f2a-4696-a990-b11b800fda02 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:56.444232 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecddff-4f2a-4696-a990-b11b800fda02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:56.455691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecddff-4f2a-4696-a990-b11b800fda02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:56.457177 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecddff-4f2a-4696-a990-b11b800fda02 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:56.474348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-79ecddff-4f2a-4696-a990-b11b800fda02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:56.474348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:56.474348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:56.474348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:56.474348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:56.474348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:56.474348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:56.474348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:56.474348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:56.474348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:56.474348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:56.474348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:56.474348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:38:56.474348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:38:56.474348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:38:56.475173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:38:56.475173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:56.475173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:56.475173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:56.475173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:56.475173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:56.475173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:56.475173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:56.475173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:56.475173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:56.475173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:56.475173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:56.475173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:56.475173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:56.475173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:56.475173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:56.475173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:56.476334 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:38:56.476334 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:38:56.476334 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:56.476334 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:56.476617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6187368-b787-4058-81fd-c0a7f3d02dae None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:56.477318 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 257/516] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:56.478523 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecddff-4f2a-4696-a990-b11b800fda02 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:56.510409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db893556-0117-4300-a4f9-f3f5353fedc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:56.511073 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db893556-0117-4300-a4f9-f3f5353fedc7 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:56.511360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db893556-0117-4300-a4f9-f3f5353fedc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:56.511644 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db893556-0117-4300-a4f9-f3f5353fedc7 None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:56.512479 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db893556-0117-4300-a4f9-f3f5353fedc7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:56.512793 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db893556-0117-4300-a4f9-f3f5353fedc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:56.514254 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db893556-0117-4300-a4f9-f3f5353fedc7 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:56.530785 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 260/517] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Jun 23 19:38:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:56.531552 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db893556-0117-4300-a4f9-f3f5353fedc7 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:56.583010 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecddff-4f2a-4696-a990-b11b800fda02 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:56.596618 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:56.620658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe497f9-8531-4fd7-b883-9d2cb8c88bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:56.620658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe497f9-8531-4fd7-b883-9d2cb8c88bef None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:56.620658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe497f9-8531-4fd7-b883-9d2cb8c88bef None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:56.620658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe497f9-8531-4fd7-b883-9d2cb8c88bef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:56.628191 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe497f9-8531-4fd7-b883-9d2cb8c88bef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:56.628600 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db893556-0117-4300-a4f9-f3f5353fedc7 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:56.629673 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe497f9-8531-4fd7-b883-9d2cb8c88bef None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:56.646860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-8fe497f9-8531-4fd7-b883-9d2cb8c88bef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:56.646860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:56.646860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:56.646860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:56.646860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:56.646860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:56.646860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:56.646860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:56.646860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:56.646860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:56.646860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:56.646860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:56.646860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:38:56.646860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:38:56.646860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:38:56.647830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:38:56.647830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:56.647830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:56.647830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:56.647830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:56.647830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:56.647830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:56.647830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:56.647830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:56.647830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:56.647830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:56.647830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:56.647830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:56.647830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:56.647830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:56.647830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:56.647830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:56.648679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:38:56.648679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:38:56.648679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:56.648679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:56.648679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 258/518] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:56.648941 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe497f9-8531-4fd7-b883-9d2cb8c88bef None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:56.661020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:56.663165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a84ae9-7d2a-453b-9aff-e19e56c1a883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:56.663838 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a84ae9-7d2a-453b-9aff-e19e56c1a883 None admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:56.664120 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a84ae9-7d2a-453b-9aff-e19e56c1a883 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:56.664398 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a84ae9-7d2a-453b-9aff-e19e56c1a883 None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:56.665096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a84ae9-7d2a-453b-9aff-e19e56c1a883 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:56.666559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a84ae9-7d2a-453b-9aff-e19e56c1a883 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:56.749259 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe497f9-8531-4fd7-b883-9d2cb8c88bef None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:56.781558 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e52dc6-d085-4292-8316-ae9b83c2ac29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:56.782343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e52dc6-d085-4292-8316-ae9b83c2ac29 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:56.782632 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e52dc6-d085-4292-8316-ae9b83c2ac29 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:56.782922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e52dc6-d085-4292-8316-ae9b83c2ac29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:56.789383 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e52dc6-d085-4292-8316-ae9b83c2ac29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:56.792313 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e52dc6-d085-4292-8316-ae9b83c2ac29 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:56.805801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-c5e52dc6-d085-4292-8316-ae9b83c2ac29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:38:56.805801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:56.805801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:56.805801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:56.805801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:56.805801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:56.805801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:56.805801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:56.805801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:56.805801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:56.805801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:56.805801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:56.805801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:38:56.805801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:38:56.805801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:38:56.806817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:38:56.806817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:56.806817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:56.806817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:56.806817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:56.806817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:56.806817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:56.806817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:56.806817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:56.806817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:56.806817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:56.806817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:56.806817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:56.806817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:56.806817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:56.806817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:56.806817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:56.808044 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:38:56.808044 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:38:56.808044 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:38:56.808044 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:38:56.808044 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:38:56.808044 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:38:56.808044 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:38:56.808044 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:56.808044 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 259/519] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:38:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:56.808044 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e52dc6-d085-4292-8316-ae9b83c2ac29 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:56.829191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 261/520] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 19:38:56 2022] POST /identity/v3/users => generated 247 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:38:56.829191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a84ae9-7d2a-453b-9aff-e19e56c1a883 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:56.889828 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:56.935546 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e52dc6-d085-4292-8316-ae9b83c2ac29 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:56.937078 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a84ae9-7d2a-453b-9aff-e19e56c1a883 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:56.964636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:56.976223 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4225d1-77a1-497d-9052-f6566e02ff7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:56.977044 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4225d1-77a1-497d-9052-f6566e02ff7a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:56.983870 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4225d1-77a1-497d-9052-f6566e02ff7a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:56.983870 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4225d1-77a1-497d-9052-f6566e02ff7a None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:56.984029 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a7939-3273-4cd4-b525-88a50d9340e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:56.984113 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4225d1-77a1-497d-9052-f6566e02ff7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:56.984182 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a7939-3273-4cd4-b525-88a50d9340e6 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:56.984373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4225d1-77a1-497d-9052-f6566e02ff7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:56.984448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a7939-3273-4cd4-b525-88a50d9340e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:56.984448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a7939-3273-4cd4-b525-88a50d9340e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:56.985323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4225d1-77a1-497d-9052-f6566e02ff7a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:56.994426 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 260/521] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:56.994426 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4225d1-77a1-497d-9052-f6566e02ff7a None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:57.056613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a7939-3273-4cd4-b525-88a50d9340e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:57.058202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a7939-3273-4cd4-b525-88a50d9340e6 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:57.105815 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4225d1-77a1-497d-9052-f6566e02ff7a None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:57.131023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:57.139944 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fb4e1-835e-47d6-ae2e-2c53001cbb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:57.140553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fb4e1-835e-47d6-ae2e-2c53001cbb17 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:57.140986 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fb4e1-835e-47d6-ae2e-2c53001cbb17 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:57.141180 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fb4e1-835e-47d6-ae2e-2c53001cbb17 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:57.141935 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fb4e1-835e-47d6-ae2e-2c53001cbb17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:57.148455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fb4e1-835e-47d6-ae2e-2c53001cbb17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:57.148455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fb4e1-835e-47d6-ae2e-2c53001cbb17 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:57.155850 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 261/522] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:57.156683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fb4e1-835e-47d6-ae2e-2c53001cbb17 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:57.177903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 262/523] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:57.180210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a7939-3273-4cd4-b525-88a50d9340e6 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:57.213243 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:57.260770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fb4e1-835e-47d6-ae2e-2c53001cbb17 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:57.296278 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc20d6-9174-4723-82bb-d6147bba671a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:57.296940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc20d6-9174-4723-82bb-d6147bba671a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:57.297251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc20d6-9174-4723-82bb-d6147bba671a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:57.297535 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc20d6-9174-4723-82bb-d6147bba671a None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:57.298319 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc20d6-9174-4723-82bb-d6147bba671a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:57.298634 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc20d6-9174-4723-82bb-d6147bba671a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:57.300060 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc20d6-9174-4723-82bb-d6147bba671a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:57.303181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a7939-3273-4cd4-b525-88a50d9340e6 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:57.321042 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 262/524] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:38:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:57.321919 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc20d6-9174-4723-82bb-d6147bba671a None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:57.344022 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba7e4d-c32c-4641-8d38-65ca51434584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:57.344801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7e4d-c32c-4641-8d38-65ca51434584 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:57.345082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7e4d-c32c-4641-8d38-65ca51434584 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:57.345382 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7e4d-c32c-4641-8d38-65ca51434584 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:57.354464 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba7e4d-c32c-4641-8d38-65ca51434584 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:57.356345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba7e4d-c32c-4641-8d38-65ca51434584 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:57.373079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:57.375321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-6bba7e4d-c32c-4641-8d38-65ca51434584 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 19:38:57.375321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:57.375321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:57.375321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:57.375321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:57.375321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:57.375321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:57.375321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:57.375321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:57.375321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:57.375321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:57.375321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:57.375321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:38:57.375321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:38:57.375321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:38:57.375321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:38:57.376281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:57.376281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:57.376281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:38:57.376281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:38:57.376281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:38:57.376281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:38:57.376281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:57.376281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:57.376281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:57.376281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:57.376281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:57.376281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:57.376281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:57.376281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:57.376281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:57.376281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:57.376281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:57.376281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:57.377215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:57.377215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:57.377215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:38:57.377215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:38:57.377215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:38:57.377215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:38:57.377215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:38:57.377215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:38:57.377215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 19:38:57.377215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:57.377215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 263/525] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:38:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:57.377791 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba7e4d-c32c-4641-8d38-65ca51434584 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:57.438895 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc20d6-9174-4723-82bb-d6147bba671a None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:57.469345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:57.475461 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f15b29-e6f0-489b-9590-373cd8e518f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:57.476265 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f15b29-e6f0-489b-9590-373cd8e518f0 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:57.476561 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f15b29-e6f0-489b-9590-373cd8e518f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:57.476840 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f15b29-e6f0-489b-9590-373cd8e518f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:57.483950 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f15b29-e6f0-489b-9590-373cd8e518f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:57.485190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba7e4d-c32c-4641-8d38-65ca51434584 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:57.485438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f15b29-e6f0-489b-9590-373cd8e518f0 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:57.500118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-e1f15b29-e6f0-489b-9590-373cd8e518f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:38:57.500118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:57.500118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:57.500118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:57.500118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:57.500118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:57.500118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:57.500118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:57.500118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:57.500118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:57.500118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:57.500118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:57.500118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:38:57.500118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:38:57.500118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:38:57.500988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:38:57.500988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:57.500988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:57.500988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:57.500988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:57.500988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:57.500988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:57.500988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:57.500988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:57.500988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:57.500988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:57.500988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:57.500988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:57.500988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:57.500988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:57.500988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:57.500988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:57.501964 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:38:57.501964 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:38:57.501964 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:38:57.501964 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:38:57.501964 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:38:57.501964 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:38:57.501964 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:38:57.501964 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:57.505719 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 263/526] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:38:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:57.506773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f15b29-e6f0-489b-9590-373cd8e518f0 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:57.524835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b89ea1-5c74-491c-b540-23c23b9a85fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:57.525685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b89ea1-5c74-491c-b540-23c23b9a85fb None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:57.525974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b89ea1-5c74-491c-b540-23c23b9a85fb None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:57.526244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b89ea1-5c74-491c-b540-23c23b9a85fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:57.537209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b89ea1-5c74-491c-b540-23c23b9a85fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:57.538629 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b89ea1-5c74-491c-b540-23c23b9a85fb None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:57.557190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-50b89ea1-5c74-491c-b540-23c23b9a85fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:57.557190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:57.557190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:57.557190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:57.557190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:57.557190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:57.557190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:57.557190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:57.557190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:57.557190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:57.557190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:57.557190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:57.557190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:38:57.557190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:38:57.557190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:38:57.558119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:38:57.558119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:57.558119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:57.558119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:57.558119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:57.558119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:57.558119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:57.558119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:57.558119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:57.558119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:57.558119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:57.558119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:57.558119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:57.558119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:57.558119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:57.558119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:57.558119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:57.558957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:38:57.558957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:38:57.558957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:57.558957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:57.558957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 264/527] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:57.559233 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b89ea1-5c74-491c-b540-23c23b9a85fb None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:57.621874 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f15b29-e6f0-489b-9590-373cd8e518f0 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:57.629549 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:57.656735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d40a7d-2cfb-4589-9744-3368ee181b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:57.657675 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d40a7d-2cfb-4589-9744-3368ee181b93 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:57.657963 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d40a7d-2cfb-4589-9744-3368ee181b93 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:57.658248 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d40a7d-2cfb-4589-9744-3368ee181b93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:57.659134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d40a7d-2cfb-4589-9744-3368ee181b93 None admin] RBAC: Adding query filter params (role.id=e466769ed9af47889225dd8d77e896a5, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=83bff5cd7782423eaa0bc5b29b208ae7) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:57.659450 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d40a7d-2cfb-4589-9744-3368ee181b93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:57.660892 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d40a7d-2cfb-4589-9744-3368ee181b93 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:57.673463 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 264/528] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:57 2022] GET /identity/v3/role_assignments?user.id=83bff5cd7782423eaa0bc5b29b208ae7&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=e466769ed9af47889225dd8d77e896a5 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:57.673463 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d40a7d-2cfb-4589-9744-3368ee181b93 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:57.680102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b89ea1-5c74-491c-b540-23c23b9a85fb None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:57.723989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad387-135f-46bf-a1c0-554641b4a9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:57.724869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad387-135f-46bf-a1c0-554641b4a9b3 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:57.725254 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad387-135f-46bf-a1c0-554641b4a9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:57.725652 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad387-135f-46bf-a1c0-554641b4a9b3 None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:57.726605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cad387-135f-46bf-a1c0-554641b4a9b3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:57.726990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cad387-135f-46bf-a1c0-554641b4a9b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:57.728668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cad387-135f-46bf-a1c0-554641b4a9b3 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:57.732899 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:57.750794 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 265/529] 10.222.0.13 () {56 vars in 1139 bytes} [Thu Jun 23 19:38:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:57.756548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad387-135f-46bf-a1c0-554641b4a9b3 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:57.811172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d40a7d-2cfb-4589-9744-3368ee181b93 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:57.857232 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7de06-7aa8-4066-8d5d-3dd2fe149170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:57.857903 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7de06-7aa8-4066-8d5d-3dd2fe149170 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:57.858193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7de06-7aa8-4066-8d5d-3dd2fe149170 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:57.858484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7de06-7aa8-4066-8d5d-3dd2fe149170 None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:57.859268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7de06-7aa8-4066-8d5d-3dd2fe149170 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:57.859585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7de06-7aa8-4066-8d5d-3dd2fe149170 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:57.861056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7de06-7aa8-4066-8d5d-3dd2fe149170 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:57.874584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 265/530] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:38:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:57.875568 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7de06-7aa8-4066-8d5d-3dd2fe149170 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:57.891062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad387-135f-46bf-a1c0-554641b4a9b3 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:57.912319 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:57.937860 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cf449-69e1-479c-8976-4fbb2b1cd41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:57.938531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cf449-69e1-479c-8976-4fbb2b1cd41a None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:57.938863 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cf449-69e1-479c-8976-4fbb2b1cd41a None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:57.939151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cf449-69e1-479c-8976-4fbb2b1cd41a None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:57.939892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931cf449-69e1-479c-8976-4fbb2b1cd41a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:57.940629 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931cf449-69e1-479c-8976-4fbb2b1cd41a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:57.942410 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931cf449-69e1-479c-8976-4fbb2b1cd41a None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:57.963369 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 266/531] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:57.964751 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cf449-69e1-479c-8976-4fbb2b1cd41a None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:58.000461 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7de06-7aa8-4066-8d5d-3dd2fe149170 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:58.037711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:58.045087 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6b849-9613-49e7-a41d-49f1a37a30bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:58.049257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6b849-9613-49e7-a41d-49f1a37a30bb None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:58.049257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6b849-9613-49e7-a41d-49f1a37a30bb None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:58.049257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6b849-9613-49e7-a41d-49f1a37a30bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:58.096126 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cf449-69e1-479c-8976-4fbb2b1cd41a None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:58.130056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6b849-9613-49e7-a41d-49f1a37a30bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:58.131685 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6b849-9613-49e7-a41d-49f1a37a30bb None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:58.137414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b8968-41bc-46d3-bd3e-86694a719692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:58.138162 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b8968-41bc-46d3-bd3e-86694a719692 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:58.138538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b8968-41bc-46d3-bd3e-86694a719692 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:58.138890 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b8968-41bc-46d3-bd3e-86694a719692 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:58.139805 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b8968-41bc-46d3-bd3e-86694a719692 None admin] RBAC: Adding query filter params (role.id=e466769ed9af47889225dd8d77e896a5, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=f078219032be4b619119d1d9d59c499d) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:58.140185 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b8968-41bc-46d3-bd3e-86694a719692 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:58.141859 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b8968-41bc-46d3-bd3e-86694a719692 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:58.157700 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 267/532] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:57 2022] GET /identity/v3/role_assignments?user.id=f078219032be4b619119d1d9d59c499d&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=e466769ed9af47889225dd8d77e896a5 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:58.158893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b8968-41bc-46d3-bd3e-86694a719692 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:58.173528 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:58.313467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 266/533] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:38:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:38:58.319110 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6b849-9613-49e7-a41d-49f1a37a30bb None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:58.355149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b8968-41bc-46d3-bd3e-86694a719692 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:58.375231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:58.421852 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19756ea8-9675-4976-b55c-74756568c55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:58.422658 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19756ea8-9675-4976-b55c-74756568c55e None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:58.422944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19756ea8-9675-4976-b55c-74756568c55e None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:58.423227 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19756ea8-9675-4976-b55c-74756568c55e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:58.436903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19756ea8-9675-4976-b55c-74756568c55e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:58.438395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19756ea8-9675-4976-b55c-74756568c55e None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:58.463054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-19756ea8-9675-4976-b55c-74756568c55e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:38:58.463054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:58.463054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:58.463054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:58.463054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:58.463054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:58.463054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:58.463054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:58.463054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:58.463054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:58.463054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:58.463054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:58.463054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:38:58.463054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:38:58.463054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:38:58.463987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:38:58.463987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:58.463987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:58.463987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:58.463987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:58.463987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:58.463987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:58.463987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:58.463987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:58.463987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:58.463987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:58.463987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:58.463987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:58.463987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:58.463987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:58.463987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:58.463987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:58.464825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:38:58.464825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:38:58.464825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:38:58.464825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:38:58.464825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:38:58.464825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:38:58.464825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:38:58.464825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:58.466496 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 268/534] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:38:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:58.474547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6b849-9613-49e7-a41d-49f1a37a30bb None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:58.477062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19756ea8-9675-4976-b55c-74756568c55e None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:58.514677 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:58.527788 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b770d-39ec-4b4e-a254-8cc65bfbe7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:58.529730 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b770d-39ec-4b4e-a254-8cc65bfbe7d7 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:58.531271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b770d-39ec-4b4e-a254-8cc65bfbe7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:58.531734 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b770d-39ec-4b4e-a254-8cc65bfbe7d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:58.552663 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b770d-39ec-4b4e-a254-8cc65bfbe7d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:58.554242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b770d-39ec-4b4e-a254-8cc65bfbe7d7 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:58.584781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-339b770d-39ec-4b4e-a254-8cc65bfbe7d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:58.584781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:58.584781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:58.584781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:58.584781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:58.584781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:58.584781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:58.584781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:58.584781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:58.584781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:58.584781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:58.584781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:58.584781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:38:58.584781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:38:58.584781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:38:58.586500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:38:58.586500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:58.586500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:58.586500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:58.586500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:58.586500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:58.586500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:58.586500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:58.586500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:58.586500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:58.586500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:58.586500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:58.586500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:58.586500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:58.586500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:58.586500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:58.586500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:58.587512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:38:58.587512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:38:58.587512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:38:58.587512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:58.593236 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 267/535] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:58.598862 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b770d-39ec-4b4e-a254-8cc65bfbe7d7 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:58.637095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19756ea8-9675-4976-b55c-74756568c55e None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:58.678455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4decc0e-e725-4cce-909e-c5fb5e5922e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:58.680098 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4decc0e-e725-4cce-909e-c5fb5e5922e9 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:58.680570 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4decc0e-e725-4cce-909e-c5fb5e5922e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:58.680991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4decc0e-e725-4cce-909e-c5fb5e5922e9 None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:58.682017 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4decc0e-e725-4cce-909e-c5fb5e5922e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:58.683424 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4decc0e-e725-4cce-909e-c5fb5e5922e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:58.685045 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4decc0e-e725-4cce-909e-c5fb5e5922e9 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:58.706345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 269/536] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:38:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:58.715485 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4decc0e-e725-4cce-909e-c5fb5e5922e9 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:58.787401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:58.810075 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b770d-39ec-4b4e-a254-8cc65bfbe7d7 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:58.874926 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7680d9-b3a1-4448-9f05-dbfd5aecd58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:58.875527 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7680d9-b3a1-4448-9f05-dbfd5aecd58e None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:58.875814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7680d9-b3a1-4448-9f05-dbfd5aecd58e None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:58.876093 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7680d9-b3a1-4448-9f05-dbfd5aecd58e None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:58.876845 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7680d9-b3a1-4448-9f05-dbfd5aecd58e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:58.877148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7680d9-b3a1-4448-9f05-dbfd5aecd58e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:58.879480 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7680d9-b3a1-4448-9f05-dbfd5aecd58e None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:58.892584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 268/537] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:58.903987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7680d9-b3a1-4448-9f05-dbfd5aecd58e None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:58.958946 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:58.979334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4decc0e-e725-4cce-909e-c5fb5e5922e9 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:59.024761 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7680d9-b3a1-4448-9f05-dbfd5aecd58e None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:59.030495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73706f-cf42-4fdf-8278-9bcb965ada54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:59.031163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73706f-cf42-4fdf-8278-9bcb965ada54 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:59.031451 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73706f-cf42-4fdf-8278-9bcb965ada54 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:59.031727 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73706f-cf42-4fdf-8278-9bcb965ada54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:59.033030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73706f-cf42-4fdf-8278-9bcb965ada54 None admin] RBAC: Adding query filter params (role.id=e466769ed9af47889225dd8d77e896a5, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=4ab2b3700cdf48f08a049fbb76ee189c) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:59.033378 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73706f-cf42-4fdf-8278-9bcb965ada54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:59.035203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73706f-cf42-4fdf-8278-9bcb965ada54 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:59.043154 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 270/538] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:58 2022] GET /identity/v3/role_assignments?user.id=4ab2b3700cdf48f08a049fbb76ee189c&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=e466769ed9af47889225dd8d77e896a5 => generated 259 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:59.044454 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0744a-6040-496c-9097-0afc17c6ae78 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:59.044750 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0744a-6040-496c-9097-0afc17c6ae78 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:59.045032 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0744a-6040-496c-9097-0afc17c6ae78 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:59.047229 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 271/539] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:38:59.056023 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1df56e-c80d-4fc1-a5d7-d4d5a1ce8b32 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:59.056369 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1df56e-c80d-4fc1-a5d7-d4d5a1ce8b32 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:59.056591 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1df56e-c80d-4fc1-a5d7-d4d5a1ce8b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:59.084090 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960303f1-4205-4652-8170-ca024858930b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:59.085089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960303f1-4205-4652-8170-ca024858930b None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:59.085415 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960303f1-4205-4652-8170-ca024858930b None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:59.085696 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960303f1-4205-4652-8170-ca024858930b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:59.099473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-9b1df56e-c80d-4fc1-a5d7-d4d5a1ce8b32 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:38:59.101281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-9b1df56e-c80d-4fc1-a5d7-d4d5a1ce8b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:38:59.102752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960303f1-4205-4652-8170-ca024858930b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:59.104334 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960303f1-4205-4652-8170-ca024858930b None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:59.137343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-960303f1-4205-4652-8170-ca024858930b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:38:59.137343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:59.137343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:59.137343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:59.137343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:59.137343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:59.137343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:59.137343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:59.137343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:59.137343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:59.137343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:59.137343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:59.137343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:38:59.137343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:38:59.137343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:38:59.138250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:38:59.138250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:59.138250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:59.138250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:59.138250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:59.138250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:59.138250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:59.138250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:59.138250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:59.138250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:59.138250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:59.138250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:59.138250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:59.138250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:59.138250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:59.138250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:59.138250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:59.140596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:38:59.140596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:38:59.140596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:38:59.140596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:38:59.140596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:38:59.140596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:38:59.140596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:38:59.140596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:38:59.140596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 269/540] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:38:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:38:59.149306 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960303f1-4205-4652-8170-ca024858930b None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:59.263632 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 272/541] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:38:59.281105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960303f1-4205-4652-8170-ca024858930b None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:59.290211 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1df56e-c80d-4fc1-a5d7-d4d5a1ce8b32 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:59.297513 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:59.326684 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20638015-da01-462d-a0aa-43761c887b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:59.327367 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20638015-da01-462d-a0aa-43761c887b80 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:59.327655 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20638015-da01-462d-a0aa-43761c887b80 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:59.327937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20638015-da01-462d-a0aa-43761c887b80 None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:59.336573 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20638015-da01-462d-a0aa-43761c887b80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:59.336573 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20638015-da01-462d-a0aa-43761c887b80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:59.336573 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20638015-da01-462d-a0aa-43761c887b80 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:59.340435 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:59.359722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 270/542] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:38:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:59.370126 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20638015-da01-462d-a0aa-43761c887b80 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:59.416775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1df56e-c80d-4fc1-a5d7-d4d5a1ce8b32 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:59.460576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce33465-d93b-4cbb-b810-5e7930816354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:59.461398 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce33465-d93b-4cbb-b810-5e7930816354 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:59.461684 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce33465-d93b-4cbb-b810-5e7930816354 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:59.461964 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce33465-d93b-4cbb-b810-5e7930816354 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:59.487429 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce33465-d93b-4cbb-b810-5e7930816354 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:38:59.502118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-6ce33465-d93b-4cbb-b810-5e7930816354 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:38:59.502118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:38:59.502118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:38:59.502118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:38:59.502118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:38:59.502118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:38:59.502118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:38:59.502118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:38:59.502118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:38:59.502118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:38:59.502118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:38:59.502118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:38:59.502118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:38:59.502118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:38:59.502118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:38:59.502118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:38:59.504359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:38:59.504359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:38:59.504359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:38:59.504359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:38:59.504359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:38:59.504359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:38:59.504359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:38:59.504359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:38:59.504359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:38:59.504359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:38:59.504359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:38:59.504359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:38:59.504359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:38:59.504359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:38:59.504359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:38:59.504359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:38:59.506379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:38:59.506379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:38:59.506379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:38:59.506379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:38:59.506379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:38:59.506379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:38:59.506379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:38:59.506379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:38:59.506379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:38:59.506379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:38:59.506379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:38:59.506379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:38:59.510412 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 273/543] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:38:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:38:59.516266 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce33465-d93b-4cbb-b810-5e7930816354 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:59.607851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20638015-da01-462d-a0aa-43761c887b80 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:59.672660 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fba96-f3da-442f-9108-9cbdbb995a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:59.673265 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fba96-f3da-442f-9108-9cbdbb995a3b None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:59.673554 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fba96-f3da-442f-9108-9cbdbb995a3b None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:59.674018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fba96-f3da-442f-9108-9cbdbb995a3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:59.674855 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fba96-f3da-442f-9108-9cbdbb995a3b None admin] RBAC: Adding query filter params (role.id=e466769ed9af47889225dd8d77e896a5, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=24bb6f31e87045f5b17f561b42edca6f) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:59.675173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fba96-f3da-442f-9108-9cbdbb995a3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:59.676610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fba96-f3da-442f-9108-9cbdbb995a3b None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:59.688773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 271/544] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:38:59 2022] GET /identity/v3/role_assignments?user.id=24bb6f31e87045f5b17f561b42edca6f&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=e466769ed9af47889225dd8d77e896a5 => generated 259 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:38:59.689424 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:59.699412 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce33465-d93b-4cbb-b810-5e7930816354 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:59.759871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67a560-4cf6-419d-bf0f-b9b8efaa3a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:59.760547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67a560-4cf6-419d-bf0f-b9b8efaa3a83 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:59.760835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67a560-4cf6-419d-bf0f-b9b8efaa3a83 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:59.761115 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67a560-4cf6-419d-bf0f-b9b8efaa3a83 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:38:59.761896 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67a560-4cf6-419d-bf0f-b9b8efaa3a83 None admin] RBAC: Adding query filter params (name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:38:59.762209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67a560-4cf6-419d-bf0f-b9b8efaa3a83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:38:59.763602 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67a560-4cf6-419d-bf0f-b9b8efaa3a83 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:38:59.777146 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 274/545] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:38:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:38:59.782315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fba96-f3da-442f-9108-9cbdbb995a3b None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:38:59.820171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:38:59.946314 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fba96-f3da-442f-9108-9cbdbb995a3b None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:38:59.995172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab99182-80c9-4342-8b60-118a0a204682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:38:59.995975 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab99182-80c9-4342-8b60-118a0a204682 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:38:59.996259 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab99182-80c9-4342-8b60-118a0a204682 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:38:59.996534 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab99182-80c9-4342-8b60-118a0a204682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:00.011446 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c349bd-4646-44a0-803c-14524e8264dd None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:00.011745 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab99182-80c9-4342-8b60-118a0a204682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:00.011906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c349bd-4646-44a0-803c-14524e8264dd None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:00.012057 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c349bd-4646-44a0-803c-14524e8264dd None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:00.013186 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab99182-80c9-4342-8b60-118a0a204682 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:00.013704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 275/546] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:00.018597 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edb9bb-a82c-43a9-b248-dbcc955e4917 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:00.018890 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edb9bb-a82c-43a9-b248-dbcc955e4917 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:00.019175 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edb9bb-a82c-43a9-b248-dbcc955e4917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:00.036413 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-e3edb9bb-a82c-43a9-b248-dbcc955e4917 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:00.037658 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e3edb9bb-a82c-43a9-b248-dbcc955e4917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:00.037843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-3ab99182-80c9-4342-8b60-118a0a204682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:00.037843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:00.037843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:00.037843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:00.037843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:00.037843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:00.037843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:00.037843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:00.037843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:00.037843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:00.037843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:00.037843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:00.037843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:00.037843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:00.037843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:00.039827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:00.039827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:00.039827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:00.039827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:00.039827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:00.039827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:00.039827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:00.039827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:00.039827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:00.039827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:00.039827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:00.039827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:00.039827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:00.039827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:00.039827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:00.039827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:00.039827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:00.040919 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:00.040919 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:00.040919 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:00.040919 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:00.046343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 272/547] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:00.052023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab99182-80c9-4342-8b60-118a0a204682 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:00.138297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:00.162373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab99182-80c9-4342-8b60-118a0a204682 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:00.166822 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 276/548] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:39:00.204736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472109c-4c7e-4d24-9042-a22005a53ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:00.205361 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472109c-4c7e-4d24-9042-a22005a53ec1 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:00.205954 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472109c-4c7e-4d24-9042-a22005a53ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:00.205954 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472109c-4c7e-4d24-9042-a22005a53ec1 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:00.206625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472109c-4c7e-4d24-9042-a22005a53ec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:00.206932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472109c-4c7e-4d24-9042-a22005a53ec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:00.208303 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472109c-4c7e-4d24-9042-a22005a53ec1 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:00.210876 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edb9bb-a82c-43a9-b248-dbcc955e4917 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:00.222560 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 273/549] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:00.228642 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472109c-4c7e-4d24-9042-a22005a53ec1 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:00.374597 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:00.404516 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edb9bb-a82c-43a9-b248-dbcc955e4917 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:00.428281 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472109c-4c7e-4d24-9042-a22005a53ec1 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:00.471064 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b97975-7bf6-47c8-9d54-364e6d2ccbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:00.471777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b97975-7bf6-47c8-9d54-364e6d2ccbf1 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:00.472056 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b97975-7bf6-47c8-9d54-364e6d2ccbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:00.472310 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b97975-7bf6-47c8-9d54-364e6d2ccbf1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:00.483860 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b97975-7bf6-47c8-9d54-364e6d2ccbf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:00.492762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-b5b97975-7bf6-47c8-9d54-364e6d2ccbf1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:00.492762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:00.492762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:00.492762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:00.492762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:00.492762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:00.492762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:00.492762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:00.492762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:00.492762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:00.492762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:00.492762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:00.492762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:00.492762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:00.492762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:00.492762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:00.493722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:00.493722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:00.493722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:00.493722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:00.493722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:00.493722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:00.493722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:00.493722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:00.493722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:00.493722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:00.493722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:00.493722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:00.493722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:00.493722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:00.493722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:00.493722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:00.494704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:00.494704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:00.494704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:00.494704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:00.494704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:00.494704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:00.494704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:00.494704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:00.494704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:00.494704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:00.494704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:00.494704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:00.494704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 277/550] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:39:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:00.502248 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b97975-7bf6-47c8-9d54-364e6d2ccbf1 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:00.523846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6afd2d-1b92-4cd0-b226-4df11cac57cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:00.524703 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6afd2d-1b92-4cd0-b226-4df11cac57cd None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:00.524993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6afd2d-1b92-4cd0-b226-4df11cac57cd None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:00.525291 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6afd2d-1b92-4cd0-b226-4df11cac57cd None admin] PATH_INFO: `/v3/users/swift` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:00.540525 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6afd2d-1b92-4cd0-b226-4df11cac57cd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:00.545095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6afd2d-1b92-4cd0-b226-4df11cac57cd None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:00.549402 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:00.575505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-ae6afd2d-1b92-4cd0-b226-4df11cac57cd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 19:39:00.575505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:00.575505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:00.575505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:00.575505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:00.575505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:00.575505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:00.575505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:00.575505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:00.575505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:00.575505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:00.575505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:00.575505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:00.575505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:00.575505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:00.575505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:00.576687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:00.576687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:00.576687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:00.576687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:00.576687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:00.576687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:00.576687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:00.576687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:00.576687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:00.576687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:00.576687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:00.576687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:00.576687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:00.576687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:00.576687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:00.576687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:00.576687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:00.576687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:00.577674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:00.577674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:00.577674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:00.577674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:00.577674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:00.577674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:00.577674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:00.577674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:00.577674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 19:39:00.577674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:00.581704 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 274/551] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:39:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:00.583672 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677794-b46c-47d4-b93b-85ea28f3a12d None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:00.583969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677794-b46c-47d4-b93b-85ea28f3a12d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:00.584253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677794-b46c-47d4-b93b-85ea28f3a12d None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:00.590654 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 275/552] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:00.590654 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48677794-b46c-47d4-b93b-85ea28f3a12d None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:00.656217 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b97975-7bf6-47c8-9d54-364e6d2ccbf1 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:00.693024 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b8da3-0556-47eb-9645-bcab733801ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:00.694039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b8da3-0556-47eb-9645-bcab733801ae None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:00.694767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b8da3-0556-47eb-9645-bcab733801ae None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:00.695575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b8da3-0556-47eb-9645-bcab733801ae None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:00.696331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b8da3-0556-47eb-9645-bcab733801ae None admin] RBAC: Adding query filter params (name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:00.696688 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b8da3-0556-47eb-9645-bcab733801ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:00.698083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b8da3-0556-47eb-9645-bcab733801ae None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:00.711699 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 278/553] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:39:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:00.711699 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e4c8c-2dfb-4eb7-adf0-97cd76cf7dc1 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:00.711699 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e4c8c-2dfb-4eb7-adf0-97cd76cf7dc1 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:00.711699 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e4c8c-2dfb-4eb7-adf0-97cd76cf7dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:00.723076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:00.728909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-9b9e4c8c-2dfb-4eb7-adf0-97cd76cf7dc1 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:00.730260 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-9b9e4c8c-2dfb-4eb7-adf0-97cd76cf7dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:00.737498 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48677794-b46c-47d4-b93b-85ea28f3a12d None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:00.782733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899ff38-9c2d-44a5-8b6d-8c3adc704f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:00.783951 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899ff38-9c2d-44a5-8b6d-8c3adc704f0d None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:00.784415 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899ff38-9c2d-44a5-8b6d-8c3adc704f0d None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:00.784990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899ff38-9c2d-44a5-8b6d-8c3adc704f0d None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:00.786306 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899ff38-9c2d-44a5-8b6d-8c3adc704f0d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:00.786772 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899ff38-9c2d-44a5-8b6d-8c3adc704f0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:00.788507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899ff38-9c2d-44a5-8b6d-8c3adc704f0d None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:00.809401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 279/554] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:39:00.809401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e4c8c-2dfb-4eb7-adf0-97cd76cf7dc1 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:00.824714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 276/555] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Jun 23 19:39:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:00.830162 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899ff38-9c2d-44a5-8b6d-8c3adc704f0d None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:00.907037 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:00.923462 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e4c8c-2dfb-4eb7-adf0-97cd76cf7dc1 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:00.953825 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899ff38-9c2d-44a5-8b6d-8c3adc704f0d None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:00.963523 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dac4c-bdd0-49ae-87af-c5ffd3f25176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:00.964572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dac4c-bdd0-49ae-87af-c5ffd3f25176 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:00.964998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dac4c-bdd0-49ae-87af-c5ffd3f25176 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:00.965462 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dac4c-bdd0-49ae-87af-c5ffd3f25176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:00.968431 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:00.983261 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dac4c-bdd0-49ae-87af-c5ffd3f25176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:00.983261 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dac4c-bdd0-49ae-87af-c5ffd3f25176 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:00.990774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ee424-aaa4-4033-a9d5-7f0694eb6bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:00.992320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ee424-aaa4-4033-a9d5-7f0694eb6bc5 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:00.992320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ee424-aaa4-4033-a9d5-7f0694eb6bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:00.992740 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ee424-aaa4-4033-a9d5-7f0694eb6bc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:01.001123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-927dac4c-bdd0-49ae-87af-c5ffd3f25176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:01.001123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:01.001123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:01.001123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:01.001123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:01.001123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:01.001123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:01.001123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:01.001123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:01.001123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:01.001123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:01.001123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:01.001123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:01.001123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:01.001123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:01.002016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:01.002016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:01.002016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:01.002016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:01.002016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:01.002016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:01.002016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:01.002016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:01.002016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:01.002016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:01.002016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:01.002016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:01.002016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:01.002016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:01.002016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:01.002016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:01.002016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:01.002980 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:01.002980 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:01.002980 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:01.002980 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:01.005976 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 280/556] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:01.008245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dac4c-bdd0-49ae-87af-c5ffd3f25176 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:01.072816 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ee424-aaa4-4033-a9d5-7f0694eb6bc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:01.074453 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ee424-aaa4-4033-a9d5-7f0694eb6bc5 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:01.120849 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dac4c-bdd0-49ae-87af-c5ffd3f25176 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:01.157212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dbf7b-9eed-4b7e-a2e1-8fd9047a49cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:01.158357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dbf7b-9eed-4b7e-a2e1-8fd9047a49cc None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:01.158843 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dbf7b-9eed-4b7e-a2e1-8fd9047a49cc None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:01.159316 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dbf7b-9eed-4b7e-a2e1-8fd9047a49cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:01.161614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:01.171726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dbf7b-9eed-4b7e-a2e1-8fd9047a49cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:01.180554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-3f6dbf7b-9eed-4b7e-a2e1-8fd9047a49cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:01.180554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:01.180554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:01.180554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:01.180554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:01.180554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:01.180554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:01.180554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:01.180554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:01.180554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:01.180554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:01.180554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:01.180554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:01.180554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:01.180554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:01.180554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:01.182246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:01.182246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:01.182246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:01.182246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:01.182246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:01.182246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:01.182246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:01.182246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:01.182246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:01.182246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:01.182246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:01.182246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:01.182246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:01.182246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:01.182246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:01.182246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:01.183087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:01.183087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:01.183087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:01.183087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:01.183087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:01.183087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:01.183087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:01.183087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:01.183087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:01.183087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:01.183087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:01.183087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:01.185709 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 281/558] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:39:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:01.185915 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 277/558] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:39:01.186963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dbf7b-9eed-4b7e-a2e1-8fd9047a49cc None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:01.192169 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ee424-aaa4-4033-a9d5-7f0694eb6bc5 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:01.240006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:01.295825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dbf7b-9eed-4b7e-a2e1-8fd9047a49cc None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:01.300297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ee424-aaa4-4033-a9d5-7f0694eb6bc5 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:01.331547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04565b73-e73e-4838-bb90-312ff8f57476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:01.332555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04565b73-e73e-4838-bb90-312ff8f57476 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:01.333057 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04565b73-e73e-4838-bb90-312ff8f57476 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:01.333652 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04565b73-e73e-4838-bb90-312ff8f57476 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:01.334596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04565b73-e73e-4838-bb90-312ff8f57476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:01.336218 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04565b73-e73e-4838-bb90-312ff8f57476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:01.337696 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a0ef0-f689-4dba-aa1a-978f145499f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:01.338131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04565b73-e73e-4838-bb90-312ff8f57476 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:01.338624 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a0ef0-f689-4dba-aa1a-978f145499f1 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:01.338982 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a0ef0-f689-4dba-aa1a-978f145499f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:01.339385 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a0ef0-f689-4dba-aa1a-978f145499f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:01.350396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a0ef0-f689-4dba-aa1a-978f145499f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:01.352098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a0ef0-f689-4dba-aa1a-978f145499f1 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:01.352825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 282/559] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:01.353869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04565b73-e73e-4838-bb90-312ff8f57476 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:01.377444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-080a0ef0-f689-4dba-aa1a-978f145499f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:01.377444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:01.377444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:01.377444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:01.377444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:01.377444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:01.377444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:01.377444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:01.377444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:01.377444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:01.377444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:01.377444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:01.377444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:01.377444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:01.377444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:01.378493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:01.378493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:01.378493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:01.378493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:01.378493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:01.378493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:01.378493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:01.378493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:01.378493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:01.378493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:01.378493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:01.378493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:01.378493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:01.378493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:01.378493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:01.378493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:01.378493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:01.379410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:01.379410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:01.379410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:01.379410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:01.383762 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 278/560] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:01.384704 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a0ef0-f689-4dba-aa1a-978f145499f1 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:01.398859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:01.467454 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04565b73-e73e-4838-bb90-312ff8f57476 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:01.477319 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:01.493530 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a0ef0-f689-4dba-aa1a-978f145499f1 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:01.502423 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573860-1932-47e0-bdd3-2510ec754500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:01.504648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573860-1932-47e0-bdd3-2510ec754500 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:01.504648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573860-1932-47e0-bdd3-2510ec754500 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:01.504648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573860-1932-47e0-bdd3-2510ec754500 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:01.504648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72573860-1932-47e0-bdd3-2510ec754500 None admin] RBAC: Adding query filter params (name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:01.504950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72573860-1932-47e0-bdd3-2510ec754500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:01.506414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72573860-1932-47e0-bdd3-2510ec754500 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:01.515886 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 283/561] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:39:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:01.516719 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573860-1932-47e0-bdd3-2510ec754500 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:01.536749 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa106c-20b9-43e3-b3cf-2df61da7b313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:01.537607 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa106c-20b9-43e3-b3cf-2df61da7b313 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:01.537902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa106c-20b9-43e3-b3cf-2df61da7b313 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:01.538415 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa106c-20b9-43e3-b3cf-2df61da7b313 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:01.546241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa106c-20b9-43e3-b3cf-2df61da7b313 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:01.548173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa106c-20b9-43e3-b3cf-2df61da7b313 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:01.563138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-54aa106c-20b9-43e3-b3cf-2df61da7b313 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 19:39:01.563138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:01.563138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:01.563138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:01.563138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:01.563138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:01.563138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:01.563138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:01.563138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:01.563138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:01.563138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:01.563138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:01.563138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:01.563138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:01.563138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:01.563138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:01.564434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:01.564434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:01.564434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:01.564434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:01.564434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:01.564434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:01.564434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:01.564434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:01.564434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:01.564434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:01.564434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:01.564434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:01.564434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:01.564434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:01.564434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:01.564434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:01.564434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:01.564434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:01.565635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:01.565635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:01.565635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:01.565635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:01.565635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:01.565635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:01.565635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:01.565635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:01.565635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 19:39:01.565635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:01.569915 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 279/562] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 23 19:39:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:01.571304 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6fcb8-dee1-41dd-a92b-22d9814d1086 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:01.571598 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6fcb8-dee1-41dd-a92b-22d9814d1086 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:01.571885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6fcb8-dee1-41dd-a92b-22d9814d1086 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:01.573228 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 280/563] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:01.573906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6fcb8-dee1-41dd-a92b-22d9814d1086 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:01.642433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573860-1932-47e0-bdd3-2510ec754500 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:01.650268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:01.680182 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823af812-31bc-4522-a586-1d36478ffdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:01.681573 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823af812-31bc-4522-a586-1d36478ffdae None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:01.682015 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823af812-31bc-4522-a586-1d36478ffdae None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:01.682445 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823af812-31bc-4522-a586-1d36478ffdae None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:01.683313 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823af812-31bc-4522-a586-1d36478ffdae None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:01.683774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823af812-31bc-4522-a586-1d36478ffdae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:01.685045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6fcb8-dee1-41dd-a92b-22d9814d1086 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:01.685192 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823af812-31bc-4522-a586-1d36478ffdae None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:01.703535 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 284/564] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:01.703535 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823af812-31bc-4522-a586-1d36478ffdae None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:01.727361 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4b055-b443-434e-b8da-ba40a841da2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:01.728257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4b055-b443-434e-b8da-ba40a841da2a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:01.728539 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4b055-b443-434e-b8da-ba40a841da2a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:01.728812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4b055-b443-434e-b8da-ba40a841da2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:01.735925 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:01.739227 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4b055-b443-434e-b8da-ba40a841da2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:01.740663 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4b055-b443-434e-b8da-ba40a841da2a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:01.760002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-f6e4b055-b443-434e-b8da-ba40a841da2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:01.760002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:01.760002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:01.760002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:01.760002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:01.760002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:01.760002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:01.760002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:01.760002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:01.760002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:01.760002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:01.760002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:01.760002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:01.760002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:01.760002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:01.760906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:01.760906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:01.760906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:01.760906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:01.760906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:01.760906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:01.760906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:01.760906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:01.760906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:01.760906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:01.760906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:01.760906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:01.760906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:01.760906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:01.760906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:01.760906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:01.760906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:01.761836 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:01.761836 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:01.761836 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:01.761836 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:01.761836 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 281/565] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:01.762671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ebd33-be28-4125-981d-ce5f200790d4 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:01.762671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ebd33-be28-4125-981d-ce5f200790d4 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:01.762896 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ebd33-be28-4125-981d-ce5f200790d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:01.779866 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-817ebd33-be28-4125-981d-ce5f200790d4 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:01.781065 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-817ebd33-be28-4125-981d-ce5f200790d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:01.812701 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823af812-31bc-4522-a586-1d36478ffdae None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:01.848211 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d1238-1b4a-443e-9125-1ed949ab79c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:01.848871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d1238-1b4a-443e-9125-1ed949ab79c9 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:01.849169 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d1238-1b4a-443e-9125-1ed949ab79c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:01.849514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d1238-1b4a-443e-9125-1ed949ab79c9 None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:01.850275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d1238-1b4a-443e-9125-1ed949ab79c9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:01.851170 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d1238-1b4a-443e-9125-1ed949ab79c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:01.852675 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d1238-1b4a-443e-9125-1ed949ab79c9 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:01.861435 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 282/566] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:39:01.862309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ebd33-be28-4125-981d-ce5f200790d4 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:01.909334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 285/567] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 23 19:39:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:01.909334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d1238-1b4a-443e-9125-1ed949ab79c9 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:01.916700 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:01.968381 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ebd33-be28-4125-981d-ce5f200790d4 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:02.002429 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c316e-0dc1-47ad-be5f-95056b7b84d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:02.003478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c316e-0dc1-47ad-be5f-95056b7b84d5 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:02.003762 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c316e-0dc1-47ad-be5f-95056b7b84d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:02.004041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c316e-0dc1-47ad-be5f-95056b7b84d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:02.006138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:02.011243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c316e-0dc1-47ad-be5f-95056b7b84d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:02.012640 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c316e-0dc1-47ad-be5f-95056b7b84d5 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:02.018532 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d1238-1b4a-443e-9125-1ed949ab79c9 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:02.026138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-782c316e-0dc1-47ad-be5f-95056b7b84d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:02.026138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:02.026138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:02.026138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:02.026138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:02.026138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:02.026138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:02.026138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:02.026138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:02.026138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:02.026138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:02.026138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:02.026138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:02.026138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:02.026138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:02.027029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:02.027029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:02.027029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:02.027029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:02.027029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:02.027029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:02.027029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:02.027029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:02.027029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:02.027029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:02.027029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:02.027029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:02.027029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:02.027029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:02.027029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:02.027029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:02.027029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:02.028128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:02.028128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:02.028128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:02.028128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:02.028128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:02.028128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:02.028128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:02.028128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:02.028128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 283/568] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:02.028128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c316e-0dc1-47ad-be5f-95056b7b84d5 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:02.055109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d6e91-576e-400e-a79c-0917d4f3f670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:02.055771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d6e91-576e-400e-a79c-0917d4f3f670 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:02.056055 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d6e91-576e-400e-a79c-0917d4f3f670 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:02.056338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d6e91-576e-400e-a79c-0917d4f3f670 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:02.057061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d6e91-576e-400e-a79c-0917d4f3f670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:02.057400 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d6e91-576e-400e-a79c-0917d4f3f670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:02.058763 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d6e91-576e-400e-a79c-0917d4f3f670 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:02.070390 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 286/569] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:02.071174 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d6e91-576e-400e-a79c-0917d4f3f670 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:02.128910 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c316e-0dc1-47ad-be5f-95056b7b84d5 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:02.139030 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:02.162121 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130c5ea-afb2-42c3-baee-0d0e07463ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:02.163422 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130c5ea-afb2-42c3-baee-0d0e07463ea8 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:02.163723 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130c5ea-afb2-42c3-baee-0d0e07463ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:02.163997 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130c5ea-afb2-42c3-baee-0d0e07463ea8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:02.170022 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d6e91-576e-400e-a79c-0917d4f3f670 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:02.173971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130c5ea-afb2-42c3-baee-0d0e07463ea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:02.182368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-5130c5ea-afb2-42c3-baee-0d0e07463ea8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:02.182368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:02.182368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:02.182368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:02.182368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:02.182368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:02.182368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:02.182368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:02.182368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:02.182368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:02.182368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:02.182368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:02.182368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:02.182368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:02.182368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:02.182368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:02.183294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:02.183294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:02.183294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:02.183294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:02.183294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:02.183294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:02.183294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:02.183294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:02.183294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:02.183294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:02.183294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:02.183294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:02.183294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:02.183294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:02.183294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:02.183294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:02.184124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:02.184124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:02.184124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:02.184124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:02.184124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:02.184124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:02.184124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:02.184124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:02.184124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:02.184124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:02.184124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:02.184124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:02.184124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 284/570] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:39:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:02.185055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb466cab-ae93-40b3-b6bc-c160691acf0a None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:02.185363 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb466cab-ae93-40b3-b6bc-c160691acf0a None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:02.185637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb466cab-ae93-40b3-b6bc-c160691acf0a None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:02.187271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 285/571] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:02.187963 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb466cab-ae93-40b3-b6bc-c160691acf0a None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:02.207389 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652f89f-2000-4588-8565-1783cce35c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:02.208175 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f89f-2000-4588-8565-1783cce35c83 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:02.208459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f89f-2000-4588-8565-1783cce35c83 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:02.208736 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f89f-2000-4588-8565-1783cce35c83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:02.219002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652f89f-2000-4588-8565-1783cce35c83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:02.220939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652f89f-2000-4588-8565-1783cce35c83 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:02.229611 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:02.239124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-1652f89f-2000-4588-8565-1783cce35c83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:02.239124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:02.239124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:02.239124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:02.239124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:02.239124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:02.239124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:02.239124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:02.239124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:02.239124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:02.239124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:02.239124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:02.239124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:02.239124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:02.239124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:02.246010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:02.246010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:02.246010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:02.246010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:02.246010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:02.246010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:02.246010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:02.246010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:02.246010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:02.246010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:02.246010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:02.246010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:02.246010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:02.246010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:02.246010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:02.246010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:02.246010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:02.246925 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:02.246925 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:02.246925 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:02.246925 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:02.246925 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 287/572] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:02.246925 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652f89f-2000-4588-8565-1783cce35c83 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:02.290674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb466cab-ae93-40b3-b6bc-c160691acf0a None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:02.325450 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a448aa4-e507-4a98-8be0-98785f5f6e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:02.326111 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a448aa4-e507-4a98-8be0-98785f5f6e4a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:02.326399 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a448aa4-e507-4a98-8be0-98785f5f6e4a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:02.326683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a448aa4-e507-4a98-8be0-98785f5f6e4a None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:02.327472 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a448aa4-e507-4a98-8be0-98785f5f6e4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:02.327785 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a448aa4-e507-4a98-8be0-98785f5f6e4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:02.329297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a448aa4-e507-4a98-8be0-98785f5f6e4a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:02.339358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652f89f-2000-4588-8565-1783cce35c83 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:02.341176 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 286/573] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:02.346203 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a448aa4-e507-4a98-8be0-98785f5f6e4a None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:02.373689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:02.379510 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c109eb2-0df5-4bcb-9af3-ba2c9e90731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:02.380301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c109eb2-0df5-4bcb-9af3-ba2c9e90731c None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:02.380583 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c109eb2-0df5-4bcb-9af3-ba2c9e90731c None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:02.380857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c109eb2-0df5-4bcb-9af3-ba2c9e90731c None admin] PATH_INFO: `/v3/users/glance` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:02.388323 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c109eb2-0df5-4bcb-9af3-ba2c9e90731c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:02.389868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c109eb2-0df5-4bcb-9af3-ba2c9e90731c None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:02.403854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-1c109eb2-0df5-4bcb-9af3-ba2c9e90731c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 19:39:02.403854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:02.403854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:02.403854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:02.403854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:02.403854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:02.403854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:02.403854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:02.403854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:02.403854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:02.403854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:02.403854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:02.403854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:02.403854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:02.403854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:02.403854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:02.404813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:02.404813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:02.404813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:02.404813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:02.404813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:02.404813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:02.404813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:02.404813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:02.404813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:02.404813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:02.404813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:02.404813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:02.404813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:02.404813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:02.404813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:02.404813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:02.404813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:02.404813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:02.405818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:02.405818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:02.405818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:02.405818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:02.405818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:02.405818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:02.405818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:02.405818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:02.405818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 19:39:02.405818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:02.405818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 288/574] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:39:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:02.406397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b66f35-95e2-4c88-afc0-56ba5e51a6f3 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:02.406465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b66f35-95e2-4c88-afc0-56ba5e51a6f3 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:02.406779 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b66f35-95e2-4c88-afc0-56ba5e51a6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:02.423188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-38b66f35-95e2-4c88-afc0-56ba5e51a6f3 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:02.424362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-38b66f35-95e2-4c88-afc0-56ba5e51a6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:02.452737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a448aa4-e507-4a98-8be0-98785f5f6e4a None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:02.485586 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:02.488197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df3fb3-6fef-4b2a-8e46-48ac60b1a6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:02.488862 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df3fb3-6fef-4b2a-8e46-48ac60b1a6f4 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:02.489146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df3fb3-6fef-4b2a-8e46-48ac60b1a6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:02.489457 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df3fb3-6fef-4b2a-8e46-48ac60b1a6f4 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:02.490192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df3fb3-6fef-4b2a-8e46-48ac60b1a6f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:02.490498 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df3fb3-6fef-4b2a-8e46-48ac60b1a6f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:02.492335 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df3fb3-6fef-4b2a-8e46-48ac60b1a6f4 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:02.496229 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 289/575] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:39:02.501921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b66f35-95e2-4c88-afc0-56ba5e51a6f3 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:02.502028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 287/576] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:39:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:02.502028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df3fb3-6fef-4b2a-8e46-48ac60b1a6f4 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:02.596472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b66f35-95e2-4c88-afc0-56ba5e51a6f3 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:02.602248 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:02.610619 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df3fb3-6fef-4b2a-8e46-48ac60b1a6f4 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:02.631280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261a45b-b47f-4258-b5b9-5b9279740a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:02.632073 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261a45b-b47f-4258-b5b9-5b9279740a8b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:02.632359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261a45b-b47f-4258-b5b9-5b9279740a8b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:02.632877 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261a45b-b47f-4258-b5b9-5b9279740a8b None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:02.633416 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261a45b-b47f-4258-b5b9-5b9279740a8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:02.633730 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261a45b-b47f-4258-b5b9-5b9279740a8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:02.635106 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261a45b-b47f-4258-b5b9-5b9279740a8b None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:02.642920 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04eeb14-6520-4033-9d08-01fdf8260232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:02.643573 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04eeb14-6520-4033-9d08-01fdf8260232 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:02.643858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04eeb14-6520-4033-9d08-01fdf8260232 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:02.644138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04eeb14-6520-4033-9d08-01fdf8260232 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:02.645038 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04eeb14-6520-4033-9d08-01fdf8260232 None admin] RBAC: Adding query filter params (role.id=e466769ed9af47889225dd8d77e896a5, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=2cc53095a45e4136b37fb6e4e677eff9) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:02.645630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04eeb14-6520-4033-9d08-01fdf8260232 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:02.646092 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 290/577] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:02.646875 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261a45b-b47f-4258-b5b9-5b9279740a8b None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:02.648025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04eeb14-6520-4033-9d08-01fdf8260232 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:02.665220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 288/578] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:39:02 2022] GET /identity/v3/role_assignments?user.id=2cc53095a45e4136b37fb6e4e677eff9&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=e466769ed9af47889225dd8d77e896a5 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:02.665220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04eeb14-6520-4033-9d08-01fdf8260232 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:02.708591 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:02.767812 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261a45b-b47f-4258-b5b9-5b9279740a8b None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:02.778455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04eeb14-6520-4033-9d08-01fdf8260232 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:02.804989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5f968-c4e8-40d5-9a60-eb2ae12added None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:02.805697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5f968-c4e8-40d5-9a60-eb2ae12added None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:02.805975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5f968-c4e8-40d5-9a60-eb2ae12added None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:02.806253 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5f968-c4e8-40d5-9a60-eb2ae12added None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:02.807429 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5f968-c4e8-40d5-9a60-eb2ae12added None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:02.807429 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5f968-c4e8-40d5-9a60-eb2ae12added None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:02.808856 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5f968-c4e8-40d5-9a60-eb2ae12added None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:02.816427 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582a1a7-0d19-4926-9980-c81a1b1f0ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:02.822286 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582a1a7-0d19-4926-9980-c81a1b1f0ed6 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:02.822286 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582a1a7-0d19-4926-9980-c81a1b1f0ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:02.822286 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582a1a7-0d19-4926-9980-c81a1b1f0ed6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:02.828940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 291/579] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Jun 23 19:39:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:02.833273 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5f968-c4e8-40d5-9a60-eb2ae12added None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:02.834448 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582a1a7-0d19-4926-9980-c81a1b1f0ed6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:02.836675 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582a1a7-0d19-4926-9980-c81a1b1f0ed6 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:02.862408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-a582a1a7-0d19-4926-9980-c81a1b1f0ed6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:02.862408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:02.862408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:02.862408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:02.862408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:02.862408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:02.862408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:02.862408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:02.862408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:02.862408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:02.862408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:02.862408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:02.862408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:02.862408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:02.862408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:02.864005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:02.864005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:02.864005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:02.864005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:02.864005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:02.864005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:02.864005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:02.864005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:02.864005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:02.864005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:02.864005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:02.864005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:02.864005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:02.864005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:02.864005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:02.864005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:02.864005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:02.865137 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:02.865137 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:02.865137 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:02.865137 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:02.865137 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 289/580] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:02.865137 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582a1a7-0d19-4926-9980-c81a1b1f0ed6 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:02.904769 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:02.970684 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5f968-c4e8-40d5-9a60-eb2ae12added None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:02.981682 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:02.998766 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582a1a7-0d19-4926-9980-c81a1b1f0ed6 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:03.009067 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20514b6c-8252-4d0b-80e2-ea17522d1a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:03.009882 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20514b6c-8252-4d0b-80e2-ea17522d1a82 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:03.010172 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20514b6c-8252-4d0b-80e2-ea17522d1a82 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:03.010453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20514b6c-8252-4d0b-80e2-ea17522d1a82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:03.022500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20514b6c-8252-4d0b-80e2-ea17522d1a82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:03.030777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-20514b6c-8252-4d0b-80e2-ea17522d1a82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:03.030777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:03.030777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:03.030777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:03.030777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:03.030777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:03.030777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:03.030777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:03.030777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:03.030777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:03.030777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:03.030777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:03.030777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:03.030777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:03.030777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:03.030777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:03.031722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:03.031722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:03.031722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:03.031722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:03.031722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:03.031722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:03.031722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:03.031722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:03.031722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:03.031722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:03.031722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:03.031722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:03.031722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:03.031722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:03.031722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:03.031722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:03.032656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:03.032656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:03.032656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:03.032656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:03.032656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:03.032656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:03.032656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:03.032656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:03.032656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:03.032656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:03.032656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:03.032656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:03.032656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 292/581] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:39:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:03.034088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20514b6c-8252-4d0b-80e2-ea17522d1a82 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:03.034166 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882283c7-08b9-4b63-b5db-6626e27c49ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:03.034803 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882283c7-08b9-4b63-b5db-6626e27c49ae None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:03.035089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882283c7-08b9-4b63-b5db-6626e27c49ae None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:03.035387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882283c7-08b9-4b63-b5db-6626e27c49ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:03.044752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882283c7-08b9-4b63-b5db-6626e27c49ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:03.046260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882283c7-08b9-4b63-b5db-6626e27c49ae None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:03.061636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-882283c7-08b9-4b63-b5db-6626e27c49ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:03.061636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:03.061636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:03.061636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:03.061636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:03.061636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:03.061636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:03.061636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:03.061636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:03.061636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:03.061636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:03.061636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:03.061636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:03.061636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:03.061636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:03.062733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:03.062733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:03.062733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:03.062733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:03.062733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:03.062733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:03.062733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:03.062733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:03.062733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:03.062733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:03.062733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:03.062733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:03.062733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:03.062733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:03.062733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:03.062733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:03.062733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:03.064092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:03.064092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:03.064092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:03.064092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:03.064092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:03.064092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:03.064092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:03.064092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:03.064092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 290/582] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:03.068150 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882283c7-08b9-4b63-b5db-6626e27c49ae None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:03.138303 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:03.148689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20514b6c-8252-4d0b-80e2-ea17522d1a82 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:03.180651 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882283c7-08b9-4b63-b5db-6626e27c49ae None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:03.185102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72114b-170b-49a0-bc51-8f00d65203cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:03.185930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72114b-170b-49a0-bc51-8f00d65203cc None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:03.186217 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72114b-170b-49a0-bc51-8f00d65203cc None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:03.186497 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72114b-170b-49a0-bc51-8f00d65203cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:03.198525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72114b-170b-49a0-bc51-8f00d65203cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:03.199993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72114b-170b-49a0-bc51-8f00d65203cc None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:03.217997 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54695ab3-8ada-409a-a636-1d1a30dab4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:03.218163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-fd72114b-170b-49a0-bc51-8f00d65203cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:03.218163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:03.218163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:03.218163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:03.218163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:03.218163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:03.218163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:03.218163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:03.218163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:03.218163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:03.218163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:03.218163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:03.218163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:03.218163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:03.218163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:03.219026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:03.219026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:03.219026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:03.219026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:03.219026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:03.219026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:03.219026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:03.219026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:03.219026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:03.219026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:03.219026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:03.219026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:03.219026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:03.219026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:03.219026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:03.219026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:03.219026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:03.219939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:03.219939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:03.219939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:03.219939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:03.220160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54695ab3-8ada-409a-a636-1d1a30dab4c9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:03.220160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54695ab3-8ada-409a-a636-1d1a30dab4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:03.220160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54695ab3-8ada-409a-a636-1d1a30dab4c9 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:03.220160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54695ab3-8ada-409a-a636-1d1a30dab4c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:03.221581 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54695ab3-8ada-409a-a636-1d1a30dab4c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:03.222953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54695ab3-8ada-409a-a636-1d1a30dab4c9 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:03.223916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 293/583] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:03.224738 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72114b-170b-49a0-bc51-8f00d65203cc None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:03.235119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 291/584] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:03.238880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54695ab3-8ada-409a-a636-1d1a30dab4c9 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:03.249525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:03.336454 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72114b-170b-49a0-bc51-8f00d65203cc None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:03.356496 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54695ab3-8ada-409a-a636-1d1a30dab4c9 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:03.373113 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf0e93-564a-4060-b35a-874c2a197c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:03.373771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf0e93-564a-4060-b35a-874c2a197c80 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:03.374120 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf0e93-564a-4060-b35a-874c2a197c80 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:03.374650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf0e93-564a-4060-b35a-874c2a197c80 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:03.375142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf0e93-564a-4060-b35a-874c2a197c80 None admin] RBAC: Adding query filter params (name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:03.375488 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf0e93-564a-4060-b35a-874c2a197c80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:03.376909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf0e93-564a-4060-b35a-874c2a197c80 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:03.385913 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 294/585] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:39:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:03.386690 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf0e93-564a-4060-b35a-874c2a197c80 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:03.395409 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:03.405210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e222f15-7f8e-46a1-a07b-ce7d7ca10036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:03.405882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e222f15-7f8e-46a1-a07b-ce7d7ca10036 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:03.406174 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e222f15-7f8e-46a1-a07b-ce7d7ca10036 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:03.406463 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e222f15-7f8e-46a1-a07b-ce7d7ca10036 None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:03.407264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e222f15-7f8e-46a1-a07b-ce7d7ca10036 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:03.407583 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e222f15-7f8e-46a1-a07b-ce7d7ca10036 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:03.409015 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e222f15-7f8e-46a1-a07b-ce7d7ca10036 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:03.422027 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 292/586] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:03.423037 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e222f15-7f8e-46a1-a07b-ce7d7ca10036 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:03.483149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:03.501361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf0e93-564a-4060-b35a-874c2a197c80 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:03.528938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e222f15-7f8e-46a1-a07b-ce7d7ca10036 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:03.538770 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e930f30-00ca-4ed1-8fd8-2f5267e5a200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:03.539557 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e930f30-00ca-4ed1-8fd8-2f5267e5a200 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:03.540240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e930f30-00ca-4ed1-8fd8-2f5267e5a200 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:03.540716 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e930f30-00ca-4ed1-8fd8-2f5267e5a200 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:03.541475 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e930f30-00ca-4ed1-8fd8-2f5267e5a200 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:03.541880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e930f30-00ca-4ed1-8fd8-2f5267e5a200 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:03.543351 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e930f30-00ca-4ed1-8fd8-2f5267e5a200 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:03.560767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 295/587] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:03.560767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e930f30-00ca-4ed1-8fd8-2f5267e5a200 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:03.568784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ae886-3442-42eb-88a5-c5f288d5c804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:03.570463 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ae886-3442-42eb-88a5-c5f288d5c804 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:03.570748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ae886-3442-42eb-88a5-c5f288d5c804 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:03.571023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ae886-3442-42eb-88a5-c5f288d5c804 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:03.579134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ae886-3442-42eb-88a5-c5f288d5c804 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:03.580565 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ae886-3442-42eb-88a5-c5f288d5c804 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:03.594858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-701ae886-3442-42eb-88a5-c5f288d5c804 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 19:39:03.594858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:03.594858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:03.594858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:03.594858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:03.594858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:03.594858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:03.594858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:03.594858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:03.594858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:03.594858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:03.594858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:03.594858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:03.594858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:03.594858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:03.594858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:03.595784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:03.595784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:03.595784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:03.595784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:03.595784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:03.595784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:03.595784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:03.595784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:03.595784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:03.595784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:03.595784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:03.595784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:03.595784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:03.595784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:03.595784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:03.595784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:03.595784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:03.595784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:03.596748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:03.596748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:03.596748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:03.596748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:03.596748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:03.596748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:03.596748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:03.596748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:03.596748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 19:39:03.596748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:03.596748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 293/588] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:39:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:03.596748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ae886-3442-42eb-88a5-c5f288d5c804 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:03.649602 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:03.669888 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e930f30-00ca-4ed1-8fd8-2f5267e5a200 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:03.703043 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ae886-3442-42eb-88a5-c5f288d5c804 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:03.705418 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93832948-5585-49be-b122-008e55c499ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:03.706213 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93832948-5585-49be-b122-008e55c499ac None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:03.706497 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93832948-5585-49be-b122-008e55c499ac None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:03.706775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93832948-5585-49be-b122-008e55c499ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:03.717963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93832948-5585-49be-b122-008e55c499ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:03.724681 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93832948-5585-49be-b122-008e55c499ac None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:03.727165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:03.739279 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48410b-65ba-4f53-ac9d-51a3218a3371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:03.742283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48410b-65ba-4f53-ac9d-51a3218a3371 None admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:03.742283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48410b-65ba-4f53-ac9d-51a3218a3371 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:03.742283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48410b-65ba-4f53-ac9d-51a3218a3371 None admin] PATH_INFO: `/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/83bff5cd7782423eaa0bc5b29b208ae7/roles/e466769ed9af47889225dd8d77e896a5` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:03.744188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-93832948-5585-49be-b122-008e55c499ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:03.744188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:03.744188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:03.744188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:03.744188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:03.744188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:03.744188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:03.744188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:03.744188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:03.744188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:03.744188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:03.744188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:03.744188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:03.744188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:03.744188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:03.745138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:03.745138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:03.745138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:03.745138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:03.745138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:03.745138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:03.745138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:03.745138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:03.745138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:03.745138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:03.745138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:03.745138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:03.745138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:03.745138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:03.745138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:03.745138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:03.745138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:03.746039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:03.746039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:03.746039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:03.746039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:03.746039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 296/589] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:03.746318 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93832948-5585-49be-b122-008e55c499ac None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:03.766405 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48410b-65ba-4f53-ac9d-51a3218a3371 None admin] RBAC: Authorizing `identity:create_grant(project_id=368f41dc1ae64e199b604ee72545c88e, user_id=83bff5cd7782423eaa0bc5b29b208ae7, role_id=e466769ed9af47889225dd8d77e896a5)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:03.767866 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48410b-65ba-4f53-ac9d-51a3218a3371 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:03.850729 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 294/590] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:39:03 2022] PUT /identity/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/83bff5cd7782423eaa0bc5b29b208ae7/roles/e466769ed9af47889225dd8d77e896a5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:39:03.851359 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48410b-65ba-4f53-ac9d-51a3218a3371 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:03.854759 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93832948-5585-49be-b122-008e55c499ac None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:03.902270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da6cf2-474c-4d7f-84be-91437797adf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:03.902708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da6cf2-474c-4d7f-84be-91437797adf0 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:03.903054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da6cf2-474c-4d7f-84be-91437797adf0 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:03.903339 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da6cf2-474c-4d7f-84be-91437797adf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:03.911869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da6cf2-474c-4d7f-84be-91437797adf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:03.913627 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da6cf2-474c-4d7f-84be-91437797adf0 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:03.929605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-87da6cf2-474c-4d7f-84be-91437797adf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:03.929605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:03.929605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:03.929605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:03.929605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:03.929605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:03.929605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:03.929605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:03.929605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:03.929605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:03.929605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:03.929605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:03.929605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:03.929605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:03.929605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:03.930559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:03.930559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:03.930559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:03.930559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:03.930559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:03.930559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:03.930559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:03.930559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:03.930559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:03.930559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:03.930559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:03.930559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:03.930559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:03.930559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:03.930559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:03.930559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:03.930559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:03.931468 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:03.931468 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:03.931468 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:03.931468 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:03.931468 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:03.931468 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:03.931468 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:03.931468 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:03.935817 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 297/591] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:03.936680 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da6cf2-474c-4d7f-84be-91437797adf0 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:04.002401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:04.008447 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:04.013363 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48410b-65ba-4f53-ac9d-51a3218a3371 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:04.053199 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da6cf2-474c-4d7f-84be-91437797adf0 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:04.061355 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f0d9a-f9f1-438e-b3e9-2fc105b53408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:04.062059 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f0d9a-f9f1-438e-b3e9-2fc105b53408 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:04.062348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f0d9a-f9f1-438e-b3e9-2fc105b53408 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:04.062628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f0d9a-f9f1-438e-b3e9-2fc105b53408 None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:04.063594 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f0d9a-f9f1-438e-b3e9-2fc105b53408 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:04.063967 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f0d9a-f9f1-438e-b3e9-2fc105b53408 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:04.066218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f0d9a-f9f1-438e-b3e9-2fc105b53408 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:04.089361 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 295/592] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Jun 23 19:39:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:04.090224 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f0d9a-f9f1-438e-b3e9-2fc105b53408 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:04.100169 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f9677-849c-4cf4-b181-487d44452529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:04.102949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f9677-849c-4cf4-b181-487d44452529 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:04.102949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f9677-849c-4cf4-b181-487d44452529 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:04.102949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f9677-849c-4cf4-b181-487d44452529 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:04.102949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f9677-849c-4cf4-b181-487d44452529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:04.103227 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f9677-849c-4cf4-b181-487d44452529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:04.104393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f9677-849c-4cf4-b181-487d44452529 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:04.117923 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 298/593] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:04.122949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f9677-849c-4cf4-b181-487d44452529 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:04.194242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f0d9a-f9f1-438e-b3e9-2fc105b53408 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:04.239632 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28177e-2f9a-4965-9d37-78ea6d561db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:04.240702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28177e-2f9a-4965-9d37-78ea6d561db7 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:04.241675 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28177e-2f9a-4965-9d37-78ea6d561db7 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:04.242420 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28177e-2f9a-4965-9d37-78ea6d561db7 None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:04.242902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28177e-2f9a-4965-9d37-78ea6d561db7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:04.243217 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28177e-2f9a-4965-9d37-78ea6d561db7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:04.244289 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f9677-849c-4cf4-b181-487d44452529 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:04.244663 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28177e-2f9a-4965-9d37-78ea6d561db7 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:04.260710 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:04.262287 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 296/594] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:04.263144 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28177e-2f9a-4965-9d37-78ea6d561db7 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:04.285825 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:04.287234 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7a9e8-bdd8-4ce3-bad1-6e489dc73df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:04.288195 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7a9e8-bdd8-4ce3-bad1-6e489dc73df7 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:04.288608 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7a9e8-bdd8-4ce3-bad1-6e489dc73df7 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:04.289251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7a9e8-bdd8-4ce3-bad1-6e489dc73df7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:04.301655 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7a9e8-bdd8-4ce3-bad1-6e489dc73df7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:04.304080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7a9e8-bdd8-4ce3-bad1-6e489dc73df7 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:04.323885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-8ea7a9e8-bdd8-4ce3-bad1-6e489dc73df7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:04.323885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:04.323885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:04.323885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:04.323885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:04.323885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:04.323885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:04.323885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:04.323885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:04.323885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:04.323885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:04.323885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:04.323885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:04.323885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:04.323885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:04.324996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:04.324996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:04.324996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:04.324996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:04.324996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:04.324996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:04.324996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:04.324996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:04.324996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:04.324996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:04.324996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:04.324996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:04.324996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:04.324996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:04.324996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:04.324996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:04.324996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:04.326119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:04.326119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:04.326119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:04.326119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:04.331929 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 299/595] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:04.332860 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7a9e8-bdd8-4ce3-bad1-6e489dc73df7 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:04.398514 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28177e-2f9a-4965-9d37-78ea6d561db7 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:04.438725 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc107037-7da0-4c8a-ab45-7e3c16ab2ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:04.439684 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc107037-7da0-4c8a-ab45-7e3c16ab2ea8 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:04.440217 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc107037-7da0-4c8a-ab45-7e3c16ab2ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:04.440546 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc107037-7da0-4c8a-ab45-7e3c16ab2ea8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:04.449779 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc107037-7da0-4c8a-ab45-7e3c16ab2ea8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:04.451372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc107037-7da0-4c8a-ab45-7e3c16ab2ea8 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:04.454555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7a9e8-bdd8-4ce3-bad1-6e489dc73df7 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:04.467102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-fc107037-7da0-4c8a-ab45-7e3c16ab2ea8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 19:39:04.467102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:04.467102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:04.467102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:04.467102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:04.467102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:04.467102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:04.467102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:04.467102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:04.467102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:04.467102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:04.467102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:04.467102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:04.467102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:04.467102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:04.467102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:04.468218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:04.468218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:04.468218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:04.468218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:04.468218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:04.468218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:04.468218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:04.468218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:04.468218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:04.468218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:04.468218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:04.468218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:04.468218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:04.468218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:04.468218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:04.468218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:04.468218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:04.468218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:04.469200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:04.469200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:04.469200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:04.469200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:04.469200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:04.469200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:04.469200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:04.469200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:04.469200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 19:39:04.469200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:04.473748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 297/596] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:39:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:04.474530 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc107037-7da0-4c8a-ab45-7e3c16ab2ea8 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:04.501715 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74d807-a82f-4b63-b895-d5b3e8da59c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:04.503571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74d807-a82f-4b63-b895-d5b3e8da59c9 None admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:04.504330 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74d807-a82f-4b63-b895-d5b3e8da59c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:04.504818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74d807-a82f-4b63-b895-d5b3e8da59c9 None admin] PATH_INFO: `/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/f078219032be4b619119d1d9d59c499d/roles/e466769ed9af47889225dd8d77e896a5` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:04.524545 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74d807-a82f-4b63-b895-d5b3e8da59c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=368f41dc1ae64e199b604ee72545c88e, user_id=f078219032be4b619119d1d9d59c499d, role_id=e466769ed9af47889225dd8d77e896a5)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:04.527117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74d807-a82f-4b63-b895-d5b3e8da59c9 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:04.559626 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:04.582936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc107037-7da0-4c8a-ab45-7e3c16ab2ea8 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:04.609952 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 300/597] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:39:04 2022] PUT /identity/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/f078219032be4b619119d1d9d59c499d/roles/e466769ed9af47889225dd8d77e896a5 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:39:04.611605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74d807-a82f-4b63-b895-d5b3e8da59c9 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:04.632363 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0015bf-3bfd-4414-a59d-09b16989410a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:04.634331 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0015bf-3bfd-4414-a59d-09b16989410a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:04.634484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0015bf-3bfd-4414-a59d-09b16989410a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:04.634834 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0015bf-3bfd-4414-a59d-09b16989410a None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:04.635643 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0015bf-3bfd-4414-a59d-09b16989410a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:04.636062 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0015bf-3bfd-4414-a59d-09b16989410a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:04.637814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0015bf-3bfd-4414-a59d-09b16989410a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:04.655399 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:04.675789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 298/598] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:04.681486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0015bf-3bfd-4414-a59d-09b16989410a None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:04.783629 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74d807-a82f-4b63-b895-d5b3e8da59c9 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:04.831939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0015bf-3bfd-4414-a59d-09b16989410a None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:04.836696 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5872b8-e496-407f-a2b6-98e75f364bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:04.836696 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5872b8-e496-407f-a2b6-98e75f364bd7 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:04.836696 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5872b8-e496-407f-a2b6-98e75f364bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:04.836696 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5872b8-e496-407f-a2b6-98e75f364bd7 None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:04.837026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5872b8-e496-407f-a2b6-98e75f364bd7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:04.837026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5872b8-e496-407f-a2b6-98e75f364bd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:04.837813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5872b8-e496-407f-a2b6-98e75f364bd7 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:04.864410 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 301/599] 10.222.0.13 () {56 vars in 1139 bytes} [Thu Jun 23 19:39:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:04.864410 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1cea7-88ea-4309-a2c0-50f8eb9cd417 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:04.864410 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1cea7-88ea-4309-a2c0-50f8eb9cd417 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:04.864410 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1cea7-88ea-4309-a2c0-50f8eb9cd417 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:04.864410 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 302/600] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:04.867125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1cea7-88ea-4309-a2c0-50f8eb9cd417 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:04.888441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583e5db-4fab-4ba9-81fc-a85723a5a702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:04.889789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583e5db-4fab-4ba9-81fc-a85723a5a702 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:04.899816 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583e5db-4fab-4ba9-81fc-a85723a5a702 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:04.899816 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583e5db-4fab-4ba9-81fc-a85723a5a702 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:04.899816 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:04.904888 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583e5db-4fab-4ba9-81fc-a85723a5a702 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:04.907159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583e5db-4fab-4ba9-81fc-a85723a5a702 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:04.927148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-9583e5db-4fab-4ba9-81fc-a85723a5a702 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:04.927148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:04.927148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:04.927148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:04.927148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:04.927148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:04.927148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:04.927148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:04.927148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:04.927148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:04.927148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:04.927148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:04.927148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:04.927148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:04.927148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:04.929146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:04.929146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:04.929146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:04.929146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:04.929146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:04.929146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:04.929146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:04.929146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:04.929146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:04.929146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:04.929146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:04.929146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:04.929146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:04.929146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:04.929146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:04.929146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:04.929146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:04.930089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:04.930089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:04.930089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:04.930089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:04.930089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:04.930089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:04.930089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:04.930089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:04.937617 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 299/601] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:04.938610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dd752-2d01-4a36-9d47-73aea39d72bc None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:04.938901 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dd752-2d01-4a36-9d47-73aea39d72bc None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:04.939181 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dd752-2d01-4a36-9d47-73aea39d72bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:04.963292 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-a35dd752-2d01-4a36-9d47-73aea39d72bc None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:04.964865 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-a35dd752-2d01-4a36-9d47-73aea39d72bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:04.966496 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:04.997716 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1cea7-88ea-4309-a2c0-50f8eb9cd417 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:05.049989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de9b04-ec18-4bb4-ad15-b103bf453109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:05.050695 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de9b04-ec18-4bb4-ad15-b103bf453109 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:05.050978 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de9b04-ec18-4bb4-ad15-b103bf453109 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:05.051254 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de9b04-ec18-4bb4-ad15-b103bf453109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:05.062381 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 300/602] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:39:05.063892 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35dd752-2d01-4a36-9d47-73aea39d72bc None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:05.070746 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de9b04-ec18-4bb4-ad15-b103bf453109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:05.072283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de9b04-ec18-4bb4-ad15-b103bf453109 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:05.105868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-17de9b04-ec18-4bb4-ad15-b103bf453109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:05.105868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:05.105868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:05.105868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:05.105868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:05.105868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:05.105868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:05.105868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:05.105868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:05.105868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:05.105868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:05.105868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:05.105868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:05.105868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:05.105868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:05.106835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:05.106835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:05.106835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:05.106835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:05.106835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:05.106835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:05.106835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:05.106835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:05.106835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:05.106835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:05.106835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:05.106835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:05.106835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:05.106835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:05.106835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:05.106835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:05.106835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:05.108341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:05.108341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:05.108341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:05.108341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:05.108341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 303/603] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:05.110037 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de9b04-ec18-4bb4-ad15-b103bf453109 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:05.201129 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35dd752-2d01-4a36-9d47-73aea39d72bc None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:05.216053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de9b04-ec18-4bb4-ad15-b103bf453109 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:05.236588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:05.249447 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f095d39-aeac-4e32-a0e6-cb1cf6dc062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:05.250610 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:05.254471 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f095d39-aeac-4e32-a0e6-cb1cf6dc062c None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:05.254471 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f095d39-aeac-4e32-a0e6-cb1cf6dc062c None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:05.254471 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f095d39-aeac-4e32-a0e6-cb1cf6dc062c None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:05.254471 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f095d39-aeac-4e32-a0e6-cb1cf6dc062c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:05.254471 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f095d39-aeac-4e32-a0e6-cb1cf6dc062c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:05.256507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f095d39-aeac-4e32-a0e6-cb1cf6dc062c None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:05.260461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432645d-4c72-4eb2-9a3d-4e10c7c65d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:05.261261 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432645d-4c72-4eb2-9a3d-4e10c7c65d51 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:05.261642 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432645d-4c72-4eb2-9a3d-4e10c7c65d51 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:05.262143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432645d-4c72-4eb2-9a3d-4e10c7c65d51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:05.273846 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432645d-4c72-4eb2-9a3d-4e10c7c65d51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:05.278250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 301/604] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:05.279771 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f095d39-aeac-4e32-a0e6-cb1cf6dc062c None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:05.281915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-4432645d-4c72-4eb2-9a3d-4e10c7c65d51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:05.281915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:05.281915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:05.281915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:05.281915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:05.281915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:05.281915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:05.281915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:05.281915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:05.281915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:05.281915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:05.281915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:05.281915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:05.281915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:05.281915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:05.281915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:05.283077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:05.283077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:05.283077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:05.283077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:05.283077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:05.283077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:05.283077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:05.283077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:05.283077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:05.283077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:05.283077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:05.283077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:05.283077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:05.283077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:05.283077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:05.283077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:05.284108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:05.284108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:05.284108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:05.284108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:05.284108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:05.284108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:05.284108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:05.284108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:05.284108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:05.284108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:05.284108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:05.284108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:05.285482 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 304/605] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:39:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:05.289750 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432645d-4c72-4eb2-9a3d-4e10c7c65d51 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:05.401599 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f095d39-aeac-4e32-a0e6-cb1cf6dc062c None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:05.417293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432645d-4c72-4eb2-9a3d-4e10c7c65d51 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:05.436519 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434ba30-9821-4126-b118-a8dc65e785c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:05.437351 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434ba30-9821-4126-b118-a8dc65e785c6 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:05.437737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434ba30-9821-4126-b118-a8dc65e785c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:05.438115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434ba30-9821-4126-b118-a8dc65e785c6 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:05.438936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434ba30-9821-4126-b118-a8dc65e785c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:05.439342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434ba30-9821-4126-b118-a8dc65e785c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:05.440814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434ba30-9821-4126-b118-a8dc65e785c6 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:05.454691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 302/606] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:05.455665 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434ba30-9821-4126-b118-a8dc65e785c6 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:05.464877 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e26ab-eac9-4934-8fee-d5ea36ac3f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:05.466551 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e26ab-eac9-4934-8fee-d5ea36ac3f63 None admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:05.467021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e26ab-eac9-4934-8fee-d5ea36ac3f63 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:05.467450 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e26ab-eac9-4934-8fee-d5ea36ac3f63 None admin] PATH_INFO: `/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/4ab2b3700cdf48f08a049fbb76ee189c/roles/e466769ed9af47889225dd8d77e896a5` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:05.484465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e26ab-eac9-4934-8fee-d5ea36ac3f63 None admin] RBAC: Authorizing `identity:create_grant(project_id=368f41dc1ae64e199b604ee72545c88e, user_id=4ab2b3700cdf48f08a049fbb76ee189c, role_id=e466769ed9af47889225dd8d77e896a5)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:05.486111 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e26ab-eac9-4934-8fee-d5ea36ac3f63 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:05.511037 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:05.563293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434ba30-9821-4126-b118-a8dc65e785c6 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:05.609486 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 305/607] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:39:05 2022] PUT /identity/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/4ab2b3700cdf48f08a049fbb76ee189c/roles/e466769ed9af47889225dd8d77e896a5 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:39:05.610638 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e26ab-eac9-4934-8fee-d5ea36ac3f63 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:05.610953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cfaa9-4569-41ad-bd72-61e17f93c2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:05.611915 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cfaa9-4569-41ad-bd72-61e17f93c2ca None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:05.612416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cfaa9-4569-41ad-bd72-61e17f93c2ca None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:05.612933 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cfaa9-4569-41ad-bd72-61e17f93c2ca None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:05.615496 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031cfaa9-4569-41ad-bd72-61e17f93c2ca None admin] RBAC: Adding query filter params (name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:05.616714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031cfaa9-4569-41ad-bd72-61e17f93c2ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:05.618609 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031cfaa9-4569-41ad-bd72-61e17f93c2ca None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:05.629511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 303/608] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:39:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:05.637058 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cfaa9-4569-41ad-bd72-61e17f93c2ca None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:05.693769 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:05.816059 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e26ab-eac9-4934-8fee-d5ea36ac3f63 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:05.827082 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cfaa9-4569-41ad-bd72-61e17f93c2ca None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:05.838303 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:05.859196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788227c3-cf32-40e7-b16d-0773ca2df7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:05.860322 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788227c3-cf32-40e7-b16d-0773ca2df7d8 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:05.860774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788227c3-cf32-40e7-b16d-0773ca2df7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:05.861243 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788227c3-cf32-40e7-b16d-0773ca2df7d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:05.868335 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f61dd-a358-416f-850f-8327a4e11d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:05.869232 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f61dd-a358-416f-850f-8327a4e11d9e None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:05.869457 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f61dd-a358-416f-850f-8327a4e11d9e None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:05.869741 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f61dd-a358-416f-850f-8327a4e11d9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:05.870540 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788227c3-cf32-40e7-b16d-0773ca2df7d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:05.872205 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788227c3-cf32-40e7-b16d-0773ca2df7d8 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:05.882460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f61dd-a358-416f-850f-8327a4e11d9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:05.883954 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f61dd-a358-416f-850f-8327a4e11d9e None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:05.888179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-788227c3-cf32-40e7-b16d-0773ca2df7d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:05.888179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:05.888179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:05.888179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:05.888179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:05.888179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:05.888179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:05.888179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:05.888179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:05.888179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:05.888179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:05.888179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:05.888179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:05.888179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:05.888179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:05.895640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:05.895640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:05.895640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:05.895640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:05.895640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:05.895640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:05.895640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:05.895640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:05.895640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:05.895640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:05.895640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:05.895640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:05.895640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:05.895640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:05.895640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:05.895640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:05.895640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:05.896596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:05.896596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:05.896596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:05.896596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:05.896596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:05.896596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:05.896596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:05.896596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:05.896596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 306/609] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:05.902014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788227c3-cf32-40e7-b16d-0773ca2df7d8 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:05.905097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-d23f61dd-a358-416f-850f-8327a4e11d9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:05.905097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:05.905097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:05.905097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:05.905097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:05.905097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:05.905097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:05.905097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:05.905097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:05.905097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:05.905097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:05.905097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:05.905097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:05.905097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:05.905097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:05.906016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:05.906016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:05.906016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:05.906016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:05.906016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:05.906016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:05.906016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:05.906016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:05.906016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:05.906016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:05.906016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:05.906016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:05.906016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:05.906016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:05.906016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:05.906016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:05.906016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:05.906947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:05.906947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:05.906947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:05.906947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:05.911053 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 304/610] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:05.912349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f61dd-a358-416f-850f-8327a4e11d9e None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:06.007596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:06.014453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788227c3-cf32-40e7-b16d-0773ca2df7d8 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:06.025987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f61dd-a358-416f-850f-8327a4e11d9e None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:06.057882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff2296-ff4c-4d86-acba-e6d6f933d3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:06.058552 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff2296-ff4c-4d86-acba-e6d6f933d3ff None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:06.058843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff2296-ff4c-4d86-acba-e6d6f933d3ff None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:06.059138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff2296-ff4c-4d86-acba-e6d6f933d3ff None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:06.059862 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff2296-ff4c-4d86-acba-e6d6f933d3ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:06.060171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff2296-ff4c-4d86-acba-e6d6f933d3ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:06.061569 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff2296-ff4c-4d86-acba-e6d6f933d3ff None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:06.080535 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 305/611] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:06.081785 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff2296-ff4c-4d86-acba-e6d6f933d3ff None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:06.084907 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc962f48-6a5b-4ec8-9303-dcbe75d5a812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:06.086222 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962f48-6a5b-4ec8-9303-dcbe75d5a812 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:06.086511 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962f48-6a5b-4ec8-9303-dcbe75d5a812 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:06.086793 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962f48-6a5b-4ec8-9303-dcbe75d5a812 None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:06.087605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc962f48-6a5b-4ec8-9303-dcbe75d5a812 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:06.087921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc962f48-6a5b-4ec8-9303-dcbe75d5a812 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:06.089405 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc962f48-6a5b-4ec8-9303-dcbe75d5a812 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:06.109649 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:06.117137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 307/612] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:06.122404 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc962f48-6a5b-4ec8-9303-dcbe75d5a812 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:06.196776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff2296-ff4c-4d86-acba-e6d6f933d3ff None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:06.233051 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83b0d1-2f9b-4d80-8cbd-47a5072e6974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:06.234056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83b0d1-2f9b-4d80-8cbd-47a5072e6974 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:06.234389 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83b0d1-2f9b-4d80-8cbd-47a5072e6974 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:06.234677 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83b0d1-2f9b-4d80-8cbd-47a5072e6974 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:06.243717 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83b0d1-2f9b-4d80-8cbd-47a5072e6974 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:06.245488 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83b0d1-2f9b-4d80-8cbd-47a5072e6974 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:06.248560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc962f48-6a5b-4ec8-9303-dcbe75d5a812 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:06.261438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-2c83b0d1-2f9b-4d80-8cbd-47a5072e6974 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 19:39:06.261438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:06.261438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:06.261438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:06.261438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:06.261438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:06.261438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:06.261438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:06.261438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:06.261438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:06.261438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:06.261438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:06.261438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:06.261438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:06.261438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:06.261438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:06.262392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:06.262392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:06.262392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:06.262392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:06.262392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:06.262392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:06.262392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:06.262392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:06.262392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:06.262392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:06.262392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:06.262392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:06.262392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:06.262392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:06.262392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:06.262392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:06.262392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:06.262392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:06.263329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:06.263329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:06.263329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:06.263329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:06.263329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:06.263329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:06.263329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:06.263329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:06.263329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 19:39:06.263329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:06.263329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 306/613] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:39:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:06.264426 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01991f71-23ba-480d-a2c7-0c0ad081ceff None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:06.264653 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01991f71-23ba-480d-a2c7-0c0ad081ceff None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:06.269240 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01991f71-23ba-480d-a2c7-0c0ad081ceff None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:06.269240 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 307/614] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:06.269240 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01991f71-23ba-480d-a2c7-0c0ad081ceff None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:06.297930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cf1aa-a257-446f-b797-72cdbca47af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:06.299562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cf1aa-a257-446f-b797-72cdbca47af6 None admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:06.299849 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cf1aa-a257-446f-b797-72cdbca47af6 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:06.300131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cf1aa-a257-446f-b797-72cdbca47af6 None admin] PATH_INFO: `/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/24bb6f31e87045f5b17f561b42edca6f/roles/e466769ed9af47889225dd8d77e896a5` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:06.321545 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6cf1aa-a257-446f-b797-72cdbca47af6 None admin] RBAC: Authorizing `identity:create_grant(project_id=368f41dc1ae64e199b604ee72545c88e, user_id=24bb6f31e87045f5b17f561b42edca6f, role_id=e466769ed9af47889225dd8d77e896a5)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:06.323547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6cf1aa-a257-446f-b797-72cdbca47af6 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:06.357354 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:06.376890 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01991f71-23ba-480d-a2c7-0c0ad081ceff None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:06.412089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950129b-b84d-4d2b-9012-129176c24650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:06.412766 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950129b-b84d-4d2b-9012-129176c24650 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:06.413748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950129b-b84d-4d2b-9012-129176c24650 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:06.414039 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950129b-b84d-4d2b-9012-129176c24650 None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:06.415125 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950129b-b84d-4d2b-9012-129176c24650 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:06.415555 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950129b-b84d-4d2b-9012-129176c24650 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:06.417008 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950129b-b84d-4d2b-9012-129176c24650 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:06.425656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 308/615] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:39:06 2022] PUT /identity/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/24bb6f31e87045f5b17f561b42edca6f/roles/e466769ed9af47889225dd8d77e896a5 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:39:06.427767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682746f1-3a78-4cd8-8b2f-f5216699f5fa None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:06.432906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682746f1-3a78-4cd8-8b2f-f5216699f5fa None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:06.433451 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682746f1-3a78-4cd8-8b2f-f5216699f5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:06.438672 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 308/616] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Jun 23 19:39:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:06.446044 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950129b-b84d-4d2b-9012-129176c24650 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:06.454729 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:06.470611 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-682746f1-3a78-4cd8-8b2f-f5216699f5fa None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:06.473790 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-682746f1-3a78-4cd8-8b2f-f5216699f5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:06.619774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 309/617] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:39:06.639608 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950129b-b84d-4d2b-9012-129176c24650 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:06.649580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682746f1-3a78-4cd8-8b2f-f5216699f5fa None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:06.687142 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d41b1-1352-456e-8133-3be0d577ccc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:06.688000 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d41b1-1352-456e-8133-3be0d577ccc1 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:06.688291 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d41b1-1352-456e-8133-3be0d577ccc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:06.688573 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d41b1-1352-456e-8133-3be0d577ccc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:06.698257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:06.705883 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d41b1-1352-456e-8133-3be0d577ccc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:06.708583 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d41b1-1352-456e-8133-3be0d577ccc1 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:06.735401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-fd3d41b1-1352-456e-8133-3be0d577ccc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:06.735401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:06.735401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:06.735401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:06.735401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:06.735401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:06.735401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:06.735401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:06.735401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:06.735401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:06.735401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:06.735401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:06.735401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:06.735401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:06.735401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:06.736455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:06.736455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:06.736455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:06.736455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:06.736455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:06.736455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:06.736455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:06.736455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:06.736455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:06.736455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:06.736455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:06.736455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:06.736455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:06.736455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:06.736455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:06.736455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:06.736455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:06.737412 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:06.737412 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:06.737412 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:06.737412 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:06.737412 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 309/618] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:06.743013 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d41b1-1352-456e-8133-3be0d577ccc1 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:06.791923 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682746f1-3a78-4cd8-8b2f-f5216699f5fa None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:06.855976 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefa50f-5780-442e-939c-4e19ffa3fac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:06.856790 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefa50f-5780-442e-939c-4e19ffa3fac2 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:06.857073 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefa50f-5780-442e-939c-4e19ffa3fac2 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:06.857378 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefa50f-5780-442e-939c-4e19ffa3fac2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:06.863174 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:06.865326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d41b1-1352-456e-8133-3be0d577ccc1 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:06.886002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbefa50f-5780-442e-939c-4e19ffa3fac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:06.893928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-dbefa50f-5780-442e-939c-4e19ffa3fac2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:06.893928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:06.893928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:06.893928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:06.893928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:06.893928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:06.893928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:06.893928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:06.893928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:06.893928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:06.893928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:06.893928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:06.893928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:06.893928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:06.893928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:06.893928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:06.895051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:06.895051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:06.895051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:06.895051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:06.895051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:06.895051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:06.895051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:06.895051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:06.895051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:06.895051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:06.895051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:06.895051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:06.895051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:06.895051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:06.895051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:06.895051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:06.895916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:06.895916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:06.895916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:06.895916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:06.895916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:06.895916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:06.895916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:06.895916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:06.895916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:06.895916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:06.895916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:06.895916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:06.897129 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 310/619] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:39:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:06.901174 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3743c35-c114-424a-a6fd-edb62aade5a3 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:06.901174 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3743c35-c114-424a-a6fd-edb62aade5a3 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:06.901174 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3743c35-c114-424a-a6fd-edb62aade5a3 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:06.902562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 311/620] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:06.907663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39763b70-7c7d-4743-8fbc-2a8dbc952f3e None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:06.907948 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39763b70-7c7d-4743-8fbc-2a8dbc952f3e None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:06.908249 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39763b70-7c7d-4743-8fbc-2a8dbc952f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:06.925658 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-39763b70-7c7d-4743-8fbc-2a8dbc952f3e None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:06.926860 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-39763b70-7c7d-4743-8fbc-2a8dbc952f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:06.942160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2146194-7cd0-438f-9c86-0b7a8ad4886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:06.943345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2146194-7cd0-438f-9c86-0b7a8ad4886f None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:06.943887 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2146194-7cd0-438f-9c86-0b7a8ad4886f None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:06.944985 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2146194-7cd0-438f-9c86-0b7a8ad4886f None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:06.945772 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2146194-7cd0-438f-9c86-0b7a8ad4886f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:06.946342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2146194-7cd0-438f-9c86-0b7a8ad4886f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:06.948208 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2146194-7cd0-438f-9c86-0b7a8ad4886f None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:06.965628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 310/621] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:06.966800 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2146194-7cd0-438f-9c86-0b7a8ad4886f None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:07.017239 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 312/622] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:39:07.018123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39763b70-7c7d-4743-8fbc-2a8dbc952f3e None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:07.037581 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:07.091521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2146194-7cd0-438f-9c86-0b7a8ad4886f None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:07.129970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d73e7-237e-4c4a-ab0b-e823095fcfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:07.130747 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d73e7-237e-4c4a-ab0b-e823095fcfb9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:07.131103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d73e7-237e-4c4a-ab0b-e823095fcfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:07.131451 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d73e7-237e-4c4a-ab0b-e823095fcfb9 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:07.132891 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d73e7-237e-4c4a-ab0b-e823095fcfb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:07.133297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d73e7-237e-4c4a-ab0b-e823095fcfb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:07.134749 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d73e7-237e-4c4a-ab0b-e823095fcfb9 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:07.144075 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 311/623] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:39:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:07.149147 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d73e7-237e-4c4a-ab0b-e823095fcfb9 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:07.166985 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39763b70-7c7d-4743-8fbc-2a8dbc952f3e None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:07.196761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:07.210288 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ee14c-337a-4ec1-aa6a-f959f986e5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:07.211681 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ee14c-337a-4ec1-aa6a-f959f986e5e0 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:07.219617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ee14c-337a-4ec1-aa6a-f959f986e5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:07.219617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ee14c-337a-4ec1-aa6a-f959f986e5e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:07.221988 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ee14c-337a-4ec1-aa6a-f959f986e5e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:07.224127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ee14c-337a-4ec1-aa6a-f959f986e5e0 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:07.242352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-6c5ee14c-337a-4ec1-aa6a-f959f986e5e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:07.242352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:07.242352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:07.242352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:07.242352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:07.242352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:07.242352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:07.242352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:07.242352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:07.242352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:07.242352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:07.242352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:07.242352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:07.242352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:07.242352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:07.244237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:07.244237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:07.244237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:07.244237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:07.244237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:07.244237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:07.244237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:07.244237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:07.244237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:07.244237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:07.244237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:07.244237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:07.244237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:07.244237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:07.244237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:07.244237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:07.244237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:07.246188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:07.246188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:07.246188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:07.246188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:07.246188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:07.246188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:07.246188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:07.246188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:07.246188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 313/624] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:07.247274 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ee14c-337a-4ec1-aa6a-f959f986e5e0 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:07.270328 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d73e7-237e-4c4a-ab0b-e823095fcfb9 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:07.288830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:07.311598 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893eddc9-73a7-4995-aeae-c8f4ded4528e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:07.312470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893eddc9-73a7-4995-aeae-c8f4ded4528e None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:07.315011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893eddc9-73a7-4995-aeae-c8f4ded4528e None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:07.315011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893eddc9-73a7-4995-aeae-c8f4ded4528e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:07.326041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893eddc9-73a7-4995-aeae-c8f4ded4528e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:07.337713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-893eddc9-73a7-4995-aeae-c8f4ded4528e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:07.337713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:07.337713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:07.337713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:07.337713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:07.337713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:07.337713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:07.337713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:07.337713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:07.337713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:07.337713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:07.337713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:07.337713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:07.337713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:07.337713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:07.337713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:07.339630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:07.339630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:07.339630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:07.339630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:07.339630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:07.339630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:07.339630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:07.339630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:07.339630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:07.339630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:07.339630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:07.339630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:07.339630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:07.339630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:07.339630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:07.339630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:07.341417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:07.341417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:07.341417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:07.341417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:07.341417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:07.341417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:07.341417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:07.341417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:07.341417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:07.341417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:07.341417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:07.341417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:07.346062 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 312/625] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:39:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:07.346062 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893eddc9-73a7-4995-aeae-c8f4ded4528e None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:07.371604 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ee14c-337a-4ec1-aa6a-f959f986e5e0 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:07.408209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fcc6c-7953-4303-a1a2-d5bea14cfbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:07.409024 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fcc6c-7953-4303-a1a2-d5bea14cfbf6 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:07.409414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fcc6c-7953-4303-a1a2-d5bea14cfbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:07.409766 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fcc6c-7953-4303-a1a2-d5bea14cfbf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:07.421454 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45fcc6c-7953-4303-a1a2-d5bea14cfbf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:07.423003 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45fcc6c-7953-4303-a1a2-d5bea14cfbf6 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:07.440592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-b45fcc6c-7953-4303-a1a2-d5bea14cfbf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:07.440592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:07.440592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:07.440592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:07.440592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:07.440592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:07.440592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:07.440592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:07.440592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:07.440592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:07.440592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:07.440592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:07.440592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:07.440592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:07.440592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:07.441796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:07.441796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:07.441796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:07.441796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:07.441796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:07.441796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:07.441796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:07.441796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:07.441796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:07.441796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:07.441796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:07.441796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:07.441796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:07.441796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:07.441796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:07.441796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:07.441796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:07.442909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:07.442909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:07.442909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:07.442909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:07.447958 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 314/626] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:07.449126 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fcc6c-7953-4303-a1a2-d5bea14cfbf6 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:07.477060 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893eddc9-73a7-4995-aeae-c8f4ded4528e None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:07.504455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:07.514190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe31353-ed16-4e1c-8bca-900a8e905a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:07.515169 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe31353-ed16-4e1c-8bca-900a8e905a63 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:07.515169 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe31353-ed16-4e1c-8bca-900a8e905a63 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:07.519925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe31353-ed16-4e1c-8bca-900a8e905a63 None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:07.519925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe31353-ed16-4e1c-8bca-900a8e905a63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:07.519925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe31353-ed16-4e1c-8bca-900a8e905a63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:07.519925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe31353-ed16-4e1c-8bca-900a8e905a63 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:07.531684 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 313/627] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:07.532545 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe31353-ed16-4e1c-8bca-900a8e905a63 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:07.567446 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:07.576318 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fcc6c-7953-4303-a1a2-d5bea14cfbf6 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:07.611387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874b26e-6e13-4519-88f6-233f71c8a4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:07.612502 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874b26e-6e13-4519-88f6-233f71c8a4f3 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:07.612502 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874b26e-6e13-4519-88f6-233f71c8a4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:07.612719 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874b26e-6e13-4519-88f6-233f71c8a4f3 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:07.613496 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874b26e-6e13-4519-88f6-233f71c8a4f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:07.613812 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874b26e-6e13-4519-88f6-233f71c8a4f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:07.615216 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874b26e-6e13-4519-88f6-233f71c8a4f3 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:07.628455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 315/628] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:39:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:07.629342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874b26e-6e13-4519-88f6-233f71c8a4f3 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:07.648728 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe31353-ed16-4e1c-8bca-900a8e905a63 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:07.688104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83054b2c-e15f-4dc6-806f-29b32b40b980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:07.689097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83054b2c-e15f-4dc6-806f-29b32b40b980 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:07.689582 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83054b2c-e15f-4dc6-806f-29b32b40b980 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:07.690056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83054b2c-e15f-4dc6-806f-29b32b40b980 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:07.690946 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83054b2c-e15f-4dc6-806f-29b32b40b980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:07.691410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83054b2c-e15f-4dc6-806f-29b32b40b980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:07.693211 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83054b2c-e15f-4dc6-806f-29b32b40b980 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:07.712215 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 314/629] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:07.713509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83054b2c-e15f-4dc6-806f-29b32b40b980 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:07.733945 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:07.736777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874b26e-6e13-4519-88f6-233f71c8a4f3 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:07.774629 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec99e1-6e49-4fd6-9fc4-f9c87f32d086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:07.775726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec99e1-6e49-4fd6-9fc4-f9c87f32d086 None admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:07.776033 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec99e1-6e49-4fd6-9fc4-f9c87f32d086 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:07.776395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec99e1-6e49-4fd6-9fc4-f9c87f32d086 None admin] PATH_INFO: `/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/2cc53095a45e4136b37fb6e4e677eff9/roles/e466769ed9af47889225dd8d77e896a5` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:07.793196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec99e1-6e49-4fd6-9fc4-f9c87f32d086 None admin] RBAC: Authorizing `identity:create_grant(project_id=368f41dc1ae64e199b604ee72545c88e, user_id=2cc53095a45e4136b37fb6e4e677eff9, role_id=e466769ed9af47889225dd8d77e896a5)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:07.794770 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec99e1-6e49-4fd6-9fc4-f9c87f32d086 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:07.816225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:07.825755 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83054b2c-e15f-4dc6-806f-29b32b40b980 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:07.859155 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599f2e1-c773-4c2a-8b72-5751703a0459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:07.859948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599f2e1-c773-4c2a-8b72-5751703a0459 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:07.860230 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599f2e1-c773-4c2a-8b72-5751703a0459 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:07.860505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599f2e1-c773-4c2a-8b72-5751703a0459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:07.871457 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599f2e1-c773-4c2a-8b72-5751703a0459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:07.873188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599f2e1-c773-4c2a-8b72-5751703a0459 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:07.894650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-1599f2e1-c773-4c2a-8b72-5751703a0459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:07.894650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:07.894650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:07.894650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:07.894650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:07.894650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:07.894650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:07.894650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:07.894650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:07.894650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:07.894650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:07.894650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:07.894650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:07.894650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:07.894650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:07.895578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:07.895578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:07.895578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:07.895578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:07.895578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:07.895578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:07.895578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:07.895578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:07.895578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:07.895578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:07.895578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:07.895578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:07.895578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:07.895578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:07.895578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:07.895578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:07.895578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:07.896914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:07.896914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:07.896914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:07.896914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:07.896914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 315/630] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:07.896914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599f2e1-c773-4c2a-8b72-5751703a0459 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:07.917330 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 316/631] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:39:07 2022] PUT /identity/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/2cc53095a45e4136b37fb6e4e677eff9/roles/e466769ed9af47889225dd8d77e896a5 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:39:07.917330 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec99e1-6e49-4fd6-9fc4-f9c87f32d086 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:08.112483 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599f2e1-c773-4c2a-8b72-5751703a0459 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:08.112979 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec99e1-6e49-4fd6-9fc4-f9c87f32d086 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:08.153249 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96af8c-5dc7-4b16-bc37-8e1401a23fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:08.155460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96af8c-5dc7-4b16-bc37-8e1401a23fb1 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:08.155460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96af8c-5dc7-4b16-bc37-8e1401a23fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:08.155653 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828713ba-dac6-4554-8c13-572ac914a308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:08.155753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96af8c-5dc7-4b16-bc37-8e1401a23fb1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:08.155827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828713ba-dac6-4554-8c13-572ac914a308 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:08.155827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828713ba-dac6-4554-8c13-572ac914a308 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:08.155827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828713ba-dac6-4554-8c13-572ac914a308 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:08.156409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828713ba-dac6-4554-8c13-572ac914a308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:08.157103 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828713ba-dac6-4554-8c13-572ac914a308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:08.159622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828713ba-dac6-4554-8c13-572ac914a308 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:08.169622 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96af8c-5dc7-4b16-bc37-8e1401a23fb1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:08.170845 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 317/632] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:08.171643 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96af8c-5dc7-4b16-bc37-8e1401a23fb1 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:08.172243 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306b919-9ee3-4418-9ac3-776e1f44d19e None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:08.172516 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306b919-9ee3-4418-9ac3-776e1f44d19e None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:08.172800 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306b919-9ee3-4418-9ac3-776e1f44d19e None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:08.174296 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 318/633] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:08.177252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306b919-9ee3-4418-9ac3-776e1f44d19e None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:08.191562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:08.196939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-3e96af8c-5dc7-4b16-bc37-8e1401a23fb1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 19:39:08.196939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:08.196939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:08.196939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:08.196939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:08.196939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:08.196939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:08.196939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:08.196939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:08.196939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:08.196939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:08.196939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:08.196939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:08.196939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:08.196939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:08.196939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:08.197948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:08.197948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:08.197948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:08.197948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:08.197948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:08.197948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:08.197948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:08.197948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:08.197948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:08.197948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:08.197948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:08.197948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:08.197948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:08.197948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:08.197948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:08.197948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:08.197948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:08.197948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:08.199359 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:08.199359 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:08.199359 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:08.199359 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:08.199359 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:08.199359 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:08.199359 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:08.199359 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:08.199359 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 19:39:08.199359 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:08.199359 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 316/634] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 23 19:39:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:08.204255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fd44f-d407-4c95-b66c-ee937738b75e None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:08.204548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fd44f-d407-4c95-b66c-ee937738b75e None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:08.207104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fd44f-d407-4c95-b66c-ee937738b75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:08.212103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:08.230119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-218fd44f-d407-4c95-b66c-ee937738b75e None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:08.231518 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-218fd44f-d407-4c95-b66c-ee937738b75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:08.291957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306b919-9ee3-4418-9ac3-776e1f44d19e None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:08.321017 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 317/635] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:39:08.321969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218fd44f-d407-4c95-b66c-ee937738b75e None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:08.347089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327495ed-29f5-4932-8c0b-5a5060ea9d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:08.347951 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327495ed-29f5-4932-8c0b-5a5060ea9d75 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:08.348248 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327495ed-29f5-4932-8c0b-5a5060ea9d75 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:08.348531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327495ed-29f5-4932-8c0b-5a5060ea9d75 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:08.363183 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327495ed-29f5-4932-8c0b-5a5060ea9d75 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:08.364663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327495ed-29f5-4932-8c0b-5a5060ea9d75 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:08.380082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-327495ed-29f5-4932-8c0b-5a5060ea9d75 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 19:39:08.380082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:08.380082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:08.380082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:08.380082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:08.380082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:08.380082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:08.380082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:08.380082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:08.380082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:08.380082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:08.380082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:08.380082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:08.380082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:08.380082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:08.380082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:08.383063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:08.383063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:08.383063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:08.383063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:08.383063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:08.383063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:08.383063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:08.383063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:08.383063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:08.383063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:08.383063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:08.383063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:08.383063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:08.383063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:08.383063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:08.383063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:08.383063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:08.383063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:08.384801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:08.384801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:08.384801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:08.384801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:08.384801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:08.384801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:08.384801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:08.384801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:08.384801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 19:39:08.384801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:08.384801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 319/636] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:39:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:08.384801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327495ed-29f5-4932-8c0b-5a5060ea9d75 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:08.441053 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218fd44f-d407-4c95-b66c-ee937738b75e None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:08.479330 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a49ce2-a864-4dcb-9a76-3e09f545fc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:08.480497 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a49ce2-a864-4dcb-9a76-3e09f545fc8c None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:08.481065 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a49ce2-a864-4dcb-9a76-3e09f545fc8c None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:08.481624 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:08.482336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a49ce2-a864-4dcb-9a76-3e09f545fc8c None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:08.484755 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a49ce2-a864-4dcb-9a76-3e09f545fc8c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:08.485614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a49ce2-a864-4dcb-9a76-3e09f545fc8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:08.488382 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a49ce2-a864-4dcb-9a76-3e09f545fc8c None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:08.492052 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:08.528720 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 318/637] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 23 19:39:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:08.530224 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a49ce2-a864-4dcb-9a76-3e09f545fc8c None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:08.531635 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327495ed-29f5-4932-8c0b-5a5060ea9d75 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:08.578386 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e056680-837f-4323-865b-7937537df679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:08.579195 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e056680-837f-4323-865b-7937537df679 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:08.579480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e056680-837f-4323-865b-7937537df679 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:08.579765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e056680-837f-4323-865b-7937537df679 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:08.595866 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e056680-837f-4323-865b-7937537df679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:08.607097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-2e056680-837f-4323-865b-7937537df679 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:08.607097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:08.607097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:08.607097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:08.607097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:08.607097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:08.607097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:08.607097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:08.607097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:08.607097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:08.607097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:08.607097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:08.607097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:08.607097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:08.607097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:08.607097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:08.608112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:08.608112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:08.608112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:08.608112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:08.608112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:08.608112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:08.608112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:08.608112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:08.608112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:08.608112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:08.608112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:08.608112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:08.608112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:08.608112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:08.608112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:08.608112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:08.608967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:08.608967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:08.608967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:08.608967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:08.608967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:08.608967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:08.608967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:08.608967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:08.608967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:08.608967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:08.608967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:08.608967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:08.613148 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 320/638] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:39:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:08.614745 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e056680-837f-4323-865b-7937537df679 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:08.655897 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a49ce2-a864-4dcb-9a76-3e09f545fc8c None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:08.693953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3464c1-2198-42d6-b1bb-bdf23e94fea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:08.695522 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3464c1-2198-42d6-b1bb-bdf23e94fea7 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:08.696016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3464c1-2198-42d6-b1bb-bdf23e94fea7 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:08.696490 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3464c1-2198-42d6-b1bb-bdf23e94fea7 None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:08.697544 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3464c1-2198-42d6-b1bb-bdf23e94fea7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:08.698078 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3464c1-2198-42d6-b1bb-bdf23e94fea7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:08.699797 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3464c1-2198-42d6-b1bb-bdf23e94fea7 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:08.723849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 319/639] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Jun 23 19:39:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:08.725104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3464c1-2198-42d6-b1bb-bdf23e94fea7 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:08.727764 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e056680-837f-4323-865b-7937537df679 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:08.760118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:08.765536 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef96c8-5df4-405d-9f0b-f643a9052fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:08.766196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef96c8-5df4-405d-9f0b-f643a9052fcc None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:08.766486 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef96c8-5df4-405d-9f0b-f643a9052fcc None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:08.766770 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef96c8-5df4-405d-9f0b-f643a9052fcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:08.781560 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:08.832250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3464c1-2198-42d6-b1bb-bdf23e94fea7 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:08.836303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef96c8-5df4-405d-9f0b-f643a9052fcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:08.837845 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef96c8-5df4-405d-9f0b-f643a9052fcc None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:08.875757 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33566b8-3293-44b0-986f-695789cf54fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:08.876355 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33566b8-3293-44b0-986f-695789cf54fa None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:08.876755 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33566b8-3293-44b0-986f-695789cf54fa None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:08.877039 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33566b8-3293-44b0-986f-695789cf54fa None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:08.877824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33566b8-3293-44b0-986f-695789cf54fa None admin] RBAC: Adding query filter params (name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:08.878135 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33566b8-3293-44b0-986f-695789cf54fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:08.879506 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33566b8-3293-44b0-986f-695789cf54fa None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:08.894245 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 320/640] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:39:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:08.894245 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33566b8-3293-44b0-986f-695789cf54fa None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:08.948156 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 321/641] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:39:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:39:08.950194 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77e09b-bfde-48f7-ae87-d22ff8ff1a8c None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:08.950723 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77e09b-bfde-48f7-ae87-d22ff8ff1a8c None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:08.951204 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77e09b-bfde-48f7-ae87-d22ff8ff1a8c None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:08.953179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 322/642] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:08.953891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77e09b-bfde-48f7-ae87-d22ff8ff1a8c None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:08.985140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:09.011386 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33566b8-3293-44b0-986f-695789cf54fa None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:09.025558 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:09.047525 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454c38f-dac3-438c-8ec0-e50b0b8103fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:09.048225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454c38f-dac3-438c-8ec0-e50b0b8103fb None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:09.048516 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454c38f-dac3-438c-8ec0-e50b0b8103fb None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:09.048802 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454c38f-dac3-438c-8ec0-e50b0b8103fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:09.061461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77e09b-bfde-48f7-ae87-d22ff8ff1a8c None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:09.097204 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc57e2-4026-451d-8d7a-e0f2b3c2666f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:09.097981 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc57e2-4026-451d-8d7a-e0f2b3c2666f None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:09.098265 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc57e2-4026-451d-8d7a-e0f2b3c2666f None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:09.098543 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc57e2-4026-451d-8d7a-e0f2b3c2666f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:09.108833 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc57e2-4026-451d-8d7a-e0f2b3c2666f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:09.110313 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc57e2-4026-451d-8d7a-e0f2b3c2666f None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:09.119024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454c38f-dac3-438c-8ec0-e50b0b8103fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:09.120499 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454c38f-dac3-438c-8ec0-e50b0b8103fb None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:09.128855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-ddbc57e2-4026-451d-8d7a-e0f2b3c2666f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:09.128855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:09.128855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:09.128855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:09.128855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:09.128855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:09.128855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:09.128855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:09.128855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:09.128855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:09.128855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:09.128855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:09.128855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:09.128855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:09.128855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:09.129941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:09.129941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:09.129941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:09.129941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:09.129941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:09.129941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:09.129941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:09.129941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:09.129941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:09.129941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:09.129941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:09.129941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:09.129941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:09.129941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:09.129941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:09.129941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:09.129941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:09.130856 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:09.130856 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:09.130856 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:09.130856 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:09.132817 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 323/643] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:09.132817 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc57e2-4026-451d-8d7a-e0f2b3c2666f None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:09.232555 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 321/644] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:39:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:39:09.233866 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5106-f738-4c68-929e-6367d928b932 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:09.234416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5106-f738-4c68-929e-6367d928b932 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:09.234708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5106-f738-4c68-929e-6367d928b932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:09.246123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:09.252192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-65fa5106-f738-4c68-929e-6367d928b932 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:09.253388 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-65fa5106-f738-4c68-929e-6367d928b932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:09.261975 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:09.265433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc57e2-4026-451d-8d7a-e0f2b3c2666f None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:09.300364 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a97ee-e977-4b32-a674-00f0ac886957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:09.301359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a97ee-e977-4b32-a674-00f0ac886957 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:09.301643 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a97ee-e977-4b32-a674-00f0ac886957 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:09.301921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a97ee-e977-4b32-a674-00f0ac886957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:09.312886 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a97ee-e977-4b32-a674-00f0ac886957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:09.314611 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a97ee-e977-4b32-a674-00f0ac886957 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:09.325790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 322/645] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:39:09.327200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa5106-f738-4c68-929e-6367d928b932 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:09.344255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-4f4a97ee-e977-4b32-a674-00f0ac886957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:09.344255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:09.344255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:09.344255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:09.344255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:09.344255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:09.344255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:09.344255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:09.344255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:09.344255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:09.344255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:09.344255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:09.344255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:09.344255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:09.344255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:09.345133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:09.345133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:09.345133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:09.345133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:09.345133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:09.345133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:09.345133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:09.345133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:09.345133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:09.345133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:09.345133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:09.345133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:09.345133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:09.345133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:09.345133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:09.345133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:09.345133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:09.346231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:09.346231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:09.346231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:09.346231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:09.352251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 324/646] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:09.352251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a97ee-e977-4b32-a674-00f0ac886957 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:09.449469 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa5106-f738-4c68-929e-6367d928b932 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:09.457198 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a97ee-e977-4b32-a674-00f0ac886957 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:09.485829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a53f78-ba76-4516-b59e-b7297f06bf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:09.486499 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a53f78-ba76-4516-b59e-b7297f06bf37 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:09.486785 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a53f78-ba76-4516-b59e-b7297f06bf37 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:09.487073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a53f78-ba76-4516-b59e-b7297f06bf37 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:09.487806 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a53f78-ba76-4516-b59e-b7297f06bf37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:09.488117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a53f78-ba76-4516-b59e-b7297f06bf37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:09.489552 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a53f78-ba76-4516-b59e-b7297f06bf37 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:09.496534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156f840-1bf1-42ac-b096-ff63ef953eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:09.497587 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f840-1bf1-42ac-b096-ff63ef953eab None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:09.498023 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f840-1bf1-42ac-b096-ff63ef953eab None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:09.498589 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f840-1bf1-42ac-b096-ff63ef953eab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:09.500741 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:09.501852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 323/647] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:09.502729 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a53f78-ba76-4516-b59e-b7297f06bf37 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:09.505988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:09.515252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156f840-1bf1-42ac-b096-ff63ef953eab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:09.525280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156f840-1bf1-42ac-b096-ff63ef953eab None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:09.534372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-1156f840-1bf1-42ac-b096-ff63ef953eab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:09.534372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:09.534372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:09.534372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:09.534372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:09.534372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:09.534372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:09.534372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:09.534372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:09.534372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:09.534372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:09.534372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:09.534372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:09.534372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:09.534372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:09.535437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:09.535437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:09.535437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:09.535437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:09.535437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:09.535437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:09.535437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:09.535437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:09.535437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:09.535437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:09.535437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:09.535437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:09.535437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:09.535437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:09.535437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:09.535437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:09.535437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:09.536648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:09.536648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:09.536648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:09.536648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:09.537843 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 325/648] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:09.538835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156f840-1bf1-42ac-b096-ff63ef953eab None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:09.615940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a53f78-ba76-4516-b59e-b7297f06bf37 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:09.644295 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156f840-1bf1-42ac-b096-ff63ef953eab None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:09.652872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a9644-023e-445d-beff-ab5ec96fe2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:09.653701 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a9644-023e-445d-beff-ab5ec96fe2a8 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:09.653989 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a9644-023e-445d-beff-ab5ec96fe2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:09.654270 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a9644-023e-445d-beff-ab5ec96fe2a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:09.665865 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a9644-023e-445d-beff-ab5ec96fe2a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:09.674160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-339a9644-023e-445d-beff-ab5ec96fe2a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:09.674160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:09.674160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:09.674160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:09.674160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:09.674160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:09.674160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:09.674160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:09.674160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:09.674160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:09.674160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:09.674160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:09.674160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:09.674160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:09.674160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:09.674160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:09.675123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:09.675123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:09.675123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:09.675123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:09.675123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:09.675123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:09.675123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:09.675123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:09.675123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:09.675123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:09.675123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:09.675123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:09.675123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:09.675123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:09.675123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:09.675123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:09.675999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:09.675999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:09.675999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:09.675999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:09.675999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:09.675999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:09.675999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:09.675999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:09.675999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:09.675999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:09.675999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:09.675999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:09.675999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 324/649] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:39:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:09.676734 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a9644-023e-445d-beff-ab5ec96fe2a8 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:09.688749 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce45cef-8390-465a-8ae4-082ecff840e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:09.689450 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce45cef-8390-465a-8ae4-082ecff840e9 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:09.689736 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce45cef-8390-465a-8ae4-082ecff840e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:09.690383 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce45cef-8390-465a-8ae4-082ecff840e9 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:09.691126 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce45cef-8390-465a-8ae4-082ecff840e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:09.691755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce45cef-8390-465a-8ae4-082ecff840e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:09.693129 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce45cef-8390-465a-8ae4-082ecff840e9 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:09.705239 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 326/650] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:09.705986 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce45cef-8390-465a-8ae4-082ecff840e9 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:09.746285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:09.759001 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:09.785545 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a9644-023e-445d-beff-ab5ec96fe2a8 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:09.821106 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882f1e5-e30f-42f0-ae9d-b7e4d6308bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:09.822036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce45cef-8390-465a-8ae4-082ecff840e9 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:09.822176 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882f1e5-e30f-42f0-ae9d-b7e4d6308bf9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:09.822377 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882f1e5-e30f-42f0-ae9d-b7e4d6308bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:09.822660 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882f1e5-e30f-42f0-ae9d-b7e4d6308bf9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:09.831075 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882f1e5-e30f-42f0-ae9d-b7e4d6308bf9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:09.832533 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882f1e5-e30f-42f0-ae9d-b7e4d6308bf9 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:09.848430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-8882f1e5-e30f-42f0-ae9d-b7e4d6308bf9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 19:39:09.848430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:09.848430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:09.848430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:09.848430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:09.848430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:09.848430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:09.848430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:09.848430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:09.848430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:09.848430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:09.848430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:09.848430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:09.848430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:09.848430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:09.848430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:09.849458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:09.849458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:09.849458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:09.849458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:09.849458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:09.849458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:09.849458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:09.849458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:09.849458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:09.849458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:09.849458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:09.849458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:09.849458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:09.849458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:09.849458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:09.849458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:09.849458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:09.849458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:09.850526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:09.850526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:09.850526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:09.850526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:09.850526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:09.850526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:09.850526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:09.850526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:09.850526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 19:39:09.850526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:09.850526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 325/651] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:39:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:09.851302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882f1e5-e30f-42f0-ae9d-b7e4d6308bf9 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:09.863699 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ca27b-6125-489e-aefe-53076869e2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:09.864368 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ca27b-6125-489e-aefe-53076869e2da None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:09.864654 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ca27b-6125-489e-aefe-53076869e2da None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:09.864935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ca27b-6125-489e-aefe-53076869e2da None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:09.865708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ca27b-6125-489e-aefe-53076869e2da None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:09.866040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ca27b-6125-489e-aefe-53076869e2da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:09.867423 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ca27b-6125-489e-aefe-53076869e2da None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:09.881560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 327/652] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:09.882842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ca27b-6125-489e-aefe-53076869e2da None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:09.971311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882f1e5-e30f-42f0-ae9d-b7e4d6308bf9 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:09.995894 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:10.000669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ca27b-6125-489e-aefe-53076869e2da None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:10.009266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cfd01-b51e-4638-a6cf-007bb7228f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:10.009940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cfd01-b51e-4638-a6cf-007bb7228f88 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:10.010227 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cfd01-b51e-4638-a6cf-007bb7228f88 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:10.010828 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cfd01-b51e-4638-a6cf-007bb7228f88 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:10.011296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cfd01-b51e-4638-a6cf-007bb7228f88 None admin] RBAC: Adding query filter params (name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:10.011601 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cfd01-b51e-4638-a6cf-007bb7228f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:10.012278 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:10.012973 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cfd01-b51e-4638-a6cf-007bb7228f88 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:10.025778 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 326/653] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:39:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:10.025778 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cfd01-b51e-4638-a6cf-007bb7228f88 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:10.038361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef001484-8e7e-4196-af21-2dc211b7ac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:10.039554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef001484-8e7e-4196-af21-2dc211b7ac8c None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:10.039848 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef001484-8e7e-4196-af21-2dc211b7ac8c None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:10.040155 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef001484-8e7e-4196-af21-2dc211b7ac8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:10.047380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef001484-8e7e-4196-af21-2dc211b7ac8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:10.048842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef001484-8e7e-4196-af21-2dc211b7ac8c None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:10.063114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-ef001484-8e7e-4196-af21-2dc211b7ac8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:10.063114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:10.063114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:10.063114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:10.063114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:10.063114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:10.063114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:10.063114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:10.063114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:10.063114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:10.063114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:10.063114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:10.063114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:10.063114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:10.063114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:10.064039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:10.064039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:10.064039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:10.064039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:10.064039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:10.064039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:10.064039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:10.064039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:10.064039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:10.064039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:10.064039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:10.064039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:10.064039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:10.064039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:10.064039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:10.064039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:10.064039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:10.064955 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:10.064955 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:10.064955 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:10.064955 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:10.064955 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:10.064955 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:10.064955 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:10.064955 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:10.064955 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 328/654] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:10.065914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef001484-8e7e-4196-af21-2dc211b7ac8c None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:10.130660 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cfd01-b51e-4638-a6cf-007bb7228f88 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:10.165739 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693709c1-8335-47de-b842-71f613b35f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:10.166405 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693709c1-8335-47de-b842-71f613b35f30 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:10.166697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693709c1-8335-47de-b842-71f613b35f30 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:10.166975 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693709c1-8335-47de-b842-71f613b35f30 None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:10.167611 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef001484-8e7e-4196-af21-2dc211b7ac8c None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:10.167805 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693709c1-8335-47de-b842-71f613b35f30 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:10.168116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693709c1-8335-47de-b842-71f613b35f30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:10.169584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693709c1-8335-47de-b842-71f613b35f30 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:10.186702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 327/655] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Jun 23 19:39:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:10.187854 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693709c1-8335-47de-b842-71f613b35f30 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:10.201711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d832da-4102-4f93-9eda-030066348f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:10.202506 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d832da-4102-4f93-9eda-030066348f73 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:10.202794 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d832da-4102-4f93-9eda-030066348f73 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:10.203077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d832da-4102-4f93-9eda-030066348f73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:10.209803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d832da-4102-4f93-9eda-030066348f73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:10.211355 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d832da-4102-4f93-9eda-030066348f73 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:10.225373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-e2d832da-4102-4f93-9eda-030066348f73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:10.225373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:10.225373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:10.225373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:10.225373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:10.225373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:10.225373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:10.225373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:10.225373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:10.225373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:10.225373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:10.225373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:10.225373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:10.225373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:10.225373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:10.226362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:10.226362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:10.226362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:10.226362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:10.226362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:10.226362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:10.226362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:10.226362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:10.226362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:10.226362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:10.226362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:10.226362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:10.226362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:10.226362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:10.226362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:10.226362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:10.226362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:10.227301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:10.227301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:10.227301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:10.227301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:10.227301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:10.227301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:10.227301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:10.227301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:10.227301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 329/656] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:10.227301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d832da-4102-4f93-9eda-030066348f73 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:10.231635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:10.256509 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:10.287982 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693709c1-8335-47de-b842-71f613b35f30 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:10.322216 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861e6f5-06d1-4ab5-a336-73dbf168a31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:10.323010 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861e6f5-06d1-4ab5-a336-73dbf168a31a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:10.323295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861e6f5-06d1-4ab5-a336-73dbf168a31a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:10.323575 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861e6f5-06d1-4ab5-a336-73dbf168a31a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:10.330782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d832da-4102-4f93-9eda-030066348f73 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:10.333479 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861e6f5-06d1-4ab5-a336-73dbf168a31a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:10.334971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861e6f5-06d1-4ab5-a336-73dbf168a31a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:10.353054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-4861e6f5-06d1-4ab5-a336-73dbf168a31a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:10.353054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:10.353054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:10.353054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:10.353054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:10.353054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:10.353054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:10.353054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:10.353054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:10.353054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:10.353054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:10.353054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:10.353054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:10.353054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:10.353054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:10.354011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:10.354011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:10.354011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:10.354011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:10.354011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:10.354011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:10.354011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:10.354011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:10.354011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:10.354011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:10.354011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:10.354011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:10.354011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:10.354011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:10.354011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:10.354011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:10.354011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:10.354902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:10.354902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:10.354902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:10.354902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:10.354902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 328/657] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:10.355494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500b96b-c905-4c48-b9c8-c1e73f76a95b None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:10.355756 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500b96b-c905-4c48-b9c8-c1e73f76a95b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:10.356035 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500b96b-c905-4c48-b9c8-c1e73f76a95b None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:10.357592 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 329/658] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:10.358294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500b96b-c905-4c48-b9c8-c1e73f76a95b None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:10.369802 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2b836-7912-47d5-a9a6-c97c3cf76f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:10.370465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2b836-7912-47d5-a9a6-c97c3cf76f80 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:10.370753 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2b836-7912-47d5-a9a6-c97c3cf76f80 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:10.371033 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2b836-7912-47d5-a9a6-c97c3cf76f80 None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:10.371826 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2b836-7912-47d5-a9a6-c97c3cf76f80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:10.372139 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2b836-7912-47d5-a9a6-c97c3cf76f80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:10.373614 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2b836-7912-47d5-a9a6-c97c3cf76f80 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:10.385887 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 330/659] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:10.386480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2b836-7912-47d5-a9a6-c97c3cf76f80 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:10.457041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:10.465124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500b96b-c905-4c48-b9c8-c1e73f76a95b None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:10.476081 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:10.490603 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2b836-7912-47d5-a9a6-c97c3cf76f80 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:10.504580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a836a-eb75-442f-a181-c39de5a61fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:10.505253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a836a-eb75-442f-a181-c39de5a61fca None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:10.510525 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a836a-eb75-442f-a181-c39de5a61fca None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:10.510525 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a836a-eb75-442f-a181-c39de5a61fca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:10.530374 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c04c2c-9d39-4150-a44f-734b1e9f7c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:10.531037 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c04c2c-9d39-4150-a44f-734b1e9f7c6a None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:10.531322 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c04c2c-9d39-4150-a44f-734b1e9f7c6a None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:10.531603 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c04c2c-9d39-4150-a44f-734b1e9f7c6a None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:10.532386 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c04c2c-9d39-4150-a44f-734b1e9f7c6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:10.532696 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c04c2c-9d39-4150-a44f-734b1e9f7c6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:10.534169 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c04c2c-9d39-4150-a44f-734b1e9f7c6a None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:10.546085 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 331/660] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:10.546875 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c04c2c-9d39-4150-a44f-734b1e9f7c6a None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:10.579131 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a836a-eb75-442f-a181-c39de5a61fca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:10.580588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a836a-eb75-442f-a181-c39de5a61fca None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:10.643720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c04c2c-9d39-4150-a44f-734b1e9f7c6a None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:10.670216 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:10.677307 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 330/661] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:39:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:39:10.677428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023abf3-90ed-4702-966f-4228846f7900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:10.677819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023abf3-90ed-4702-966f-4228846f7900 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:10.678136 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023abf3-90ed-4702-966f-4228846f7900 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:10.678374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecdf8e-db33-4f46-8908-cfe5eca03d45 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:10.678509 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023abf3-90ed-4702-966f-4228846f7900 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:10.678689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecdf8e-db33-4f46-8908-cfe5eca03d45 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:10.678976 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecdf8e-db33-4f46-8908-cfe5eca03d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:10.679426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023abf3-90ed-4702-966f-4228846f7900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:10.679737 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023abf3-90ed-4702-966f-4228846f7900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:10.681132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023abf3-90ed-4702-966f-4228846f7900 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:10.692871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 332/662] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:10.694019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023abf3-90ed-4702-966f-4228846f7900 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:10.695596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-7fecdf8e-db33-4f46-8908-cfe5eca03d45 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:10.696815 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-7fecdf8e-db33-4f46-8908-cfe5eca03d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:10.704303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:10.763508 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 331/663] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:39:10.764400 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fecdf8e-db33-4f46-8908-cfe5eca03d45 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:10.798681 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023abf3-90ed-4702-966f-4228846f7900 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:10.838688 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a796229-d4df-493e-b355-abf411392bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:10.839685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a796229-d4df-493e-b355-abf411392bc8 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:10.839965 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a796229-d4df-493e-b355-abf411392bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:10.840237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a796229-d4df-493e-b355-abf411392bc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:10.841067 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a796229-d4df-493e-b355-abf411392bc8 None admin] RBAC: Adding query filter params (role.id=e466769ed9af47889225dd8d77e896a5, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=83bff5cd7782423eaa0bc5b29b208ae7) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:10.841410 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a796229-d4df-493e-b355-abf411392bc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:10.842930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a796229-d4df-493e-b355-abf411392bc8 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:10.848961 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 333/664] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:39:10 2022] GET /identity/v3/role_assignments?user.id=83bff5cd7782423eaa0bc5b29b208ae7&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=e466769ed9af47889225dd8d77e896a5 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:10.849767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a796229-d4df-493e-b355-abf411392bc8 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:10.873407 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fecdf8e-db33-4f46-8908-cfe5eca03d45 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:10.904128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:10.917576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8728e4-db7e-4703-ab3c-07cb99ecab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:10.918444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8728e4-db7e-4703-ab3c-07cb99ecab0c None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:10.918741 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8728e4-db7e-4703-ab3c-07cb99ecab0c None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:10.919121 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8728e4-db7e-4703-ab3c-07cb99ecab0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:10.919987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8728e4-db7e-4703-ab3c-07cb99ecab0c None admin] RBAC: Adding query filter params (role.id=e466769ed9af47889225dd8d77e896a5, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=f078219032be4b619119d1d9d59c499d) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:10.922460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8728e4-db7e-4703-ab3c-07cb99ecab0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:10.922460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8728e4-db7e-4703-ab3c-07cb99ecab0c None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:10.928289 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 332/665] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:39:10 2022] GET /identity/v3/role_assignments?user.id=f078219032be4b619119d1d9d59c499d&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=e466769ed9af47889225dd8d77e896a5 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:10.929857 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8728e4-db7e-4703-ab3c-07cb99ecab0c None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:10.968639 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:11.018305 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a796229-d4df-493e-b355-abf411392bc8 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:11.070089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8728e4-db7e-4703-ab3c-07cb99ecab0c None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:11.073986 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0245ad-35d9-4e6d-9ac4-d8a4c5ac5f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:11.074837 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0245ad-35d9-4e6d-9ac4-d8a4c5ac5f36 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:11.075125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0245ad-35d9-4e6d-9ac4-d8a4c5ac5f36 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:11.075405 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0245ad-35d9-4e6d-9ac4-d8a4c5ac5f36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:11.090370 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0245ad-35d9-4e6d-9ac4-d8a4c5ac5f36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:11.092556 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0245ad-35d9-4e6d-9ac4-d8a4c5ac5f36 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:11.115417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-9e0245ad-35d9-4e6d-9ac4-d8a4c5ac5f36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:11.115417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:11.115417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:11.115417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:11.115417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:11.115417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:11.115417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:11.115417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:11.115417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:11.115417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:11.115417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:11.115417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:11.115417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:11.115417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:11.115417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:11.116771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:11.116771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:11.116771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:11.116771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:11.116771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:11.116771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:11.116771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:11.116771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:11.116771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:11.116771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:11.116771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:11.116771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:11.116771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:11.116771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:11.116771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:11.116771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:11.116771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:11.117820 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:11.117820 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:11.117820 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:11.117820 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:11.121307 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 334/666] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:11.121796 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed801fc0-0354-4a0a-a8ff-ba205b69d082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:11.122185 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0245ad-35d9-4e6d-9ac4-d8a4c5ac5f36 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:11.122617 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed801fc0-0354-4a0a-a8ff-ba205b69d082 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:11.122942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed801fc0-0354-4a0a-a8ff-ba205b69d082 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:11.123237 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed801fc0-0354-4a0a-a8ff-ba205b69d082 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:11.135879 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed801fc0-0354-4a0a-a8ff-ba205b69d082 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:11.138132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed801fc0-0354-4a0a-a8ff-ba205b69d082 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:11.157041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-ed801fc0-0354-4a0a-a8ff-ba205b69d082 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 19:39:11.157041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:11.157041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:11.157041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:11.157041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:11.157041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:11.157041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:11.157041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:11.157041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:11.157041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:11.157041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:11.157041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:11.157041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:11.157041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:11.157041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:11.157041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:11.158070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:11.158070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:11.158070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:11.158070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:11.158070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:11.158070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:11.158070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:11.158070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:11.158070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:11.158070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:11.158070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:11.158070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:11.158070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:11.158070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:11.158070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:11.158070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:11.158070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:11.158070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:11.159019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:11.159019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:11.159019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:11.159019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:11.159019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:11.159019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:11.159019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:11.159019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:11.159019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 19:39:11.159019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:11.159573 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 333/667] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:39:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:11.160715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed801fc0-0354-4a0a-a8ff-ba205b69d082 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:11.227292 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:11.252278 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0245ad-35d9-4e6d-9ac4-d8a4c5ac5f36 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:11.285661 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:11.289524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed801fc0-0354-4a0a-a8ff-ba205b69d082 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:11.300950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed067af-f149-4f52-ba30-4dd5214f81a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:11.302160 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed067af-f149-4f52-ba30-4dd5214f81a8 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:11.302518 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed067af-f149-4f52-ba30-4dd5214f81a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:11.302871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed067af-f149-4f52-ba30-4dd5214f81a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:11.317691 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed067af-f149-4f52-ba30-4dd5214f81a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:11.327588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-7ed067af-f149-4f52-ba30-4dd5214f81a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:11.327588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:11.327588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:11.327588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:11.327588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:11.327588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:11.327588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:11.327588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:11.327588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:11.327588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:11.327588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:11.327588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:11.327588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:11.327588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:11.327588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:11.327588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:11.328546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:11.328546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:11.328546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:11.328546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:11.328546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:11.328546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:11.328546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:11.328546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:11.328546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:11.328546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:11.328546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:11.328546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:11.328546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:11.328546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:11.328546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:11.328546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:11.329433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:11.329433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:11.329433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:11.329433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:11.329433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:11.329433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:11.329433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:11.329433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:11.329433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:11.329433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:11.329433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:11.329433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:11.329433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 335/668] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:39:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:11.332190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89536331-b8ea-4d1c-9be3-22eb463689a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:11.333176 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89536331-b8ea-4d1c-9be3-22eb463689a8 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:11.333730 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89536331-b8ea-4d1c-9be3-22eb463689a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:11.334090 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed067af-f149-4f52-ba30-4dd5214f81a8 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:11.334595 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89536331-b8ea-4d1c-9be3-22eb463689a8 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:11.336355 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89536331-b8ea-4d1c-9be3-22eb463689a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:11.336880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89536331-b8ea-4d1c-9be3-22eb463689a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:11.338832 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89536331-b8ea-4d1c-9be3-22eb463689a8 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:11.355417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 334/669] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:11.356534 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89536331-b8ea-4d1c-9be3-22eb463689a8 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:11.442648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed067af-f149-4f52-ba30-4dd5214f81a8 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:11.482697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39ddb3-a84a-4463-9771-2568fc9d845d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:11.483576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39ddb3-a84a-4463-9771-2568fc9d845d None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:11.483841 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39ddb3-a84a-4463-9771-2568fc9d845d None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:11.484197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39ddb3-a84a-4463-9771-2568fc9d845d None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:11.485117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39ddb3-a84a-4463-9771-2568fc9d845d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:11.485527 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39ddb3-a84a-4463-9771-2568fc9d845d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:11.487058 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39ddb3-a84a-4463-9771-2568fc9d845d None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:11.496575 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89536331-b8ea-4d1c-9be3-22eb463689a8 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:11.510642 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 336/670] 10.222.0.13 () {56 vars in 1139 bytes} [Thu Jun 23 19:39:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:11.510642 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39ddb3-a84a-4463-9771-2568fc9d845d None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:11.513950 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:11.543050 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f093d8-51c5-48e2-9c3c-473fe77547b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:11.544030 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f093d8-51c5-48e2-9c3c-473fe77547b4 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:11.544671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f093d8-51c5-48e2-9c3c-473fe77547b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:11.545134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f093d8-51c5-48e2-9c3c-473fe77547b4 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:11.546088 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f093d8-51c5-48e2-9c3c-473fe77547b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:11.546577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f093d8-51c5-48e2-9c3c-473fe77547b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:11.549130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f093d8-51c5-48e2-9c3c-473fe77547b4 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:11.555733 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:11.559399 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 335/671] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:39:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:11.560448 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f093d8-51c5-48e2-9c3c-473fe77547b4 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:11.628265 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39ddb3-a84a-4463-9771-2568fc9d845d None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:11.665313 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f1bc3-7bb4-4ee5-ad5f-ee954b9dd7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:11.666276 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f1bc3-7bb4-4ee5-ad5f-ee954b9dd7df None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:11.666722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f1bc3-7bb4-4ee5-ad5f-ee954b9dd7df None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:11.667103 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f1bc3-7bb4-4ee5-ad5f-ee954b9dd7df None admin] PATH_INFO: `/v3/projects/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:11.674379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f1bc3-7bb4-4ee5-ad5f-ee954b9dd7df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:11.675973 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f1bc3-7bb4-4ee5-ad5f-ee954b9dd7df None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:11.690571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-903f1bc3-7bb4-4ee5-ad5f-ee954b9dd7df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:11.690571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:11.690571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:11.690571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:11.690571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:11.690571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:11.690571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:11.690571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:11.690571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:11.690571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:11.690571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:11.690571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:11.690571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:11.690571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:11.690571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:11.691447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:11.691447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:11.691447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:11.691447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:11.691447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:11.691447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:11.691447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:11.691447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:11.691447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:11.691447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:11.691447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:11.691447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:11.691447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:11.691447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:11.691447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:11.691447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:11.691447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:11.692340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:11.692340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:11.692340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:11.692340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:11.692340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:11.692340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:11.692340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:11.692340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:11.692340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 337/672] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:11.693039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f1bc3-7bb4-4ee5-ad5f-ee954b9dd7df None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:11.695732 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f093d8-51c5-48e2-9c3c-473fe77547b4 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:11.739144 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9c978-de16-45da-9dd7-cc9f5cb28353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:11.740022 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9c978-de16-45da-9dd7-cc9f5cb28353 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:11.740410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9c978-de16-45da-9dd7-cc9f5cb28353 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:11.740825 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9c978-de16-45da-9dd7-cc9f5cb28353 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:11.785421 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:11.816338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9c978-de16-45da-9dd7-cc9f5cb28353 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:11.817910 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9c978-de16-45da-9dd7-cc9f5cb28353 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:11.822223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:11.828176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f1bc3-7bb4-4ee5-ad5f-ee954b9dd7df None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:11.869252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec3eda-ee96-465d-909d-e80c77758260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:11.870335 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec3eda-ee96-465d-909d-e80c77758260 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:11.870625 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec3eda-ee96-465d-909d-e80c77758260 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:11.870907 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec3eda-ee96-465d-909d-e80c77758260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:11.887269 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec3eda-ee96-465d-909d-e80c77758260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:11.888791 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec3eda-ee96-465d-909d-e80c77758260 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:11.909171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-17ec3eda-ee96-465d-909d-e80c77758260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:11.909171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:11.909171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:11.909171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:11.909171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:11.909171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:11.909171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:11.909171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:11.909171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:11.909171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:11.909171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:11.909171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:11.909171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:11.909171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:11.909171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:11.910237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:11.910237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:11.910237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:11.910237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:11.910237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:11.910237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:11.910237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:11.910237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:11.910237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:11.910237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:11.910237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:11.910237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:11.910237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:11.910237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:11.910237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:11.910237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:11.910237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:11.911333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:11.911333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:11.911333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:11.911333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:11.915543 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 338/673] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:11.916403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec3eda-ee96-465d-909d-e80c77758260 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:11.937713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 336/674] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:39:11.938706 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9c978-de16-45da-9dd7-cc9f5cb28353 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:12.014633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:12.020823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec3eda-ee96-465d-909d-e80c77758260 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:12.048498 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9c978-de16-45da-9dd7-cc9f5cb28353 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:12.056428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ae67f-160b-483c-a1f5-0efa114e1f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:12.057101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ae67f-160b-483c-a1f5-0efa114e1f13 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:12.057422 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ae67f-160b-483c-a1f5-0efa114e1f13 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:12.057705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ae67f-160b-483c-a1f5-0efa114e1f13 None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:12.058504 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ae67f-160b-483c-a1f5-0efa114e1f13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:12.058821 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ae67f-160b-483c-a1f5-0efa114e1f13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:12.060281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ae67f-160b-483c-a1f5-0efa114e1f13 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:12.073719 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 339/675] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:12.074779 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ae67f-160b-483c-a1f5-0efa114e1f13 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:12.087909 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a8eaa-4b9c-4b7c-86d7-4d63bf3fc0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:12.088632 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8eaa-4b9c-4b7c-86d7-4d63bf3fc0a4 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:12.088925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8eaa-4b9c-4b7c-86d7-4d63bf3fc0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:12.089252 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8eaa-4b9c-4b7c-86d7-4d63bf3fc0a4 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:12.089800 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:12.091281 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a8eaa-4b9c-4b7c-86d7-4d63bf3fc0a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:12.091901 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a8eaa-4b9c-4b7c-86d7-4d63bf3fc0a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:12.093556 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a8eaa-4b9c-4b7c-86d7-4d63bf3fc0a4 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:12.107529 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 337/676] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:12.108801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a8eaa-4b9c-4b7c-86d7-4d63bf3fc0a4 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:12.185557 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ae67f-160b-483c-a1f5-0efa114e1f13 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:12.221771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf6258-2bfc-4764-aa09-60a7473ad869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:12.222565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf6258-2bfc-4764-aa09-60a7473ad869 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:12.222852 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf6258-2bfc-4764-aa09-60a7473ad869 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:12.223134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf6258-2bfc-4764-aa09-60a7473ad869 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:12.224661 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a8eaa-4b9c-4b7c-86d7-4d63bf3fc0a4 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:12.234363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf6258-2bfc-4764-aa09-60a7473ad869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:12.235889 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf6258-2bfc-4764-aa09-60a7473ad869 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:12.255755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-daaf6258-2bfc-4764-aa09-60a7473ad869 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:12.255755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:12.255755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:12.255755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:12.255755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:12.255755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:12.255755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:12.255755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:12.255755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:12.255755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:12.255755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:12.255755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:12.255755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:12.255755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:12.255755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:12.257531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:12.257531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:12.257531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:12.257531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:12.257531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:12.257531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:12.257531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:12.257531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:12.257531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:12.257531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:12.257531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:12.257531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:12.257531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:12.257531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:12.257531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:12.257531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:12.257531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:12.258647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:12.258647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:12.258647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:12.258647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:12.258647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 340/677] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:12.258925 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf6258-2bfc-4764-aa09-60a7473ad869 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:12.262224 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:12.268263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d41474-ef8f-406d-8216-9733582ed82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:12.269278 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d41474-ef8f-406d-8216-9733582ed82a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:12.269716 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d41474-ef8f-406d-8216-9733582ed82a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:12.270142 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d41474-ef8f-406d-8216-9733582ed82a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:12.271251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d41474-ef8f-406d-8216-9733582ed82a None admin] RBAC: Adding query filter params (role.id=e466769ed9af47889225dd8d77e896a5, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=4ab2b3700cdf48f08a049fbb76ee189c) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:12.271713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d41474-ef8f-406d-8216-9733582ed82a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:12.273691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d41474-ef8f-406d-8216-9733582ed82a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:12.280800 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 338/678] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:39:12 2022] GET /identity/v3/role_assignments?user.id=4ab2b3700cdf48f08a049fbb76ee189c&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=e466769ed9af47889225dd8d77e896a5 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:12.281841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d41474-ef8f-406d-8216-9733582ed82a None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:12.331504 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:12.398370 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d41474-ef8f-406d-8216-9733582ed82a None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:12.426628 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf6258-2bfc-4764-aa09-60a7473ad869 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:12.437415 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b7fb6-40ef-4635-8f0a-2572121ab143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:12.438462 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b7fb6-40ef-4635-8f0a-2572121ab143 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:12.439012 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b7fb6-40ef-4635-8f0a-2572121ab143 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:12.439618 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b7fb6-40ef-4635-8f0a-2572121ab143 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:12.440624 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b7fb6-40ef-4635-8f0a-2572121ab143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:12.441219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b7fb6-40ef-4635-8f0a-2572121ab143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:12.442864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b7fb6-40ef-4635-8f0a-2572121ab143 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:12.458576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 339/679] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:12.464445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b7fb6-40ef-4635-8f0a-2572121ab143 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:12.499461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328025c-caf2-45d4-b278-82b7ea6e0e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:12.500310 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328025c-caf2-45d4-b278-82b7ea6e0e2e None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:12.500605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328025c-caf2-45d4-b278-82b7ea6e0e2e None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:12.500943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328025c-caf2-45d4-b278-82b7ea6e0e2e None admin] PATH_INFO: `/v3/users/swift` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:12.511036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328025c-caf2-45d4-b278-82b7ea6e0e2e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:12.513026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328025c-caf2-45d4-b278-82b7ea6e0e2e None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:12.530069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-b328025c-caf2-45d4-b278-82b7ea6e0e2e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 19:39:12.530069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:12.530069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:12.530069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:12.530069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:12.530069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:12.530069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:12.530069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:12.530069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:12.530069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:12.530069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:12.530069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:12.530069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:12.530069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:12.530069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:12.530069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:12.531061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:12.531061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:12.531061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:12.531061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:12.531061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:12.531061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:12.531061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:12.531061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:12.531061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:12.531061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:12.531061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:12.531061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:12.531061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:12.531061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:12.531061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:12.531061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:12.531061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:12.531061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:12.531996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:12.531996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:12.531996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:12.531996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:12.531996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:12.531996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:12.531996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:12.531996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:12.531996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 19:39:12.531996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:12.536502 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 341/680] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:39:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:12.537791 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328025c-caf2-45d4-b278-82b7ea6e0e2e None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:12.539818 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:12.598457 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b7fb6-40ef-4635-8f0a-2572121ab143 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:12.644409 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d49ee-7298-492a-b0de-3911b1cff141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:12.646192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d49ee-7298-492a-b0de-3911b1cff141 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:12.646713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d49ee-7298-492a-b0de-3911b1cff141 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:12.648050 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d49ee-7298-492a-b0de-3911b1cff141 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:12.658343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d49ee-7298-492a-b0de-3911b1cff141 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:12.659824 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328025c-caf2-45d4-b278-82b7ea6e0e2e None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:12.660318 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d49ee-7298-492a-b0de-3911b1cff141 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:12.679260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-d61d49ee-7298-492a-b0de-3911b1cff141 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:12.679260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:12.679260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:12.679260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:12.679260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:12.679260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:12.679260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:12.679260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:12.679260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:12.679260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:12.679260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:12.679260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:12.679260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:12.679260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:12.679260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:12.680326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:12.680326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:12.680326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:12.680326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:12.680326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:12.680326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:12.680326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:12.680326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:12.680326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:12.680326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:12.680326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:12.680326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:12.680326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:12.680326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:12.680326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:12.680326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:12.680326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:12.681392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:12.681392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:12.681392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:12.681392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:12.681392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:12.681392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:12.681392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:12.681392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:12.684193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 340/681] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:12.688148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d49ee-7298-492a-b0de-3911b1cff141 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:12.697505 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:12.712255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830004c-7c18-409c-98b3-c894b24277df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:12.713303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830004c-7c18-409c-98b3-c894b24277df None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:12.714283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830004c-7c18-409c-98b3-c894b24277df None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:12.714776 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830004c-7c18-409c-98b3-c894b24277df None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:12.716164 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830004c-7c18-409c-98b3-c894b24277df None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:12.716865 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830004c-7c18-409c-98b3-c894b24277df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:12.719209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830004c-7c18-409c-98b3-c894b24277df None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:12.743841 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 342/682] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Jun 23 19:39:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:12.751389 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830004c-7c18-409c-98b3-c894b24277df None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:12.810500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d49ee-7298-492a-b0de-3911b1cff141 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:12.826324 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:12.857420 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4e81f-5eb7-4c0d-8ea5-56dc443b945c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:12.857420 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4e81f-5eb7-4c0d-8ea5-56dc443b945c None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:12.857420 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4e81f-5eb7-4c0d-8ea5-56dc443b945c None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:12.857420 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4e81f-5eb7-4c0d-8ea5-56dc443b945c None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:12.857863 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4e81f-5eb7-4c0d-8ea5-56dc443b945c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:12.857863 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4e81f-5eb7-4c0d-8ea5-56dc443b945c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:12.861427 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4e81f-5eb7-4c0d-8ea5-56dc443b945c None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:12.884706 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 341/683] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:12.894239 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4e81f-5eb7-4c0d-8ea5-56dc443b945c None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:12.919452 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830004c-7c18-409c-98b3-c894b24277df None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:12.989615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fe22c-846c-40c3-b39d-77df8e29fe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:12.990573 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fe22c-846c-40c3-b39d-77df8e29fe8e None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:12.991505 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fe22c-846c-40c3-b39d-77df8e29fe8e None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:12.991958 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fe22c-846c-40c3-b39d-77df8e29fe8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:13.000034 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4e81f-5eb7-4c0d-8ea5-56dc443b945c None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:13.038331 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9b746-d2de-45ca-a5b4-279e84fd7b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:13.039170 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9b746-d2de-45ca-a5b4-279e84fd7b6f None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:13.039559 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9b746-d2de-45ca-a5b4-279e84fd7b6f None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:13.039944 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9b746-d2de-45ca-a5b4-279e84fd7b6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:13.040890 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9b746-d2de-45ca-a5b4-279e84fd7b6f None admin] RBAC: Adding query filter params (role.id=e466769ed9af47889225dd8d77e896a5, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=24bb6f31e87045f5b17f561b42edca6f) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:13.041349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9b746-d2de-45ca-a5b4-279e84fd7b6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:13.042914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9b746-d2de-45ca-a5b4-279e84fd7b6f None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:13.049538 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 342/684] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:39:12 2022] GET /identity/v3/role_assignments?user.id=24bb6f31e87045f5b17f561b42edca6f&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=e466769ed9af47889225dd8d77e896a5 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:13.093561 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:13.121516 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fe22c-846c-40c3-b39d-77df8e29fe8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:13.122950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fe22c-846c-40c3-b39d-77df8e29fe8e None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:13.255806 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd510da7-a6f0-4ac3-bcf9-1d9e38003bc3 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:13.256362 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd510da7-a6f0-4ac3-bcf9-1d9e38003bc3 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:13.256362 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd510da7-a6f0-4ac3-bcf9-1d9e38003bc3 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:13.258225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 343/685] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:13.261902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6f456-eb3b-4616-a506-041deca835af None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:13.262192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6f456-eb3b-4616-a506-041deca835af None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:13.262508 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6f456-eb3b-4616-a506-041deca835af None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:13.264192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 344/686] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:13.267380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 343/687] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:39:13.267885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8444e-13d2-4064-a4de-58404cc85705 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:13.268637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8444e-13d2-4064-a4de-58404cc85705 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:13.269122 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8444e-13d2-4064-a4de-58404cc85705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:13.270688 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c3d14-95c1-41c9-83c1-ab38405b746e None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:13.273361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c3d14-95c1-41c9-83c1-ab38405b746e None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:13.274118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c3d14-95c1-41c9-83c1-ab38405b746e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:13.290562 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-09c8444e-13d2-4064-a4de-58404cc85705 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:13.291777 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-09c8444e-13d2-4064-a4de-58404cc85705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:13.292881 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-dc4c3d14-95c1-41c9-83c1-ab38405b746e None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:13.294399 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-dc4c3d14-95c1-41c9-83c1-ab38405b746e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:13.326880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:13.368034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 344/688] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:39:13.369118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c3d14-95c1-41c9-83c1-ab38405b746e None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:13.376975 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 345/689] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:39:13.386248 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:13.404813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8444e-13d2-4064-a4de-58404cc85705 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:13.485404 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c3d14-95c1-41c9-83c1-ab38405b746e None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:13.520526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8444e-13d2-4064-a4de-58404cc85705 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:13.522093 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb51b0-e228-44dd-9e2d-e0b8051733d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:13.523724 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb51b0-e228-44dd-9e2d-e0b8051733d0 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:13.523949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb51b0-e228-44dd-9e2d-e0b8051733d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:13.524273 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb51b0-e228-44dd-9e2d-e0b8051733d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:13.535504 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb51b0-e228-44dd-9e2d-e0b8051733d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:13.537006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb51b0-e228-44dd-9e2d-e0b8051733d0 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:13.555161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-d3fb51b0-e228-44dd-9e2d-e0b8051733d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:13.555161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:13.555161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:13.555161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:13.555161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:13.555161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:13.555161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:13.555161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:13.555161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:13.555161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:13.555161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:13.555161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:13.555161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:13.555161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:13.555161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:13.556191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:13.556191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:13.556191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:13.556191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:13.556191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:13.556191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:13.556191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:13.556191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:13.556191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:13.556191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:13.556191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:13.556191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:13.556191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:13.556191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:13.556191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:13.556191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:13.556191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:13.557177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:13.557177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:13.557177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:13.557177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:13.557177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 345/690] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:13.557705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb51b0-e228-44dd-9e2d-e0b8051733d0 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:13.569905 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2eb53e-8a8a-40aa-95e9-aa63128c742a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:13.569905 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2eb53e-8a8a-40aa-95e9-aa63128c742a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:13.569905 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2eb53e-8a8a-40aa-95e9-aa63128c742a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:13.569905 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2eb53e-8a8a-40aa-95e9-aa63128c742a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:13.582464 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2eb53e-8a8a-40aa-95e9-aa63128c742a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:13.584118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2eb53e-8a8a-40aa-95e9-aa63128c742a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:13.605123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-7e2eb53e-8a8a-40aa-95e9-aa63128c742a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:13.605123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:13.605123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:13.605123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:13.605123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:13.605123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:13.605123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:13.605123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:13.605123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:13.605123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:13.605123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:13.605123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:13.605123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:13.605123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:13.605123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:13.606089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:13.606089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:13.606089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:13.606089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:13.606089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:13.606089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:13.606089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:13.606089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:13.606089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:13.606089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:13.606089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:13.606089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:13.606089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:13.606089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:13.606089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:13.606089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:13.606089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:13.606988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:13.606988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:13.606988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:13.606988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:13.611455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 346/691] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:13.612353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2eb53e-8a8a-40aa-95e9-aa63128c742a None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:13.625600 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:13.643049 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:13.671029 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb51b0-e228-44dd-9e2d-e0b8051733d0 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:13.713141 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd70d8a-5a39-4e50-b52b-63e3257789b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:13.713982 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd70d8a-5a39-4e50-b52b-63e3257789b3 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:13.714279 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd70d8a-5a39-4e50-b52b-63e3257789b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:13.714934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd70d8a-5a39-4e50-b52b-63e3257789b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:13.727772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd70d8a-5a39-4e50-b52b-63e3257789b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:13.738166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-5dd70d8a-5a39-4e50-b52b-63e3257789b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:39:13.738166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:13.738166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:13.738166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:13.738166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:13.738166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:13.738166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:13.738166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:13.738166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:13.738166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:13.738166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:13.738166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:13.738166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:13.738166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:13.738166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:13.738166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:13.739495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:13.739495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:13.739495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:13.739495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:13.739495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:13.739495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:13.739495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:13.739495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:13.739495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:13.739495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:13.739495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:13.739495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:13.739495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:13.739495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:13.739495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:13.739495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:13.740334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:13.740334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:13.740334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:13.740334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:13.740334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:13.740334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:13.740334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:13.740334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:13.740334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:13.740334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:13.740334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:39:13.740334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:13.740334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 346/692] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:39:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:13.741708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd70d8a-5a39-4e50-b52b-63e3257789b3 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:13.744299 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2eb53e-8a8a-40aa-95e9-aa63128c742a None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:13.795936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63451b73-5c8e-4c57-8c12-9406a38125e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:13.797336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63451b73-5c8e-4c57-8c12-9406a38125e8 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:13.798141 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63451b73-5c8e-4c57-8c12-9406a38125e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:13.798635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63451b73-5c8e-4c57-8c12-9406a38125e8 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:13.800116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63451b73-5c8e-4c57-8c12-9406a38125e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:13.800738 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63451b73-5c8e-4c57-8c12-9406a38125e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:13.803008 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63451b73-5c8e-4c57-8c12-9406a38125e8 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:13.825784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 347/693] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:13.825784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63451b73-5c8e-4c57-8c12-9406a38125e8 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:13.851903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd70d8a-5a39-4e50-b52b-63e3257789b3 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:13.886922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:13.898932 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdffee-f677-4f4d-bcb9-23267334b2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:13.899724 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdffee-f677-4f4d-bcb9-23267334b2dd None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:13.900115 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdffee-f677-4f4d-bcb9-23267334b2dd None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:13.900503 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdffee-f677-4f4d-bcb9-23267334b2dd None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:13.901413 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdffee-f677-4f4d-bcb9-23267334b2dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:13.901836 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdffee-f677-4f4d-bcb9-23267334b2dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:13.903633 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdffee-f677-4f4d-bcb9-23267334b2dd None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:13.920971 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 347/694] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:13.920971 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdffee-f677-4f4d-bcb9-23267334b2dd None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:13.953131 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:13.981359 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63451b73-5c8e-4c57-8c12-9406a38125e8 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:14.018552 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bce9a-c700-4411-abdc-0a7a06897051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:14.019281 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bce9a-c700-4411-abdc-0a7a06897051 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:14.019567 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bce9a-c700-4411-abdc-0a7a06897051 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:14.019839 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bce9a-c700-4411-abdc-0a7a06897051 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:14.020947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bce9a-c700-4411-abdc-0a7a06897051 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:14.020947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bce9a-c700-4411-abdc-0a7a06897051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:14.023027 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bce9a-c700-4411-abdc-0a7a06897051 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:14.032924 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 348/695] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:39:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:14.033563 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bce9a-c700-4411-abdc-0a7a06897051 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:14.068235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdffee-f677-4f4d-bcb9-23267334b2dd None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:14.117846 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bc95e-89d2-44ed-82d7-091fd2cd30ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:14.120088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bc95e-89d2-44ed-82d7-091fd2cd30ab None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:14.120576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bc95e-89d2-44ed-82d7-091fd2cd30ab None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:14.121329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bc95e-89d2-44ed-82d7-091fd2cd30ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:14.130692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bc95e-89d2-44ed-82d7-091fd2cd30ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:14.133652 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bc95e-89d2-44ed-82d7-091fd2cd30ab None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:14.140219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bce9a-c700-4411-abdc-0a7a06897051 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:14.152526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-dd8bc95e-89d2-44ed-82d7-091fd2cd30ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:14.152526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:14.152526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:14.152526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:14.152526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:14.152526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:14.152526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:14.152526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:14.152526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:14.152526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:14.152526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:14.152526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:14.152526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:14.152526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:14.152526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:14.153780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:14.153780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:14.153780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:14.153780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:14.153780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:14.153780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:14.153780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:14.153780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:14.153780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:14.153780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:14.153780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:14.153780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:14.153780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:14.153780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:14.153780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:14.153780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:14.153780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:14.154668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:14.154668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:14.154668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:14.154668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:14.154668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:14.154668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:14.154668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:14.154668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:14.162723 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 348/696] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:14.162723 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bc95e-89d2-44ed-82d7-091fd2cd30ab None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:14.188346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657d168-2fd6-446b-a06e-9492193fd5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:14.189608 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657d168-2fd6-446b-a06e-9492193fd5eb None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:14.190528 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657d168-2fd6-446b-a06e-9492193fd5eb None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:14.191258 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657d168-2fd6-446b-a06e-9492193fd5eb None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:14.192428 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657d168-2fd6-446b-a06e-9492193fd5eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:14.196033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657d168-2fd6-446b-a06e-9492193fd5eb None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:14.214294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:14.269120 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bc95e-89d2-44ed-82d7-091fd2cd30ab None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:14.280845 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:14.293400 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 349/697] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 19:39:14 2022] POST /identity/v3/users => generated 254 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:39:14.300528 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657d168-2fd6-446b-a06e-9492193fd5eb None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:14.330960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f88c7f-6d9f-45c3-844a-b07428770a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:14.332574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88c7f-6d9f-45c3-844a-b07428770a13 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:14.332863 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88c7f-6d9f-45c3-844a-b07428770a13 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:14.333140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88c7f-6d9f-45c3-844a-b07428770a13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:14.357192 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f88c7f-6d9f-45c3-844a-b07428770a13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:14.358749 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f88c7f-6d9f-45c3-844a-b07428770a13 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:14.395517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-20f88c7f-6d9f-45c3-844a-b07428770a13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:14.395517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:14.395517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:14.395517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:14.395517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:14.395517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:14.395517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:14.395517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:14.395517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:14.395517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:14.395517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:14.395517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:14.395517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:14.395517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:14.395517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:14.396517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:14.396517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:14.396517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:14.396517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:14.396517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:14.396517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:14.396517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:14.396517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:14.396517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:14.396517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:14.396517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:14.396517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:14.396517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:14.396517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:14.396517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:14.396517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:14.396517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:14.397501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:14.397501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:14.397501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:14.397501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:14.398375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 349/698] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:14.403963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f88c7f-6d9f-45c3-844a-b07428770a13 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:14.520215 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657d168-2fd6-446b-a06e-9492193fd5eb None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:14.520945 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:14.527468 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f88c7f-6d9f-45c3-844a-b07428770a13 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:14.562824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2594b-730e-4fa9-bfc4-e5a3401593db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:14.563844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2594b-730e-4fa9-bfc4-e5a3401593db None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:14.564345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2594b-730e-4fa9-bfc4-e5a3401593db None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:14.564857 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2594b-730e-4fa9-bfc4-e5a3401593db None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:14.565892 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2594b-730e-4fa9-bfc4-e5a3401593db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:14.566413 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2594b-730e-4fa9-bfc4-e5a3401593db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:14.566594 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e9108-d140-4e09-ac58-6fcbf3dae73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:14.567223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e9108-d140-4e09-ac58-6fcbf3dae73f None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:14.567513 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e9108-d140-4e09-ac58-6fcbf3dae73f None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:14.567793 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e9108-d140-4e09-ac58-6fcbf3dae73f None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:14.568523 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e9108-d140-4e09-ac58-6fcbf3dae73f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:14.569107 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e9108-d140-4e09-ac58-6fcbf3dae73f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:14.570155 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2594b-730e-4fa9-bfc4-e5a3401593db None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:14.571123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e9108-d140-4e09-ac58-6fcbf3dae73f None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:14.584372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 350/699] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:14.586289 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 350/700] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:14.597269 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e9108-d140-4e09-ac58-6fcbf3dae73f None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:14.597448 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2594b-730e-4fa9-bfc4-e5a3401593db None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:14.666294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:14.715392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e9108-d140-4e09-ac58-6fcbf3dae73f None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:14.726684 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2594b-730e-4fa9-bfc4-e5a3401593db None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:14.774562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb2afe-5ede-47e6-b6a2-ba37c726fbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:14.775373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb2afe-5ede-47e6-b6a2-ba37c726fbb5 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:14.775641 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb2afe-5ede-47e6-b6a2-ba37c726fbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:14.775940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb2afe-5ede-47e6-b6a2-ba37c726fbb5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:14.787351 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb2afe-5ede-47e6-b6a2-ba37c726fbb5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:14.789514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb2afe-5ede-47e6-b6a2-ba37c726fbb5 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:14.792830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87083f4-e42e-444a-9c46-e74e61a5d709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:14.793522 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87083f4-e42e-444a-9c46-e74e61a5d709 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:14.793802 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87083f4-e42e-444a-9c46-e74e61a5d709 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:14.794079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87083f4-e42e-444a-9c46-e74e61a5d709 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:14.794909 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87083f4-e42e-444a-9c46-e74e61a5d709 None admin] RBAC: Adding query filter params (role.id=e466769ed9af47889225dd8d77e896a5, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=2cc53095a45e4136b37fb6e4e677eff9) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:14.795223 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87083f4-e42e-444a-9c46-e74e61a5d709 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:14.796637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87083f4-e42e-444a-9c46-e74e61a5d709 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:14.811456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 351/701] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:39:14 2022] GET /identity/v3/role_assignments?user.id=2cc53095a45e4136b37fb6e4e677eff9&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=e466769ed9af47889225dd8d77e896a5 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:14.827904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-29fb2afe-5ede-47e6-b6a2-ba37c726fbb5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 19:39:14.827904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:14.827904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:14.827904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:14.827904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:14.827904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:14.827904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:14.827904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:14.827904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:14.827904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:14.827904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:14.827904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:14.827904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:14.827904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:14.827904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:14.827904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:14.828960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:14.828960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:14.828960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:14.828960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:14.828960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:14.828960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:14.828960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:14.828960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:14.828960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:14.828960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:14.828960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:14.828960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:14.828960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:14.828960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:14.828960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:14.828960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:14.828960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:14.828960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:14.829935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:14.829935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:14.829935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:14.829935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:14.829935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:14.829935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:14.829935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:14.829935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:14.829935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 19:39:14.829935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:14.833625 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 351/702] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 23 19:39:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:14.838356 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87083f4-e42e-444a-9c46-e74e61a5d709 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:14.985314 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f39099-7d89-49f9-9853-8c4c43d1753c None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:14.985620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f39099-7d89-49f9-9853-8c4c43d1753c None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:14.985808 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f39099-7d89-49f9-9853-8c4c43d1753c None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:14.987468 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 352/703] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:14.994117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194308d-2819-41eb-afd2-9c1cc80bc13f None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:14.994403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194308d-2819-41eb-afd2-9c1cc80bc13f None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:14.994675 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194308d-2819-41eb-afd2-9c1cc80bc13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:14.997277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87083f4-e42e-444a-9c46-e74e61a5d709 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:15.026332 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-1194308d-2819-41eb-afd2-9c1cc80bc13f None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:15.027558 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-1194308d-2819-41eb-afd2-9c1cc80bc13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:15.029097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:15.044900 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:15.048426 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0de6f-914e-4e26-81ce-561a989e4d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:15.050029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0de6f-914e-4e26-81ce-561a989e4d8f None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:15.050547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0de6f-914e-4e26-81ce-561a989e4d8f None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:15.051475 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0de6f-914e-4e26-81ce-561a989e4d8f None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:15.052550 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0de6f-914e-4e26-81ce-561a989e4d8f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:15.053416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0de6f-914e-4e26-81ce-561a989e4d8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:15.055644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0de6f-914e-4e26-81ce-561a989e4d8f None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:15.080421 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 352/704] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 23 19:39:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:15.087820 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0de6f-914e-4e26-81ce-561a989e4d8f None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:15.111703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 353/705] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:39:15.143162 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194308d-2819-41eb-afd2-9c1cc80bc13f None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:15.206955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0de6f-914e-4e26-81ce-561a989e4d8f None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:15.250888 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e101e-efef-450f-a545-ed08493bf745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:15.251455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e101e-efef-450f-a545-ed08493bf745 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:15.251775 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e101e-efef-450f-a545-ed08493bf745 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:15.252010 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e101e-efef-450f-a545-ed08493bf745 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:15.260104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194308d-2819-41eb-afd2-9c1cc80bc13f None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:15.297316 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239af07-c68a-4ea7-be41-c2d182b1ae22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:15.298255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239af07-c68a-4ea7-be41-c2d182b1ae22 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:15.298542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239af07-c68a-4ea7-be41-c2d182b1ae22 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:15.298824 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239af07-c68a-4ea7-be41-c2d182b1ae22 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:15.299490 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239af07-c68a-4ea7-be41-c2d182b1ae22 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:15.301007 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239af07-c68a-4ea7-be41-c2d182b1ae22 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:15.309772 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:15.318079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-5239af07-c68a-4ea7-be41-c2d182b1ae22 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 19:39:15.318079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:15.318079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:15.318079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:15.318079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:15.318079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:15.318079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:15.318079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:15.318079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 19:39:15.318079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:15.318079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:15.318079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:15.318079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:15.318079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:15.318079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:15.318079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:15.323940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:15.323940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:15.323940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:15.323940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:15.323940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:15.323940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:15.323940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:15.323940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:15.323940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:15.323940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:15.323940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:15.323940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:15.323940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:15.323940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:15.323940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:15.323940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:15.324816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:15.324816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:15.324816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:15.324816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:15.324816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:15.324816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:15.324816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:15.324816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:15.324816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:15.324816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:15.324816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:15.324816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:15.324816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:15.324816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 19:39:15.324816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:15.324816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 354/706] 10.222.0.13 () {56 vars in 1129 bytes} [Thu Jun 23 19:39:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:15.326700 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239af07-c68a-4ea7-be41-c2d182b1ae22 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:15.338343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e101e-efef-450f-a545-ed08493bf745 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:15.340197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e101e-efef-450f-a545-ed08493bf745 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:15.343019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:15.502322 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239af07-c68a-4ea7-be41-c2d182b1ae22 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:15.522442 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 353/707] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:39:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:39:15.527628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec401c2-198c-43ad-85f7-50bf96b33c72 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:15.527628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec401c2-198c-43ad-85f7-50bf96b33c72 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:15.527628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec401c2-198c-43ad-85f7-50bf96b33c72 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:15.533251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 354/708] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:15.534134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec401c2-198c-43ad-85f7-50bf96b33c72 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:15.550798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f63623-5b29-41b4-86d0-4ef1d8f01f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:15.551975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f63623-5b29-41b4-86d0-4ef1d8f01f00 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:15.552536 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f63623-5b29-41b4-86d0-4ef1d8f01f00 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:15.552970 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f63623-5b29-41b4-86d0-4ef1d8f01f00 None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:15.555296 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f63623-5b29-41b4-86d0-4ef1d8f01f00 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:15.555804 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f63623-5b29-41b4-86d0-4ef1d8f01f00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:15.557824 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f63623-5b29-41b4-86d0-4ef1d8f01f00 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:15.564445 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 355/709] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Jun 23 19:39:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:15.566145 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655d8c8-56da-4b63-957e-6a30050365f7 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:15.566899 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655d8c8-56da-4b63-957e-6a30050365f7 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:15.567598 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655d8c8-56da-4b63-957e-6a30050365f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:15.594324 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-d655d8c8-56da-4b63-957e-6a30050365f7 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:15.596482 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d655d8c8-56da-4b63-957e-6a30050365f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:15.625902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:15.654057 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec401c2-198c-43ad-85f7-50bf96b33c72 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:15.691390 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 356/710] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:39:15.692655 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655d8c8-56da-4b63-957e-6a30050365f7 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:15.697798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:15.714770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f61c71-28d3-4fe9-b26f-b0905ffb707a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:15.715575 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f61c71-28d3-4fe9-b26f-b0905ffb707a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:15.715865 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f61c71-28d3-4fe9-b26f-b0905ffb707a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:15.716142 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f61c71-28d3-4fe9-b26f-b0905ffb707a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:15.735845 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f61c71-28d3-4fe9-b26f-b0905ffb707a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:15.740826 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f61c71-28d3-4fe9-b26f-b0905ffb707a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:15.759993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-b2f61c71-28d3-4fe9-b26f-b0905ffb707a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:15.759993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:15.759993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:15.759993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:15.759993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:15.759993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:15.759993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:15.759993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:15.759993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:15.759993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:15.759993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:15.759993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:15.759993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:15.759993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:15.759993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:15.760916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:15.760916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:15.760916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:15.760916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:15.760916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:15.760916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:15.760916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:15.760916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:15.760916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:15.760916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:15.760916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:15.760916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:15.760916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:15.760916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:15.760916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:15.760916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:15.760916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:15.761857 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:15.761857 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:15.761857 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:15.761857 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:15.765671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 355/711] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:15.766498 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f61c71-28d3-4fe9-b26f-b0905ffb707a None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:15.841283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655d8c8-56da-4b63-957e-6a30050365f7 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:15.885761 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f61c71-28d3-4fe9-b26f-b0905ffb707a None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:15.890128 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1d640-9f8a-4ade-9f53-f6c0bc914afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:15.890809 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1d640-9f8a-4ade-9f53-f6c0bc914afd None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:15.891097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1d640-9f8a-4ade-9f53-f6c0bc914afd None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:15.891377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1d640-9f8a-4ade-9f53-f6c0bc914afd None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:15.892094 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1d640-9f8a-4ade-9f53-f6c0bc914afd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:15.892403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1d640-9f8a-4ade-9f53-f6c0bc914afd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:15.893823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1d640-9f8a-4ade-9f53-f6c0bc914afd None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:15.900364 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 357/712] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Jun 23 19:39:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:15.901009 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1d640-9f8a-4ade-9f53-f6c0bc914afd None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:16.005532 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:16.015766 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc40c1-35f3-4559-9873-5c48e800ce00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:16.016901 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc40c1-35f3-4559-9873-5c48e800ce00 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:16.017403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc40c1-35f3-4559-9873-5c48e800ce00 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:16.017840 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc40c1-35f3-4559-9873-5c48e800ce00 None admin] PATH_INFO: `/v3/services/network` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:16.018668 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc40c1-35f3-4559-9873-5c48e800ce00 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:16.020229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc40c1-35f3-4559-9873-5c48e800ce00 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:16.048266 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:16.050994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-00cc40c1-35f3-4559-9873-5c48e800ce00 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 19:39:16.050994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:16.050994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:16.050994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:16.050994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:16.050994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:16.050994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:16.050994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:16.050994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 19:39:16.050994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:16.050994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:16.050994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:16.050994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:16.050994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:16.050994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:16.050994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:16.050994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:16.052108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:16.052108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:16.052108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:16.052108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:16.052108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:16.052108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:16.052108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:16.052108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:16.052108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:16.052108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:16.052108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:16.052108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:16.052108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:16.052108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:16.052108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:16.052108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:16.053266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:16.053266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:16.053266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:16.053266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:16.053266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:16.053266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:16.053266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:16.053266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:16.053266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:16.053266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:16.053266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:16.053266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:16.053266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 19:39:16.053266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:16.053266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 356/713] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:15 2022] GET /identity/v3/services/network => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:16.066821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc40c1-35f3-4559-9873-5c48e800ce00 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:16.125921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1d640-9f8a-4ade-9f53-f6c0bc914afd None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:16.165668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edead81-77e1-4ace-a44f-db2d32b930d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:16.167109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edead81-77e1-4ace-a44f-db2d32b930d3 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:16.167594 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edead81-77e1-4ace-a44f-db2d32b930d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:16.168070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edead81-77e1-4ace-a44f-db2d32b930d3 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:16.168986 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edead81-77e1-4ace-a44f-db2d32b930d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:16.169503 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edead81-77e1-4ace-a44f-db2d32b930d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:16.171114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edead81-77e1-4ace-a44f-db2d32b930d3 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:16.188551 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 358/714] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:16.190068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edead81-77e1-4ace-a44f-db2d32b930d3 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:16.203160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc40c1-35f3-4559-9873-5c48e800ce00 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:16.242586 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd3228-1f48-4e1f-bcef-ce58b18d658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:16.243611 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd3228-1f48-4e1f-bcef-ce58b18d658d None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:16.243611 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd3228-1f48-4e1f-bcef-ce58b18d658d None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:16.243967 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd3228-1f48-4e1f-bcef-ce58b18d658d None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:16.244742 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd3228-1f48-4e1f-bcef-ce58b18d658d None admin] RBAC: Adding query filter params (name=network) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:16.245114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd3228-1f48-4e1f-bcef-ce58b18d658d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:16.246648 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd3228-1f48-4e1f-bcef-ce58b18d658d None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:16.251742 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 357/715] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 19:39:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:16.258479 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd3228-1f48-4e1f-bcef-ce58b18d658d None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:16.301801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edead81-77e1-4ace-a44f-db2d32b930d3 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:16.322814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:16.331110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:16.340383 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9459922-896b-4464-90df-bf6692279b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:16.342686 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9459922-896b-4464-90df-bf6692279b74 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:16.342686 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9459922-896b-4464-90df-bf6692279b74 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:16.342686 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9459922-896b-4464-90df-bf6692279b74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:16.350081 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9459922-896b-4464-90df-bf6692279b74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:16.352473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9459922-896b-4464-90df-bf6692279b74 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:16.367453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-c9459922-896b-4464-90df-bf6692279b74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:16.367453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:16.367453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:16.367453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:16.367453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:16.367453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:16.367453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:16.367453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:16.367453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:16.367453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:16.367453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:16.367453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:16.367453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:16.367453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:16.367453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:16.368453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:16.368453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:16.368453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:16.368453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:16.368453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:16.368453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:16.368453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:16.368453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:16.368453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:16.368453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:16.368453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:16.368453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:16.368453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:16.368453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:16.368453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:16.368453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:16.368453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:16.369415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:16.369415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:16.369415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:16.369415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:16.369415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:16.369415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:16.369415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:16.369415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:16.371384 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd3228-1f48-4e1f-bcef-ce58b18d658d None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:16.376126 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 359/716] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:16.378521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9459922-896b-4464-90df-bf6692279b74 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:16.425239 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be84963-27ea-4e56-9577-33a4321a0774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:16.426099 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be84963-27ea-4e56-9577-33a4321a0774 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:16.426327 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be84963-27ea-4e56-9577-33a4321a0774 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:16.426606 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be84963-27ea-4e56-9577-33a4321a0774 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:16.427317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be84963-27ea-4e56-9577-33a4321a0774 None admin] RBAC: Adding query filter params (type=network) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:16.427619 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be84963-27ea-4e56-9577-33a4321a0774 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:16.429218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be84963-27ea-4e56-9577-33a4321a0774 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:16.442308 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 358/717] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 19:39:16 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:16.492521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9459922-896b-4464-90df-bf6692279b74 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:16.531151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc4308-0e0a-4dbd-af51-617754637640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:16.532255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc4308-0e0a-4dbd-af51-617754637640 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:16.532769 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc4308-0e0a-4dbd-af51-617754637640 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:16.533304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc4308-0e0a-4dbd-af51-617754637640 None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:16.534361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc4308-0e0a-4dbd-af51-617754637640 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:16.534919 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc4308-0e0a-4dbd-af51-617754637640 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:16.536662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc4308-0e0a-4dbd-af51-617754637640 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:16.556969 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 360/718] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:16.558750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be84963-27ea-4e56-9577-33a4321a0774 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:16.690576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be84963-27ea-4e56-9577-33a4321a0774 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:16.716313 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:16.727827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734966b1-68d7-4e43-86ae-c500417e69bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:16.731676 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734966b1-68d7-4e43-86ae-c500417e69bd None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:16.731676 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734966b1-68d7-4e43-86ae-c500417e69bd None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:16.731676 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734966b1-68d7-4e43-86ae-c500417e69bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:16.731676 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734966b1-68d7-4e43-86ae-c500417e69bd None admin] RBAC: Adding query filter params (role.id=76bd0cf7bf094e4fa3db121b96215004, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=83bff5cd7782423eaa0bc5b29b208ae7) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:16.731676 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734966b1-68d7-4e43-86ae-c500417e69bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:16.731676 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734966b1-68d7-4e43-86ae-c500417e69bd None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:16.737977 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 359/719] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:39:16 2022] GET /identity/v3/role_assignments?user.id=83bff5cd7782423eaa0bc5b29b208ae7&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=76bd0cf7bf094e4fa3db121b96215004 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:17.025424 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab0414-b1ef-4224-b419-3d7d005eaa62 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:17.026139 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab0414-b1ef-4224-b419-3d7d005eaa62 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:17.026665 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab0414-b1ef-4224-b419-3d7d005eaa62 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:17.028611 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 361/720] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:17.033687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d0d9a-95dd-419e-a5f1-273bc0fcfc11 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:17.033984 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d0d9a-95dd-419e-a5f1-273bc0fcfc11 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:17.034270 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d0d9a-95dd-419e-a5f1-273bc0fcfc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:17.055560 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-3d8d0d9a-95dd-419e-a5f1-273bc0fcfc11 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:17.056751 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-3d8d0d9a-95dd-419e-a5f1-273bc0fcfc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:17.148489 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 360/721] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:39:17.190921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab0414-b1ef-4224-b419-3d7d005eaa62 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:17.260298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:17.324560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab0414-b1ef-4224-b419-3d7d005eaa62 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:17.370798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea89951-6759-4889-b78d-bd7c38a81a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:17.371613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea89951-6759-4889-b78d-bd7c38a81a4f None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:17.371903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea89951-6759-4889-b78d-bd7c38a81a4f None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:17.372184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea89951-6759-4889-b78d-bd7c38a81a4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:17.385969 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea89951-6759-4889-b78d-bd7c38a81a4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:17.394031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-dea89951-6759-4889-b78d-bd7c38a81a4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:17.394031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:17.394031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:17.394031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:17.394031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:17.394031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:17.394031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:17.394031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:17.394031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:17.394031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:17.394031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:17.394031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:17.394031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:17.394031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:17.394031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:17.394031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:17.394956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:17.394956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:17.394956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:17.394956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:17.394956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:17.394956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:17.394956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:17.394956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:17.394956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:17.394956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:17.394956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:17.394956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:17.394956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:17.394956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:17.394956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:17.394956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:17.396025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:17.396025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:17.396025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:17.396025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:17.396025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:17.396025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:17.396025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:17.396025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:17.396025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:17.396025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:17.396025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:17.396025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:17.396025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 362/722] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:39:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:17.402116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d0d9a-95dd-419e-a5f1-273bc0fcfc11 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:17.532953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d0d9a-95dd-419e-a5f1-273bc0fcfc11 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:17.553194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:17.576654 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da214ff5-5e09-425b-af03-d0013afc150c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:17.577363 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da214ff5-5e09-425b-af03-d0013afc150c None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:17.577654 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da214ff5-5e09-425b-af03-d0013afc150c None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:17.577934 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da214ff5-5e09-425b-af03-d0013afc150c None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:17.578704 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da214ff5-5e09-425b-af03-d0013afc150c None admin] RBAC: Adding query filter params (name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:17.579012 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da214ff5-5e09-425b-af03-d0013afc150c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:17.580391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da214ff5-5e09-425b-af03-d0013afc150c None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:17.595606 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 361/723] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:39:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:17.602076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea89951-6759-4889-b78d-bd7c38a81a4f None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:17.607941 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa515b-5b9c-4d7d-a93d-434cfd711e94 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:17.608254 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa515b-5b9c-4d7d-a93d-434cfd711e94 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:17.608524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa515b-5b9c-4d7d-a93d-434cfd711e94 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:17.610067 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 362/724] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:39:17.617958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c8af0-0583-445f-9778-0d0b1258624d None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:17.617958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c8af0-0583-445f-9778-0d0b1258624d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:17.617958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c8af0-0583-445f-9778-0d0b1258624d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:17.636387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-f27c8af0-0583-445f-9778-0d0b1258624d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:17.637964 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f27c8af0-0583-445f-9778-0d0b1258624d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:17.719169 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 363/725] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 19:39:17.743144 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c8af0-0583-445f-9778-0d0b1258624d None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:17.804979 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea89951-6759-4889-b78d-bd7c38a81a4f None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:17.814505 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:17.842203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0ee80-9ed5-43c9-a571-7af56d44ca95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:17.843420 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0ee80-9ed5-43c9-a571-7af56d44ca95 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:17.844004 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0ee80-9ed5-43c9-a571-7af56d44ca95 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:17.844529 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0ee80-9ed5-43c9-a571-7af56d44ca95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:17.856289 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0ee80-9ed5-43c9-a571-7af56d44ca95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:17.858173 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0ee80-9ed5-43c9-a571-7af56d44ca95 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:17.884883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-97d0ee80-9ed5-43c9-a571-7af56d44ca95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:17.884883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:17.884883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:17.884883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:17.884883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:17.884883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:17.884883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:17.884883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:17.884883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:17.884883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:17.884883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:17.884883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:17.884883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:17.884883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:17.884883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:17.886163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:17.886163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:17.886163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:17.886163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:17.886163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:17.886163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:17.886163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:17.886163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:17.886163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:17.886163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:17.886163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:17.886163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:17.886163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:17.886163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:17.886163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:17.886163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:17.886163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:17.887104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:17.887104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:17.887104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:17.887104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:17.889395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 363/726] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:17.900486 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0ee80-9ed5-43c9-a571-7af56d44ca95 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:17.910450 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c8af0-0583-445f-9778-0d0b1258624d None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:17.931331 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:17.978787 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0f7f9-f5b7-4340-9def-f874a73fecc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:17.979601 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0f7f9-f5b7-4340-9def-f874a73fecc0 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:17.979885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0f7f9-f5b7-4340-9def-f874a73fecc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:17.980181 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0f7f9-f5b7-4340-9def-f874a73fecc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:17.998109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0f7f9-f5b7-4340-9def-f874a73fecc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:18.013853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-d0c0f7f9-f5b7-4340-9def-f874a73fecc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:39:18.013853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:18.013853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:18.013853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:18.013853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:18.013853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:18.013853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:18.013853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:18.013853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:18.013853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:18.013853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:18.013853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:18.013853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:18.013853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:18.013853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:18.013853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:18.014861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:18.014861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:18.014861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:18.014861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:18.014861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:18.014861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:18.014861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:18.014861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:18.014861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:18.014861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:18.014861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:18.014861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:18.014861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:18.014861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:18.014861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:18.014861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:18.019900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:18.019900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:18.019900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:18.019900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:18.019900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:18.019900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:18.019900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:18.019900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:18.019900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:18.019900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:18.019900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:39:18.019900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:18.019900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 364/727] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:39:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:18.022863 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0ee80-9ed5-43c9-a571-7af56d44ca95 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:18.035052 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0f7f9-f5b7-4340-9def-f874a73fecc0 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:18.062770 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efab22-31f3-4af0-8630-10069d3fe6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:18.063773 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efab22-31f3-4af0-8630-10069d3fe6ea None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:18.064285 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efab22-31f3-4af0-8630-10069d3fe6ea None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:18.064772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efab22-31f3-4af0-8630-10069d3fe6ea None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:18.065830 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efab22-31f3-4af0-8630-10069d3fe6ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:18.066397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efab22-31f3-4af0-8630-10069d3fe6ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:18.068173 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efab22-31f3-4af0-8630-10069d3fe6ea None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:18.084047 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 364/728] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:18.093799 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efab22-31f3-4af0-8630-10069d3fe6ea None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:18.121725 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:18.212637 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efab22-31f3-4af0-8630-10069d3fe6ea None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:18.251319 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602f6b0-c736-41fb-a887-986ffd15383c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:18.252499 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602f6b0-c736-41fb-a887-986ffd15383c None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:18.253015 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602f6b0-c736-41fb-a887-986ffd15383c None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:18.253632 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602f6b0-c736-41fb-a887-986ffd15383c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:18.262248 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602f6b0-c736-41fb-a887-986ffd15383c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:18.263987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602f6b0-c736-41fb-a887-986ffd15383c None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:18.280336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-7602f6b0-c736-41fb-a887-986ffd15383c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 19:39:18.280336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:18.280336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:18.280336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:18.280336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:18.280336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:18.280336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:18.280336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:18.280336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:18.280336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:18.280336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:18.280336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:18.280336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:18.280336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:18.280336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:18.280336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:18.281438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:18.281438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:18.281438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:18.281438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:18.281438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:18.281438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:18.281438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:18.281438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:18.281438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:18.281438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:18.281438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:18.281438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:18.281438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:18.281438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:18.281438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:18.281438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:18.281438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:18.281438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:18.282477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:18.282477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:18.282477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:18.282477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:18.282477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:18.282477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:18.282477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:18.282477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:18.282477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 19:39:18.282477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:18.285243 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 365/729] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 23 19:39:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:18.295143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602f6b0-c736-41fb-a887-986ffd15383c None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:18.312763 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0f7f9-f5b7-4340-9def-f874a73fecc0 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:18.351791 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735950a-28ad-4ccd-a1f7-802d561ced43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:18.355608 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735950a-28ad-4ccd-a1f7-802d561ced43 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:18.355608 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735950a-28ad-4ccd-a1f7-802d561ced43 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:18.355608 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735950a-28ad-4ccd-a1f7-802d561ced43 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:18.355608 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735950a-28ad-4ccd-a1f7-802d561ced43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:18.355608 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735950a-28ad-4ccd-a1f7-802d561ced43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:18.355608 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735950a-28ad-4ccd-a1f7-802d561ced43 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:18.365693 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 365/730] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:39:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:18.378228 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735950a-28ad-4ccd-a1f7-802d561ced43 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:18.422216 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:18.442613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602f6b0-c736-41fb-a887-986ffd15383c None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:18.444706 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:18.483533 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85380f06-dfca-44ed-ac3b-e73c038f02e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:18.484621 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85380f06-dfca-44ed-ac3b-e73c038f02e6 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:18.485127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85380f06-dfca-44ed-ac3b-e73c038f02e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:18.485620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85380f06-dfca-44ed-ac3b-e73c038f02e6 None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:18.486854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85380f06-dfca-44ed-ac3b-e73c038f02e6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:18.487633 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85380f06-dfca-44ed-ac3b-e73c038f02e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:18.489299 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85380f06-dfca-44ed-ac3b-e73c038f02e6 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:18.510120 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 366/731] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Jun 23 19:39:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:18.522876 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85380f06-dfca-44ed-ac3b-e73c038f02e6 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:18.575244 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735950a-28ad-4ccd-a1f7-802d561ced43 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:18.629680 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85380f06-dfca-44ed-ac3b-e73c038f02e6 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:18.638805 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d14f3-6ca1-475e-928c-ab02922ac44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:18.640155 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d14f3-6ca1-475e-928c-ab02922ac44e None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:18.640438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d14f3-6ca1-475e-928c-ab02922ac44e None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:18.640713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d14f3-6ca1-475e-928c-ab02922ac44e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:18.656260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d14f3-6ca1-475e-928c-ab02922ac44e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:18.658281 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d14f3-6ca1-475e-928c-ab02922ac44e None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:18.671812 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569e309-5063-421e-8173-5ef77d0ffea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:18.672809 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569e309-5063-421e-8173-5ef77d0ffea0 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:18.673345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569e309-5063-421e-8173-5ef77d0ffea0 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:18.673867 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569e309-5063-421e-8173-5ef77d0ffea0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:18.681646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-f62d14f3-6ca1-475e-928c-ab02922ac44e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:18.681646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:18.681646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:18.681646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:18.681646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:18.681646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:18.681646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:18.681646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:18.681646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:18.681646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:18.681646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:18.681646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:18.681646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:18.681646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:18.681646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:18.682577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:18.682577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:18.682577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:18.682577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:18.682577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:18.682577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:18.682577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:18.682577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:18.682577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:18.682577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:18.682577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:18.682577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:18.682577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:18.682577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:18.682577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:18.682577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:18.682577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:18.683496 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:18.683496 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:18.683496 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:18.683496 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:18.688067 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:18.688336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 366/732] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:18.690223 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fcf13-fb7f-479d-882a-20240fb405f6 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:18.690508 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fcf13-fb7f-479d-882a-20240fb405f6 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:18.690788 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fcf13-fb7f-479d-882a-20240fb405f6 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:18.692790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 367/733] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:18.694669 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fcf13-fb7f-479d-882a-20240fb405f6 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:18.759158 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569e309-5063-421e-8173-5ef77d0ffea0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:18.761051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569e309-5063-421e-8173-5ef77d0ffea0 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:18.798521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:18.817980 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fcf13-fb7f-479d-882a-20240fb405f6 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:18.858725 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a32d8d-8b96-4d75-80f1-fdc36681fe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:18.859982 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a32d8d-8b96-4d75-80f1-fdc36681fe57 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:18.859982 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a32d8d-8b96-4d75-80f1-fdc36681fe57 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:18.860171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a32d8d-8b96-4d75-80f1-fdc36681fe57 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:18.860793 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a32d8d-8b96-4d75-80f1-fdc36681fe57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:18.861105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a32d8d-8b96-4d75-80f1-fdc36681fe57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:18.862884 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a32d8d-8b96-4d75-80f1-fdc36681fe57 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:18.870272 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 367/734] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:39:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:39:18.877913 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe9167-646d-4c28-9190-3a6762078a6d None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:18.878630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe9167-646d-4c28-9190-3a6762078a6d None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:18.879122 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe9167-646d-4c28-9190-3a6762078a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:18.885625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 368/735] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:18.887349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a32d8d-8b96-4d75-80f1-fdc36681fe57 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:18.904617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-4dfe9167-646d-4c28-9190-3a6762078a6d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:18.906162 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-4dfe9167-646d-4c28-9190-3a6762078a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:18.937493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:18.977467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 368/736] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:39:18.978841 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe9167-646d-4c28-9190-3a6762078a6d None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:19.019020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a32d8d-8b96-4d75-80f1-fdc36681fe57 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:19.065859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17f9ea-5603-4a65-a3cf-6c45338066d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:19.066657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17f9ea-5603-4a65-a3cf-6c45338066d6 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:19.066944 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17f9ea-5603-4a65-a3cf-6c45338066d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:19.067282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17f9ea-5603-4a65-a3cf-6c45338066d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:19.080339 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17f9ea-5603-4a65-a3cf-6c45338066d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:19.081881 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17f9ea-5603-4a65-a3cf-6c45338066d6 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:19.084786 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:19.086872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe9167-646d-4c28-9190-3a6762078a6d None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:19.102255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-4f17f9ea-5603-4a65-a3cf-6c45338066d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:19.102255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:19.102255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:19.102255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:19.102255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:19.102255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:19.102255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:19.102255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:19.102255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:19.102255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:19.102255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:19.102255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:19.102255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:19.102255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:19.102255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:19.103376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:19.103376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:19.103376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:19.103376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:19.103376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:19.103376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:19.103376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:19.103376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:19.103376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:19.103376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:19.103376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:19.103376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:19.103376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:19.103376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:19.103376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:19.103376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:19.103376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:19.104486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:19.104486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:19.104486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:19.104486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:19.109490 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 369/737] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:19.110557 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17f9ea-5603-4a65-a3cf-6c45338066d6 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:19.125767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7180ab-db3e-478c-9691-8b39425d3c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:19.126816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7180ab-db3e-478c-9691-8b39425d3c05 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:19.127200 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7180ab-db3e-478c-9691-8b39425d3c05 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:19.127557 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7180ab-db3e-478c-9691-8b39425d3c05 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:19.136171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7180ab-db3e-478c-9691-8b39425d3c05 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:19.137620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7180ab-db3e-478c-9691-8b39425d3c05 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:19.153202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-7d7180ab-db3e-478c-9691-8b39425d3c05 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 19:39:19.153202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:19.153202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:19.153202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:19.153202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:19.153202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:19.153202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:19.153202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:19.153202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:19.153202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:19.153202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:19.153202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:19.153202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:19.153202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:19.153202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:19.153202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:19.154177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:19.154177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:19.154177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:19.154177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:19.154177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:19.154177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:19.154177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:19.154177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:19.154177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:19.154177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:19.154177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:19.154177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:19.154177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:19.154177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:19.154177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:19.154177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:19.154177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:19.154177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:19.155140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:19.155140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:19.155140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:19.155140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:19.155140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:19.155140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:19.155140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:19.155140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:19.155140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 19:39:19.155140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:19.155140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 369/738] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:39:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:19.155774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7180ab-db3e-478c-9691-8b39425d3c05 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:19.185499 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:19.231028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17f9ea-5603-4a65-a3cf-6c45338066d6 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:19.259833 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7180ab-db3e-478c-9691-8b39425d3c05 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:19.266253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225b2dd-dd68-4dbe-ae39-25e2f90b1e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:19.266919 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225b2dd-dd68-4dbe-ae39-25e2f90b1e8a None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:19.267205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225b2dd-dd68-4dbe-ae39-25e2f90b1e8a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:19.267486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225b2dd-dd68-4dbe-ae39-25e2f90b1e8a None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:19.268206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225b2dd-dd68-4dbe-ae39-25e2f90b1e8a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:19.269605 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225b2dd-dd68-4dbe-ae39-25e2f90b1e8a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:19.293467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e713f66-d22d-4ab0-8864-8c5323f52276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:19.294131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e713f66-d22d-4ab0-8864-8c5323f52276 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:19.294417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e713f66-d22d-4ab0-8864-8c5323f52276 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:19.294692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e713f66-d22d-4ab0-8864-8c5323f52276 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:19.295433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e713f66-d22d-4ab0-8864-8c5323f52276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:19.295715 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e713f66-d22d-4ab0-8864-8c5323f52276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:19.297068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e713f66-d22d-4ab0-8864-8c5323f52276 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:19.308818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 370/739] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:19.310036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8fd3-0c1e-42e9-9793-81f27b94d92a None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:19.310328 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8fd3-0c1e-42e9-9793-81f27b94d92a None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:19.310611 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8fd3-0c1e-42e9-9793-81f27b94d92a None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:19.311826 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 371/740] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:19.312516 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c8fd3-0c1e-42e9-9793-81f27b94d92a None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:19.402278 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:19.406115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 370/741] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 19:39:19 2022] POST /identity/v3/services => generated 251 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:39:19.407576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b571f-358c-4c17-91bb-f41343f6b576 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:19.407869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b571f-358c-4c17-91bb-f41343f6b576 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:19.408155 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b571f-358c-4c17-91bb-f41343f6b576 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:19.409449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 371/742] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:19.413443 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b571f-358c-4c17-91bb-f41343f6b576 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:19.435394 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c8fd3-0c1e-42e9-9793-81f27b94d92a None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:19.476082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc9a76-3743-4678-8286-a0e0584d01ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:19.477065 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc9a76-3743-4678-8286-a0e0584d01ba None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:19.477573 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc9a76-3743-4678-8286-a0e0584d01ba None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:19.478019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc9a76-3743-4678-8286-a0e0584d01ba None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:19.478922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc9a76-3743-4678-8286-a0e0584d01ba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:19.479242 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc9a76-3743-4678-8286-a0e0584d01ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:19.480747 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc9a76-3743-4678-8286-a0e0584d01ba None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:19.486814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:19.501278 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 372/743] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Jun 23 19:39:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:19.502755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88620c-f291-44c3-9d6e-26ad8a37890a None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:19.503049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88620c-f291-44c3-9d6e-26ad8a37890a None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:19.503333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88620c-f291-44c3-9d6e-26ad8a37890a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:19.521576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-dc88620c-f291-44c3-9d6e-26ad8a37890a None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:19.523490 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-dc88620c-f291-44c3-9d6e-26ad8a37890a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:19.544101 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b571f-358c-4c17-91bb-f41343f6b576 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:19.589959 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f51209-43e3-48e8-9ec8-1bef335495e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:19.590760 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f51209-43e3-48e8-9ec8-1bef335495e4 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:19.591044 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f51209-43e3-48e8-9ec8-1bef335495e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:19.591321 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f51209-43e3-48e8-9ec8-1bef335495e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:19.599852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f51209-43e3-48e8-9ec8-1bef335495e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:19.601385 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f51209-43e3-48e8-9ec8-1bef335495e4 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:19.603181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 373/744] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:39:19.606498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4a448-653e-4408-bba0-fdde6bce9e5c None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:19.606498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4a448-653e-4408-bba0-fdde6bce9e5c None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:19.606498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4a448-653e-4408-bba0-fdde6bce9e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:19.616408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-63f51209-43e3-48e8-9ec8-1bef335495e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:19.616408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:19.616408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:19.616408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:19.616408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:19.616408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:19.616408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:19.616408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:19.616408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:19.616408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:19.616408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:19.616408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:19.616408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:19.616408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:19.616408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:19.617345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:19.617345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:19.617345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:19.617345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:19.617345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:19.617345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:19.617345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:19.617345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:19.617345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:19.617345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:19.617345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:19.617345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:19.617345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:19.617345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:19.617345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:19.617345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:19.617345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:19.618242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:19.618242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:19.618242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:19.618242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:19.618242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:19.618242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:19.618242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:19.618242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:19.622460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 372/745] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:19.623369 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f51209-43e3-48e8-9ec8-1bef335495e4 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:19.625225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-b9e4a448-653e-4408-bba0-fdde6bce9e5c None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:19.626798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-b9e4a448-653e-4408-bba0-fdde6bce9e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:19.705283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 374/746] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 19:39:19.705283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4a448-653e-4408-bba0-fdde6bce9e5c None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:19.705283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:19.745400 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f51209-43e3-48e8-9ec8-1bef335495e4 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:19.763661 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:19.782588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5824ce-6052-4714-ae00-0091a12344d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:19.783269 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5824ce-6052-4714-ae00-0091a12344d5 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:19.783603 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5824ce-6052-4714-ae00-0091a12344d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:19.783892 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5824ce-6052-4714-ae00-0091a12344d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:19.823530 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4a448-653e-4408-bba0-fdde6bce9e5c None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:19.854594 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5824ce-6052-4714-ae00-0091a12344d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:19.856050 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5824ce-6052-4714-ae00-0091a12344d5 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:19.861315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7343cf-639d-4637-a146-c447ef28b2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:19.861990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7343cf-639d-4637-a146-c447ef28b2af None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:19.862280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7343cf-639d-4637-a146-c447ef28b2af None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:19.862578 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7343cf-639d-4637-a146-c447ef28b2af None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:19.863438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7343cf-639d-4637-a146-c447ef28b2af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:19.863872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7343cf-639d-4637-a146-c447ef28b2af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:19.865347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7343cf-639d-4637-a146-c447ef28b2af None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:19.888339 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 375/747] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:19.888339 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7343cf-639d-4637-a146-c447ef28b2af None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:19.956199 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:19.976139 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 373/748] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:39:19 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 19:39:19.976969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5824ce-6052-4714-ae00-0091a12344d5 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:19.996916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:20.000981 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7343cf-639d-4637-a146-c447ef28b2af None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:20.039032 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95588257-dd33-45f2-9aea-c628a747625e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:20.039827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95588257-dd33-45f2-9aea-c628a747625e None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:20.040114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95588257-dd33-45f2-9aea-c628a747625e None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:20.040396 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95588257-dd33-45f2-9aea-c628a747625e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:20.050346 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95588257-dd33-45f2-9aea-c628a747625e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:20.058473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-95588257-dd33-45f2-9aea-c628a747625e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:39:20.058473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:20.058473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:20.058473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:20.058473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:20.058473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:20.058473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:20.058473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:20.058473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:20.058473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:20.058473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:20.058473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:20.058473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:20.058473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:20.058473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:20.058473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:20.059650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:20.059650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:20.059650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:20.059650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:20.059650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:20.059650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:20.059650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:20.059650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:20.059650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:20.059650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:20.059650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:20.059650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:20.059650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:20.059650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:20.059650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:20.059650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:20.065574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:20.065574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:20.065574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:20.065574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:20.065574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:20.065574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:20.065574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:20.065574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:20.065574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:20.065574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:20.065574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:39:20.065574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:20.065574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 376/749] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:39:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:20.065574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95588257-dd33-45f2-9aea-c628a747625e None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:20.092501 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5824ce-6052-4714-ae00-0091a12344d5 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:20.127715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aeb08e-9bca-4238-a56a-f0ea09d3aa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:20.128382 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aeb08e-9bca-4238-a56a-f0ea09d3aa24 None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:20.128671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aeb08e-9bca-4238-a56a-f0ea09d3aa24 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:20.128959 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aeb08e-9bca-4238-a56a-f0ea09d3aa24 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:20.129730 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aeb08e-9bca-4238-a56a-f0ea09d3aa24 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:20.131104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aeb08e-9bca-4238-a56a-f0ea09d3aa24 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:20.170410 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95588257-dd33-45f2-9aea-c628a747625e None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:20.192462 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:20.204474 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a86a5-be02-4644-8ea0-5850c741976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:20.205131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a86a5-be02-4644-8ea0-5850c741976e None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:20.205457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a86a5-be02-4644-8ea0-5850c741976e None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:20.205736 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a86a5-be02-4644-8ea0-5850c741976e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:20.206613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a86a5-be02-4644-8ea0-5850c741976e None admin] RBAC: Adding query filter params (role.id=e466769ed9af47889225dd8d77e896a5, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=fec6c1cbf48a44f9922bd82e714861c1) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:20.206880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a86a5-be02-4644-8ea0-5850c741976e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:20.208338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a86a5-be02-4644-8ea0-5850c741976e None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:20.216206 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 377/750] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:39:20 2022] GET /identity/v3/role_assignments?user.id=fec6c1cbf48a44f9922bd82e714861c1&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=e466769ed9af47889225dd8d77e896a5 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:20.217261 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a86a5-be02-4644-8ea0-5850c741976e None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:20.225728 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 374/751] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 19:39:19 2022] POST /identity/v3/services => generated 240 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:39:20.227824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aeb08e-9bca-4238-a56a-f0ea09d3aa24 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:20.417467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a86a5-be02-4644-8ea0-5850c741976e None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:20.419324 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:20.461753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aeb08e-9bca-4238-a56a-f0ea09d3aa24 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:20.468665 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a73e5-dc0a-496b-90fc-a7ba96f697f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:20.469515 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a73e5-dc0a-496b-90fc-a7ba96f697f5 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:20.469807 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a73e5-dc0a-496b-90fc-a7ba96f697f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:20.470093 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a73e5-dc0a-496b-90fc-a7ba96f697f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:20.488117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a73e5-dc0a-496b-90fc-a7ba96f697f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:20.489669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a73e5-dc0a-496b-90fc-a7ba96f697f5 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:20.500588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a8064-eecf-4ce9-8e5e-7c12cb370032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:20.501957 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a8064-eecf-4ce9-8e5e-7c12cb370032 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:20.502463 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a8064-eecf-4ce9-8e5e-7c12cb370032 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:20.502943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a8064-eecf-4ce9-8e5e-7c12cb370032 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:20.503916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a8064-eecf-4ce9-8e5e-7c12cb370032 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:20.504489 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a8064-eecf-4ce9-8e5e-7c12cb370032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:20.506108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a8064-eecf-4ce9-8e5e-7c12cb370032 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:20.512689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-397a73e5-dc0a-496b-90fc-a7ba96f697f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:20.512689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:20.512689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:20.512689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:20.512689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:20.512689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:20.512689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:20.512689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:20.512689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:20.512689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:20.512689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:20.512689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:20.512689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:20.512689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:20.512689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:20.513844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:20.513844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:20.513844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:20.513844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:20.513844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:20.513844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:20.513844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:20.513844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:20.513844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:20.513844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:20.513844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:20.513844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:20.513844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:20.513844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:20.513844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:20.513844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:20.513844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:20.514766 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:20.514766 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:20.514766 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:20.514766 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:20.514766 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 378/752] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:20.518823 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 375/753] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:39:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:20.525211 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a73e5-dc0a-496b-90fc-a7ba96f697f5 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:20.526683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a8064-eecf-4ce9-8e5e-7c12cb370032 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:20.611713 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:20.639467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a8064-eecf-4ce9-8e5e-7c12cb370032 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:20.675484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285039c-441e-411f-b61b-5c75ca0d83a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:20.676282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285039c-441e-411f-b61b-5c75ca0d83a5 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:20.676561 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285039c-441e-411f-b61b-5c75ca0d83a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:20.676835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285039c-441e-411f-b61b-5c75ca0d83a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:20.688870 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285039c-441e-411f-b61b-5c75ca0d83a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:20.690350 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285039c-441e-411f-b61b-5c75ca0d83a5 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:20.708754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-a285039c-441e-411f-b61b-5c75ca0d83a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:20.708754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:20.708754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:20.708754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:20.708754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:20.708754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:20.708754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:20.708754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:20.708754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:20.708754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:20.708754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:20.708754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:20.708754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:20.708754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:20.708754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:20.710253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:20.710253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:20.710253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:20.710253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:20.710253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:20.710253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:20.710253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:20.710253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:20.710253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:20.710253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:20.710253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:20.710253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:20.710253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:20.710253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:20.710253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:20.710253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:20.710253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:20.711168 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:20.711168 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:20.711168 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:20.711168 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:20.711881 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 376/754] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:20.711881 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:20.718093 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285039c-441e-411f-b61b-5c75ca0d83a5 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:20.757576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a73e5-dc0a-496b-90fc-a7ba96f697f5 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:20.824343 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df876630-516a-44a0-97e7-2c9ae4f120ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:20.825016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df876630-516a-44a0-97e7-2c9ae4f120ca None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:20.825326 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df876630-516a-44a0-97e7-2c9ae4f120ca None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:20.825605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df876630-516a-44a0-97e7-2c9ae4f120ca None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:20.826404 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df876630-516a-44a0-97e7-2c9ae4f120ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:20.826711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df876630-516a-44a0-97e7-2c9ae4f120ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:20.829679 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df876630-516a-44a0-97e7-2c9ae4f120ca None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:20.862047 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 379/755] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:20.863330 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df876630-516a-44a0-97e7-2c9ae4f120ca None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:20.911725 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285039c-441e-411f-b61b-5c75ca0d83a5 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:20.980064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b3b30-3375-402a-b061-94b184ff481f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:20.980650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b3b30-3375-402a-b061-94b184ff481f None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:20.980935 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b3b30-3375-402a-b061-94b184ff481f None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:20.981228 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b3b30-3375-402a-b061-94b184ff481f None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:20.981960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b3b30-3375-402a-b061-94b184ff481f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:20.982263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b3b30-3375-402a-b061-94b184ff481f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:20.983639 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b3b30-3375-402a-b061-94b184ff481f None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:21.010642 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 377/756] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:21.016607 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b3b30-3375-402a-b061-94b184ff481f None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:21.045618 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:21.051174 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df876630-516a-44a0-97e7-2c9ae4f120ca None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:21.105525 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:21.128847 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f3631-c42c-41b9-ab53-d76e26219eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:21.129675 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f3631-c42c-41b9-ab53-d76e26219eda None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:21.129963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f3631-c42c-41b9-ab53-d76e26219eda None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:21.130242 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f3631-c42c-41b9-ab53-d76e26219eda None admin] PATH_INFO: `/v3/projects/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:21.144721 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f3631-c42c-41b9-ab53-d76e26219eda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:21.146215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f3631-c42c-41b9-ab53-d76e26219eda None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:21.175647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-389f3631-c42c-41b9-ab53-d76e26219eda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:21.175647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:21.175647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:21.175647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:21.175647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:21.175647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:21.175647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:21.175647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:21.175647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:21.175647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:21.175647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:21.175647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:21.175647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:21.175647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:21.175647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:21.176692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:21.176692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:21.176692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:21.176692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:21.176692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:21.176692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:21.176692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:21.176692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:21.176692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:21.176692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:21.176692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:21.176692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:21.176692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:21.176692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:21.176692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:21.176692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:21.176692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:21.177904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:21.177904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:21.177904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:21.177904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:21.177904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:21.177904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:21.177904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:21.177904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:21.177904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 380/757] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:21.184775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f3631-c42c-41b9-ab53-d76e26219eda None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:21.215587 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b3b30-3375-402a-b061-94b184ff481f None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:21.287478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca4273-d210-4f3a-a1bc-27d2eb8ed6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:21.289132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca4273-d210-4f3a-a1bc-27d2eb8ed6fd None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:21.289261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca4273-d210-4f3a-a1bc-27d2eb8ed6fd None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:21.289543 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca4273-d210-4f3a-a1bc-27d2eb8ed6fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:21.302501 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca4273-d210-4f3a-a1bc-27d2eb8ed6fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:21.307606 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca4273-d210-4f3a-a1bc-27d2eb8ed6fd None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:21.341456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-67ca4273-d210-4f3a-a1bc-27d2eb8ed6fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 19:39:21.341456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:21.341456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:21.341456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:21.341456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:21.341456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:21.341456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:21.341456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:21.341456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:21.341456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:21.341456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:21.341456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:21.341456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:21.341456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:21.341456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:21.341456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:21.342460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:21.342460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:21.342460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:21.342460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:21.342460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:21.342460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:21.342460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:21.342460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:21.342460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:21.342460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:21.342460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:21.342460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:21.342460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:21.342460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:21.342460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:21.342460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:21.342460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:21.342460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:21.343397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:21.343397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:21.343397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:21.343397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:21.343397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:21.343397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:21.343397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:21.343397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:21.343397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 19:39:21.343397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:21.344669 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 378/758] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 23 19:39:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:21.349511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca4273-d210-4f3a-a1bc-27d2eb8ed6fd None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:21.385348 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f3631-c42c-41b9-ab53-d76e26219eda None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:21.477876 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301f748-fb92-4664-a186-cf9b751c1e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:21.478692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301f748-fb92-4664-a186-cf9b751c1e22 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:21.478870 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301f748-fb92-4664-a186-cf9b751c1e22 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:21.479124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301f748-fb92-4664-a186-cf9b751c1e22 None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:21.479922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301f748-fb92-4664-a186-cf9b751c1e22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:21.480235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301f748-fb92-4664-a186-cf9b751c1e22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:21.481720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301f748-fb92-4664-a186-cf9b751c1e22 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:21.499960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca4273-d210-4f3a-a1bc-27d2eb8ed6fd None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:21.508240 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:21.511462 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 381/759] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:21.517525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301f748-fb92-4664-a186-cf9b751c1e22 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:21.539362 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ccb43-148e-445a-b71a-e7da7ecdc4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:21.539971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ccb43-148e-445a-b71a-e7da7ecdc4a0 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:21.540261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ccb43-148e-445a-b71a-e7da7ecdc4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:21.540546 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ccb43-148e-445a-b71a-e7da7ecdc4a0 None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:21.541513 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ccb43-148e-445a-b71a-e7da7ecdc4a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:21.541954 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ccb43-148e-445a-b71a-e7da7ecdc4a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:21.544284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ccb43-148e-445a-b71a-e7da7ecdc4a0 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:21.565214 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 379/760] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 23 19:39:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:21.572002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ccb43-148e-445a-b71a-e7da7ecdc4a0 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:21.573518 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:21.660943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301f748-fb92-4664-a186-cf9b751c1e22 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:21.705262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b222448-e945-4fa6-bfcc-5434cecd97fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:21.705928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b222448-e945-4fa6-bfcc-5434cecd97fd None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:21.706218 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b222448-e945-4fa6-bfcc-5434cecd97fd None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:21.706561 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b222448-e945-4fa6-bfcc-5434cecd97fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:21.707442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b222448-e945-4fa6-bfcc-5434cecd97fd None admin] RBAC: Adding query filter params (role.id=76bd0cf7bf094e4fa3db121b96215004, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=2cc53095a45e4136b37fb6e4e677eff9) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:21.707764 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b222448-e945-4fa6-bfcc-5434cecd97fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:21.709232 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b222448-e945-4fa6-bfcc-5434cecd97fd None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:21.724001 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 382/761] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:39:21 2022] GET /identity/v3/role_assignments?user.id=2cc53095a45e4136b37fb6e4e677eff9&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=76bd0cf7bf094e4fa3db121b96215004 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:21.783608 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ccb43-148e-445a-b71a-e7da7ecdc4a0 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:21.839747 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e9b41-7674-43df-9115-36d6ec33b7c0 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:21.839747 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e9b41-7674-43df-9115-36d6ec33b7c0 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:21.839747 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e9b41-7674-43df-9115-36d6ec33b7c0 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:21.839747 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 383/762] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:39:21.841056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44fb9e-8115-4198-b660-8fa9b26954b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:21.841904 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44fb9e-8115-4198-b660-8fa9b26954b6 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:21.842192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44fb9e-8115-4198-b660-8fa9b26954b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:21.842473 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44fb9e-8115-4198-b660-8fa9b26954b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:21.848528 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69471414-c1a7-48e3-b84a-2da340810194 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:21.849105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69471414-c1a7-48e3-b84a-2da340810194 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:21.849641 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69471414-c1a7-48e3-b84a-2da340810194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:21.870499 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44fb9e-8115-4198-b660-8fa9b26954b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:21.875037 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44fb9e-8115-4198-b660-8fa9b26954b6 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:21.878294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-69471414-c1a7-48e3-b84a-2da340810194 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:21.880454 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-69471414-c1a7-48e3-b84a-2da340810194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:21.908871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-fc44fb9e-8115-4198-b660-8fa9b26954b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:21.908871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:21.908871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:21.908871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:21.908871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:21.908871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:21.908871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:21.908871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:21.908871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:21.908871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:21.908871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:21.908871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:21.908871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:21.908871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:21.908871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:21.909913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:21.909913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:21.909913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:21.909913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:21.909913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:21.909913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:21.909913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:21.909913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:21.909913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:21.909913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:21.909913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:21.909913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:21.909913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:21.909913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:21.909913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:21.909913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:21.909913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:21.910801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:21.910801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:21.910801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:21.910801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:21.913655 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 380/763] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:21.917731 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44fb9e-8115-4198-b660-8fa9b26954b6 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:21.951371 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:22.040132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44fb9e-8115-4198-b660-8fa9b26954b6 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:22.040568 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 384/764] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 19:39:22.078197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008d824-ae79-4580-9299-686aaf507e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:22.079197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008d824-ae79-4580-9299-686aaf507e3e None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:22.079704 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008d824-ae79-4580-9299-686aaf507e3e None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:22.080123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69471414-c1a7-48e3-b84a-2da340810194 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:22.080366 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008d824-ae79-4580-9299-686aaf507e3e None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:22.081312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008d824-ae79-4580-9299-686aaf507e3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:22.081808 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008d824-ae79-4580-9299-686aaf507e3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:22.083407 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008d824-ae79-4580-9299-686aaf507e3e None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:22.096790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 381/765] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:22.102381 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008d824-ae79-4580-9299-686aaf507e3e None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:22.107210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:22.200706 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:22.240826 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69471414-c1a7-48e3-b84a-2da340810194 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:22.245585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008d824-ae79-4580-9299-686aaf507e3e None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:22.278276 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb5a28-1134-49d7-868f-d1d88ba46339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:22.279182 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb5a28-1134-49d7-868f-d1d88ba46339 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:22.279557 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb5a28-1134-49d7-868f-d1d88ba46339 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:22.279902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb5a28-1134-49d7-868f-d1d88ba46339 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:22.280640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb5a28-1134-49d7-868f-d1d88ba46339 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:22.282121 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb5a28-1134-49d7-868f-d1d88ba46339 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:22.295134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-41cb5a28-1134-49d7-868f-d1d88ba46339 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 19:39:22.295134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:22.295134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:22.295134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:22.295134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:22.295134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:22.295134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:22.295134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:22.295134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 19:39:22.295134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:22.295134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:22.295134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:22.295134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:22.295134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:22.295134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:22.295134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:22.296116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:22.296116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:22.296116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:22.296116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:22.296116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:22.296116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:22.296116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:22.296116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:22.296116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:22.296116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:22.296116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:22.296116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:22.296116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:22.296116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:22.296116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:22.296116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:22.296944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:22.296944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:22.296944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:22.296944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:22.296944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:22.296944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:22.296944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:22.296944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:22.296944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:22.296944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:22.296944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:22.296944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:22.296944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:22.296944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 19:39:22.296944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:22.296944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 385/766] 10.222.0.13 () {56 vars in 1129 bytes} [Thu Jun 23 19:39:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:22.302345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb5a28-1134-49d7-868f-d1d88ba46339 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:22.306643 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bcea9-dba3-49a7-8d01-758f3dd3aa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:22.307727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bcea9-dba3-49a7-8d01-758f3dd3aa23 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:22.308248 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bcea9-dba3-49a7-8d01-758f3dd3aa23 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:22.308736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bcea9-dba3-49a7-8d01-758f3dd3aa23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:22.328665 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59bcea9-dba3-49a7-8d01-758f3dd3aa23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:22.330513 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59bcea9-dba3-49a7-8d01-758f3dd3aa23 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:22.351844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-d59bcea9-dba3-49a7-8d01-758f3dd3aa23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:22.351844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:22.351844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:22.351844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:22.351844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:22.351844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:22.351844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:22.351844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:22.351844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:22.351844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:22.351844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:22.351844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:22.351844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:22.351844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:22.351844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:22.352776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:22.352776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:22.352776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:22.352776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:22.352776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:22.352776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:22.352776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:22.352776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:22.352776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:22.352776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:22.352776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:22.352776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:22.352776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:22.352776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:22.352776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:22.352776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:22.352776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:22.353715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:22.353715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:22.353715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:22.353715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:22.353715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:22.353715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:22.353715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:22.353715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:22.364650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 382/767] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:22.374166 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bcea9-dba3-49a7-8d01-758f3dd3aa23 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:22.426157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:22.469934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb5a28-1134-49d7-868f-d1d88ba46339 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:22.514631 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bcea9-dba3-49a7-8d01-758f3dd3aa23 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:22.552839 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cff47-e7e8-47bc-9360-984776e835e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:22.553744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cff47-e7e8-47bc-9360-984776e835e1 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:22.554143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cff47-e7e8-47bc-9360-984776e835e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:22.554433 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cff47-e7e8-47bc-9360-984776e835e1 None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:22.555236 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cff47-e7e8-47bc-9360-984776e835e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:22.555551 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cff47-e7e8-47bc-9360-984776e835e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:22.557129 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cff47-e7e8-47bc-9360-984776e835e1 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:22.559880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:22.562283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c07d54-7abf-47a7-a270-6c317b2a0fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:22.562961 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c07d54-7abf-47a7-a270-6c317b2a0fe5 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:22.563245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c07d54-7abf-47a7-a270-6c317b2a0fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:22.563519 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c07d54-7abf-47a7-a270-6c317b2a0fe5 None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:22.564293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c07d54-7abf-47a7-a270-6c317b2a0fe5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:22.564600 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c07d54-7abf-47a7-a270-6c317b2a0fe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:22.565998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c07d54-7abf-47a7-a270-6c317b2a0fe5 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:22.571656 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 383/768] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:22.574027 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 386/769] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Jun 23 19:39:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:22.578629 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cff47-e7e8-47bc-9360-984776e835e1 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:22.583482 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c07d54-7abf-47a7-a270-6c317b2a0fe5 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:22.700658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cff47-e7e8-47bc-9360-984776e835e1 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:22.745410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d285c0-d5f3-4972-9956-d227fac1d134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:22.746083 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d285c0-d5f3-4972-9956-d227fac1d134 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:22.746481 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d285c0-d5f3-4972-9956-d227fac1d134 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:22.746768 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d285c0-d5f3-4972-9956-d227fac1d134 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:22.747597 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d285c0-d5f3-4972-9956-d227fac1d134 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:22.747904 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d285c0-d5f3-4972-9956-d227fac1d134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:22.749314 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d285c0-d5f3-4972-9956-d227fac1d134 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:22.750145 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c07d54-7abf-47a7-a270-6c317b2a0fe5 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:22.759708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 384/770] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Jun 23 19:39:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:22.759708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c79540-f6e3-4714-9d7c-f037f4435a9c None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:22.759708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c79540-f6e3-4714-9d7c-f037f4435a9c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:22.759708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c79540-f6e3-4714-9d7c-f037f4435a9c None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:22.759708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 385/771] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:22.759708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15f417-a7f0-4508-9654-1c13135c6b06 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:22.760181 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15f417-a7f0-4508-9654-1c13135c6b06 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:22.760181 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15f417-a7f0-4508-9654-1c13135c6b06 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:22.764744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 386/772] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:22.766151 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15f417-a7f0-4508-9654-1c13135c6b06 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:22.793733 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aab439-a9e9-4ed4-a9f6-d374dd082c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:22.795120 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aab439-a9e9-4ed4-a9f6-d374dd082c92 None admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:22.795478 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aab439-a9e9-4ed4-a9f6-d374dd082c92 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:22.795931 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aab439-a9e9-4ed4-a9f6-d374dd082c92 None admin] PATH_INFO: `/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/83bff5cd7782423eaa0bc5b29b208ae7/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:22.797917 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aab439-a9e9-4ed4-a9f6-d374dd082c92 None admin] RBAC: Authorizing `identity:create_grant(project_id=368f41dc1ae64e199b604ee72545c88e, user_id=83bff5cd7782423eaa0bc5b29b208ae7, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:22.799335 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aab439-a9e9-4ed4-a9f6-d374dd082c92 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:22.827888 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:22.869261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15f417-a7f0-4508-9654-1c13135c6b06 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:22.891990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:22.897924 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 387/773] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:39:22 2022] PUT /identity/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/83bff5cd7782423eaa0bc5b29b208ae7/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:39:22.900629 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4b7f6-7842-47da-a9c4-599adcddaf78 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:22.900928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4b7f6-7842-47da-a9c4-599adcddaf78 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:22.901367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4b7f6-7842-47da-a9c4-599adcddaf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:22.923628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b35725-ff30-4466-af31-c17059fda082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:22.925236 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b35725-ff30-4466-af31-c17059fda082 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:22.925922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b35725-ff30-4466-af31-c17059fda082 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:22.926596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b35725-ff30-4466-af31-c17059fda082 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:22.929450 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b35725-ff30-4466-af31-c17059fda082 None admin] RBAC: Adding query filter params (interface=public, service_id=3a51ccf9d1964ad3a29bd9447ddc6b62, region_id=RegionOne) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:22.929636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-26a4b7f6-7842-47da-a9c4-599adcddaf78 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:22.931009 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b35725-ff30-4466-af31-c17059fda082 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:22.931760 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-26a4b7f6-7842-47da-a9c4-599adcddaf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:22.934157 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b35725-ff30-4466-af31-c17059fda082 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:22.951472 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 387/774] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 23 19:39:22 2022] GET /identity/v3/endpoints?service_id=3a51ccf9d1964ad3a29bd9447ddc6b62&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:22.955222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece09d1c-551b-4e1e-9f68-39bbd32ccce4 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:22.956221 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece09d1c-551b-4e1e-9f68-39bbd32ccce4 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:22.957548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece09d1c-551b-4e1e-9f68-39bbd32ccce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:22.989706 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-ece09d1c-551b-4e1e-9f68-39bbd32ccce4 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:22.992757 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ece09d1c-551b-4e1e-9f68-39bbd32ccce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:23.043960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 388/775] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:23.045226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4b7f6-7842-47da-a9c4-599adcddaf78 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:23.091215 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 388/776] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:23.091676 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece09d1c-551b-4e1e-9f68-39bbd32ccce4 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:23.164752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:23.170981 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4b7f6-7842-47da-a9c4-599adcddaf78 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:23.213232 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:23.214904 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece09d1c-551b-4e1e-9f68-39bbd32ccce4 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:23.220631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f15064-7be9-458d-9c73-dd50a4e038da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:23.221343 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f15064-7be9-458d-9c73-dd50a4e038da None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:23.221632 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f15064-7be9-458d-9c73-dd50a4e038da None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:23.222825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f15064-7be9-458d-9c73-dd50a4e038da None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:23.222825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f15064-7be9-458d-9c73-dd50a4e038da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:23.224697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f15064-7be9-458d-9c73-dd50a4e038da None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:23.237089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 389/777] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 23 19:39:23 2022] GET /identity/v3/services => generated 772 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:23.237089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f15064-7be9-458d-9c73-dd50a4e038da None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:23.306637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92412c6e-7c3a-42d3-9fc2-c01aea41a284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:23.307875 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92412c6e-7c3a-42d3-9fc2-c01aea41a284 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:23.308372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92412c6e-7c3a-42d3-9fc2-c01aea41a284 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:23.308848 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92412c6e-7c3a-42d3-9fc2-c01aea41a284 None admin] PATH_INFO: `/v3/services/network` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:23.309748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92412c6e-7c3a-42d3-9fc2-c01aea41a284 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:23.311231 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92412c6e-7c3a-42d3-9fc2-c01aea41a284 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:23.335284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-92412c6e-7c3a-42d3-9fc2-c01aea41a284 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 19:39:23.335284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:23.335284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:23.335284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:23.335284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:23.335284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:23.335284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:23.335284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:23.335284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 19:39:23.335284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:23.335284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:23.335284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:23.335284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:23.335284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:23.335284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:23.335284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:23.335284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:23.336430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:23.336430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:23.336430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:23.336430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:23.336430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:23.336430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:23.336430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:23.336430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:23.336430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:23.336430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:23.336430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:23.336430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:23.336430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:23.336430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:23.336430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:23.336430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:23.337329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:23.337329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:23.337329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:23.337329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:23.337329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:23.337329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:23.337329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:23.337329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:23.337329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:23.337329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:23.337329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:23.337329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:23.337329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 19:39:23.337329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:23.343061 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 389/778] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:23 2022] GET /identity/v3/services/network => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:23.349013 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92412c6e-7c3a-42d3-9fc2-c01aea41a284 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:23.369267 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f15064-7be9-458d-9c73-dd50a4e038da None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:23.436284 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5f5eb-13d9-4d13-9ca6-91b1dd14ea08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:23.439461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5f5eb-13d9-4d13-9ca6-91b1dd14ea08 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:23.441590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5f5eb-13d9-4d13-9ca6-91b1dd14ea08 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:23.442043 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5f5eb-13d9-4d13-9ca6-91b1dd14ea08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:23.458506 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5f5eb-13d9-4d13-9ca6-91b1dd14ea08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:23.469574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-d0f5f5eb-13d9-4d13-9ca6-91b1dd14ea08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:23.469574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:23.469574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:23.469574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:23.469574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:23.469574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:23.469574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:23.469574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:23.469574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:23.469574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:23.469574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:23.469574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:23.469574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:23.469574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:23.469574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:23.469574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:23.470775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:23.470775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:23.470775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:23.470775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:23.470775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:23.470775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:23.470775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:23.470775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:23.470775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:23.470775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:23.470775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:23.470775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:23.470775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:23.470775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:23.470775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:23.470775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:23.471630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:23.471630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:23.471630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:23.471630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:23.471630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:23.471630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:23.471630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:23.471630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:23.471630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:23.471630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:23.471630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:23.471630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:23.481499 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 390/779] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:39:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:23.483536 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5f5eb-13d9-4d13-9ca6-91b1dd14ea08 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:23.563039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:23.578702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92412c6e-7c3a-42d3-9fc2-c01aea41a284 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:23.611900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:23.639483 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701857df-82ae-4d4a-9af2-c1d80c3194e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:23.645266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701857df-82ae-4d4a-9af2-c1d80c3194e9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:23.645266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701857df-82ae-4d4a-9af2-c1d80c3194e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:23.645266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701857df-82ae-4d4a-9af2-c1d80c3194e9 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:23.645266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701857df-82ae-4d4a-9af2-c1d80c3194e9 None admin] RBAC: Adding query filter params (name=network) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:23.645266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701857df-82ae-4d4a-9af2-c1d80c3194e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:23.645266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701857df-82ae-4d4a-9af2-c1d80c3194e9 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:23.650320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 390/780] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 19:39:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:23.655913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701857df-82ae-4d4a-9af2-c1d80c3194e9 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:23.656703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5f5eb-13d9-4d13-9ca6-91b1dd14ea08 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:23.765984 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28578a97-3df9-49db-8a51-166cb3bdcf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:23.766584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28578a97-3df9-49db-8a51-166cb3bdcf84 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:23.766875 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28578a97-3df9-49db-8a51-166cb3bdcf84 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:23.767152 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28578a97-3df9-49db-8a51-166cb3bdcf84 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:23.767921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28578a97-3df9-49db-8a51-166cb3bdcf84 None admin] RBAC: Adding query filter params (name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:23.768234 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28578a97-3df9-49db-8a51-166cb3bdcf84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:23.769667 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28578a97-3df9-49db-8a51-166cb3bdcf84 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:23.795470 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 391/781] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:39:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:23.795771 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701857df-82ae-4d4a-9af2-c1d80c3194e9 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:23.801325 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28578a97-3df9-49db-8a51-166cb3bdcf84 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:23.834305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6220d46-8c1c-477b-9d68-9f31509bd516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:23.835093 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6220d46-8c1c-477b-9d68-9f31509bd516 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:23.835958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6220d46-8c1c-477b-9d68-9f31509bd516 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:23.836304 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6220d46-8c1c-477b-9d68-9f31509bd516 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:23.837023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6220d46-8c1c-477b-9d68-9f31509bd516 None admin] RBAC: Adding query filter params (type=network) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:23.837361 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6220d46-8c1c-477b-9d68-9f31509bd516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:23.839315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6220d46-8c1c-477b-9d68-9f31509bd516 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:23.849231 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 391/782] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 19:39:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:23.852722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6220d46-8c1c-477b-9d68-9f31509bd516 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:23.955132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:24.001885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28578a97-3df9-49db-8a51-166cb3bdcf84 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:24.033742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:24.042239 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec340e2-4c5c-47be-b7e8-549ed77e6465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:24.043110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec340e2-4c5c-47be-b7e8-549ed77e6465 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:24.043392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec340e2-4c5c-47be-b7e8-549ed77e6465 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:24.043667 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec340e2-4c5c-47be-b7e8-549ed77e6465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:24.068062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec340e2-4c5c-47be-b7e8-549ed77e6465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:24.070538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec340e2-4c5c-47be-b7e8-549ed77e6465 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:24.079424 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6220d46-8c1c-477b-9d68-9f31509bd516 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:24.110703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-5ec340e2-4c5c-47be-b7e8-549ed77e6465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:24.110703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:24.110703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:24.110703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:24.110703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:24.110703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:24.110703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:24.110703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:24.110703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:24.110703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:24.110703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:24.110703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:24.110703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:24.110703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:24.110703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:24.111670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:24.111670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:24.111670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:24.111670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:24.111670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:24.111670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:24.111670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:24.111670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:24.111670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:24.111670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:24.111670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:24.111670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:24.111670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:24.111670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:24.111670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:24.111670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:24.111670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:24.112565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:24.112565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:24.112565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:24.112565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:24.117128 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 392/783] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:24.118654 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e8e6-1c93-4b55-9641-7bf5bd2ec050 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:24.118946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e8e6-1c93-4b55-9641-7bf5bd2ec050 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:24.119224 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e8e6-1c93-4b55-9641-7bf5bd2ec050 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:24.121578 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 393/784] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:24.124543 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7e8e6-1c93-4b55-9641-7bf5bd2ec050 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:24.139241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f185b-4294-425e-b8fa-e3db63015d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:24.140244 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f185b-4294-425e-b8fa-e3db63015d2c None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:24.140713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f185b-4294-425e-b8fa-e3db63015d2c None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:24.141196 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f185b-4294-425e-b8fa-e3db63015d2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:24.142313 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f185b-4294-425e-b8fa-e3db63015d2c None admin] RBAC: Adding query filter params (interface=public, service_id=e172b249354d461084189cacdc82e613, region_id=RegionOne) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:24.142967 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f185b-4294-425e-b8fa-e3db63015d2c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:24.144509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f185b-4294-425e-b8fa-e3db63015d2c None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:24.151620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 392/785] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 23 19:39:23 2022] GET /identity/v3/endpoints?service_id=e172b249354d461084189cacdc82e613&interface=public®ion_id=RegionOne => generated 194 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:24.153260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255f183-4424-49dd-bd7b-8023afcc574d None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:24.153733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255f183-4424-49dd-bd7b-8023afcc574d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:24.154217 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255f183-4424-49dd-bd7b-8023afcc574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:24.174220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-7255f183-4424-49dd-bd7b-8023afcc574d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:24.175627 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-7255f183-4424-49dd-bd7b-8023afcc574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:24.254312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 393/786] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:24.255727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255f183-4424-49dd-bd7b-8023afcc574d None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:24.282479 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7e8e6-1c93-4b55-9641-7bf5bd2ec050 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:24.314438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:24.322054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957746f-bc65-4e06-a9f8-63bf10696922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:24.322989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957746f-bc65-4e06-a9f8-63bf10696922 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:24.323440 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957746f-bc65-4e06-a9f8-63bf10696922 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:24.327266 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957746f-bc65-4e06-a9f8-63bf10696922 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:24.327266 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957746f-bc65-4e06-a9f8-63bf10696922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:24.327266 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957746f-bc65-4e06-a9f8-63bf10696922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:24.327266 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957746f-bc65-4e06-a9f8-63bf10696922 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:24.340359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 394/787] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:24.341490 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957746f-bc65-4e06-a9f8-63bf10696922 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:24.370680 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:24.381232 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255f183-4424-49dd-bd7b-8023afcc574d None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:24.421495 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76557fc-652e-4862-afe7-572fc3129563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:24.422391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76557fc-652e-4862-afe7-572fc3129563 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:24.422938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76557fc-652e-4862-afe7-572fc3129563 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:24.423358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76557fc-652e-4862-afe7-572fc3129563 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:24.424211 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76557fc-652e-4862-afe7-572fc3129563 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:24.425900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76557fc-652e-4862-afe7-572fc3129563 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:24.432276 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 394/788] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 23 19:39:24 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:24.433459 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76557fc-652e-4862-afe7-572fc3129563 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:24.448952 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957746f-bc65-4e06-a9f8-63bf10696922 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:24.498400 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4506b-17f9-4a21-8805-4287075c9d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:24.499719 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4506b-17f9-4a21-8805-4287075c9d3f None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:24.500165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4506b-17f9-4a21-8805-4287075c9d3f None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:24.500540 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4506b-17f9-4a21-8805-4287075c9d3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:24.516095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4506b-17f9-4a21-8805-4287075c9d3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:24.525735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-b9f4506b-17f9-4a21-8805-4287075c9d3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:39:24.525735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:24.525735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:24.525735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:24.525735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:24.525735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:24.525735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:24.525735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:24.525735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:24.525735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:24.525735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:24.525735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:24.525735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:24.525735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:24.525735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:24.525735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:24.526938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:24.526938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:24.526938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:24.526938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:24.526938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:24.526938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:24.526938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:24.526938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:24.526938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:24.526938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:24.526938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:24.526938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:24.526938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:24.526938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:24.526938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:24.526938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:24.527825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:24.527825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:24.527825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:24.527825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:24.527825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:24.527825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:24.527825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:24.527825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:24.527825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:24.527825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:24.527825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:39:24.527825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:24.530052 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 395/789] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:39:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:24.542332 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4506b-17f9-4a21-8805-4287075c9d3f None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:24.668064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76557fc-652e-4862-afe7-572fc3129563 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:24.672224 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:24.700195 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:24.713714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44046455-f74e-4a09-bcce-c3763256674d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:24.714839 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44046455-f74e-4a09-bcce-c3763256674d None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:24.715304 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44046455-f74e-4a09-bcce-c3763256674d None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:24.715730 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44046455-f74e-4a09-bcce-c3763256674d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:24.719539 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4506b-17f9-4a21-8805-4287075c9d3f None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:24.723795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44046455-f74e-4a09-bcce-c3763256674d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:24.725564 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44046455-f74e-4a09-bcce-c3763256674d None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:24.741853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-44046455-f74e-4a09-bcce-c3763256674d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 19:39:24.741853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:24.741853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:24.741853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:24.741853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:24.741853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:24.741853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:24.741853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:24.741853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:24.741853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:24.741853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:24.741853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:24.741853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:24.741853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:24.741853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:24.741853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:24.743098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:24.743098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:24.743098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:24.743098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:24.743098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:24.743098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:24.743098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:24.743098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:24.743098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:24.743098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:24.743098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:24.743098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:24.743098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:24.743098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:24.743098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:24.743098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:24.743098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:24.743098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:24.744282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:24.744282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:24.744282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:24.744282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:24.744282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:24.744282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:24.744282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:24.744282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:24.744282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 19:39:24.744282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:24.746617 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 395/790] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 23 19:39:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:24.754286 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44046455-f74e-4a09-bcce-c3763256674d None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:24.763437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8d828-6500-4e2b-b86d-63e40fab41ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:24.764240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8d828-6500-4e2b-b86d-63e40fab41ef None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:24.764674 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8d828-6500-4e2b-b86d-63e40fab41ef None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:24.765526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8d828-6500-4e2b-b86d-63e40fab41ef None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:24.766084 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8d828-6500-4e2b-b86d-63e40fab41ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:24.766484 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8d828-6500-4e2b-b86d-63e40fab41ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:24.768052 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8d828-6500-4e2b-b86d-63e40fab41ef None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:24.778767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 396/791] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:39:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:24.784793 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8d828-6500-4e2b-b86d-63e40fab41ef None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:24.863167 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44046455-f74e-4a09-bcce-c3763256674d None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:24.903362 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bc3c1-8c46-44f8-a59f-dcd31da10339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:24.904110 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bc3c1-8c46-44f8-a59f-dcd31da10339 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:24.904459 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bc3c1-8c46-44f8-a59f-dcd31da10339 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:24.904805 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bc3c1-8c46-44f8-a59f-dcd31da10339 None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:24.913615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bc3c1-8c46-44f8-a59f-dcd31da10339 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:24.913615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bc3c1-8c46-44f8-a59f-dcd31da10339 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:24.913615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bc3c1-8c46-44f8-a59f-dcd31da10339 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:24.937922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 396/792] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Jun 23 19:39:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:24.942404 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8d828-6500-4e2b-b86d-63e40fab41ef None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:24.943416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bc3c1-8c46-44f8-a59f-dcd31da10339 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:24.997837 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954585a-e8f9-4f93-a4b3-1fbf583a7a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:24.998470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:25.000185 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954585a-e8f9-4f93-a4b3-1fbf583a7a36 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:25.000722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954585a-e8f9-4f93-a4b3-1fbf583a7a36 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:25.001524 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954585a-e8f9-4f93-a4b3-1fbf583a7a36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:25.014832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954585a-e8f9-4f93-a4b3-1fbf583a7a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:25.016705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954585a-e8f9-4f93-a4b3-1fbf583a7a36 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:25.036565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-8954585a-e8f9-4f93-a4b3-1fbf583a7a36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:25.036565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:25.036565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:25.036565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:25.036565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:25.036565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:25.036565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:25.036565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:25.036565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:25.036565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:25.036565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:25.036565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:25.036565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:25.036565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:25.036565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:25.037555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:25.037555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:25.037555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:25.037555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:25.037555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:25.037555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:25.037555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:25.037555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:25.037555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:25.037555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:25.037555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:25.037555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:25.037555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:25.037555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:25.037555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:25.037555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:25.037555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:25.039168 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:25.039168 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:25.039168 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:25.039168 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:25.041691 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 397/793] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:25.047308 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954585a-e8f9-4f93-a4b3-1fbf583a7a36 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:25.054650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:25.150351 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bc3c1-8c46-44f8-a59f-dcd31da10339 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:25.207449 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954585a-e8f9-4f93-a4b3-1fbf583a7a36 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:25.244068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b398e89-bbb8-447f-b81f-12f37256a5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:25.244449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782c6bd-55b2-4b1d-8042-70374d8dcacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:25.244743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b398e89-bbb8-447f-b81f-12f37256a5ab None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:25.245032 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b398e89-bbb8-447f-b81f-12f37256a5ab None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:25.245230 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782c6bd-55b2-4b1d-8042-70374d8dcacd None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:25.245344 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b398e89-bbb8-447f-b81f-12f37256a5ab None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:25.245516 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782c6bd-55b2-4b1d-8042-70374d8dcacd None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:25.245758 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782c6bd-55b2-4b1d-8042-70374d8dcacd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:25.246072 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b398e89-bbb8-447f-b81f-12f37256a5ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:25.246385 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b398e89-bbb8-447f-b81f-12f37256a5ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:25.247777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b398e89-bbb8-447f-b81f-12f37256a5ab None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:25.261878 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 398/794] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:25.267308 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b398e89-bbb8-447f-b81f-12f37256a5ab None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:25.271308 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782c6bd-55b2-4b1d-8042-70374d8dcacd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:25.273056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782c6bd-55b2-4b1d-8042-70374d8dcacd None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:25.301679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-c782c6bd-55b2-4b1d-8042-70374d8dcacd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:25.301679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:25.301679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:25.301679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:25.301679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:25.301679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:25.301679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:25.301679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:25.301679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:25.301679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:25.301679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:25.301679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:25.301679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:25.301679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:25.301679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:25.302637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:25.302637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:25.302637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:25.302637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:25.302637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:25.302637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:25.302637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:25.302637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:25.302637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:25.302637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:25.302637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:25.302637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:25.302637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:25.302637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:25.302637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:25.302637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:25.302637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:25.304099 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:25.304099 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:25.304099 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:25.304099 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:25.308187 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 397/795] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:25.309566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b68c5-1720-423d-8052-f62791384cb4 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:25.309857 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b68c5-1720-423d-8052-f62791384cb4 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:25.310132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b68c5-1720-423d-8052-f62791384cb4 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:25.313263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 398/796] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:25.313993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b68c5-1720-423d-8052-f62791384cb4 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:25.333997 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:25.375971 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b398e89-bbb8-447f-b81f-12f37256a5ab None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:25.401654 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:25.414094 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb39e5-2d85-450c-8e20-9ded37e5185b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:25.415440 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb39e5-2d85-450c-8e20-9ded37e5185b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:25.415741 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb39e5-2d85-450c-8e20-9ded37e5185b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:25.416291 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb39e5-2d85-450c-8e20-9ded37e5185b None admin] PATH_INFO: `/v3/users/swift` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:25.421686 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b68c5-1720-423d-8052-f62791384cb4 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:25.425775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb39e5-2d85-450c-8e20-9ded37e5185b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:25.427328 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb39e5-2d85-450c-8e20-9ded37e5185b None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:25.445507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-5efb39e5-2d85-450c-8e20-9ded37e5185b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 19:39:25.445507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:25.445507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:25.445507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:25.445507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:25.445507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:25.445507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:25.445507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:25.445507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:25.445507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:25.445507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:25.445507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:25.445507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:25.445507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:25.445507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:25.445507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:25.447702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:25.447702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:25.447702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:25.447702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:25.447702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:25.447702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:25.447702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:25.447702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:25.447702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:25.447702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:25.447702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:25.447702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:25.447702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:25.447702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:25.447702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:25.447702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:25.447702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:25.447702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:25.450006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:25.450006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:25.450006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:25.450006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:25.450006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:25.450006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:25.450006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:25.450006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:25.450006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 19:39:25.450006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:25.450006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 399/797] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:39:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:25.450006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8c45d-dcac-4c1f-a15f-72597cd21b1e None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:25.450006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8c45d-dcac-4c1f-a15f-72597cd21b1e None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:25.451676 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8c45d-dcac-4c1f-a15f-72597cd21b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:25.466808 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-d8e8c45d-dcac-4c1f-a15f-72597cd21b1e None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:25.467928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d8e8c45d-dcac-4c1f-a15f-72597cd21b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:25.468894 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db1c52-7d08-4e75-ab38-9af42dd85389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:25.469639 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db1c52-7d08-4e75-ab38-9af42dd85389 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:25.470218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db1c52-7d08-4e75-ab38-9af42dd85389 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:25.470503 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db1c52-7d08-4e75-ab38-9af42dd85389 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:25.472129 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db1c52-7d08-4e75-ab38-9af42dd85389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:25.472446 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db1c52-7d08-4e75-ab38-9af42dd85389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:25.473976 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db1c52-7d08-4e75-ab38-9af42dd85389 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:25.489847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 399/798] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:25.490772 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db1c52-7d08-4e75-ab38-9af42dd85389 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:25.549285 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 400/799] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:25.550171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8c45d-dcac-4c1f-a15f-72597cd21b1e None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:25.610389 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db1c52-7d08-4e75-ab38-9af42dd85389 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:25.623458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:25.644758 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6ec29-249d-4512-82ea-18b6f31fc1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:25.645463 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6ec29-249d-4512-82ea-18b6f31fc1cb None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:25.645745 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6ec29-249d-4512-82ea-18b6f31fc1cb None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:25.646032 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6ec29-249d-4512-82ea-18b6f31fc1cb None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:25.646907 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6ec29-249d-4512-82ea-18b6f31fc1cb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:25.647260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6ec29-249d-4512-82ea-18b6f31fc1cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:25.648702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6ec29-249d-4512-82ea-18b6f31fc1cb None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:25.650393 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:25.672392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 400/800] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Jun 23 19:39:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:25.672392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6ec29-249d-4512-82ea-18b6f31fc1cb None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:25.679154 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8c45d-dcac-4c1f-a15f-72597cd21b1e None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:25.717435 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f73e7f-3b36-436a-92ca-a5b952c430de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:25.718163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f73e7f-3b36-436a-92ca-a5b952c430de None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:25.718706 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f73e7f-3b36-436a-92ca-a5b952c430de None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:25.718706 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f73e7f-3b36-436a-92ca-a5b952c430de None admin] PATH_INFO: `/v3/projects/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:25.725646 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f73e7f-3b36-436a-92ca-a5b952c430de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:25.727124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f73e7f-3b36-436a-92ca-a5b952c430de None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:25.741783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-13f73e7f-3b36-436a-92ca-a5b952c430de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:25.741783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:25.741783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:25.741783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:25.741783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:25.741783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:25.741783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:25.741783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:25.741783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:25.741783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:25.741783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:25.741783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:25.741783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:25.741783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:25.741783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:25.742720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:25.742720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:25.742720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:25.742720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:25.742720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:25.742720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:25.742720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:25.742720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:25.742720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:25.742720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:25.742720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:25.742720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:25.742720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:25.742720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:25.742720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:25.742720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:25.742720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:25.748714 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:25.748714 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:25.748714 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:25.748714 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:25.748714 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:25.748714 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:25.748714 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:25.748714 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:25.748714 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 401/801] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:25.748714 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9cf09-667b-4a36-8403-6cca4f2f1a43 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:25.748714 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9cf09-667b-4a36-8403-6cca4f2f1a43 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:25.750325 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9cf09-667b-4a36-8403-6cca4f2f1a43 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:25.750325 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 402/802] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:25.750325 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9cf09-667b-4a36-8403-6cca4f2f1a43 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:25.785608 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6ec29-249d-4512-82ea-18b6f31fc1cb None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:25.825245 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ec1a0-0c42-41e6-baaf-52523a810794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:25.826058 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ec1a0-0c42-41e6-baaf-52523a810794 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:25.826500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ec1a0-0c42-41e6-baaf-52523a810794 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:25.826729 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ec1a0-0c42-41e6-baaf-52523a810794 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:25.838561 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ec1a0-0c42-41e6-baaf-52523a810794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:25.846851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-556ec1a0-0c42-41e6-baaf-52523a810794 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:39:25.846851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:25.846851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:25.846851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:25.846851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:25.846851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:25.846851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:25.846851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:25.846851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:25.846851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:25.846851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:25.846851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:25.846851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:25.846851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:25.846851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:25.846851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:25.848001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:25.848001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:25.848001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:25.848001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:25.848001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:25.848001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:25.848001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:25.848001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:25.848001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:25.848001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:25.848001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:25.848001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:25.848001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:25.848001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:25.848001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:25.848001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:25.854014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:25.854014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:25.854014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:25.854014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:25.854014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:25.854014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:25.854014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:25.854014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:25.854014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:25.854014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:25.854014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:39:25.854014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:25.854014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 401/803] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:39:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:25.854014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ec1a0-0c42-41e6-baaf-52523a810794 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:25.875185 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9cf09-667b-4a36-8403-6cca4f2f1a43 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:25.892766 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:25.916476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423fa4e-2a1f-4848-93be-1cbc916beda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:25.917385 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423fa4e-2a1f-4848-93be-1cbc916beda8 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:25.917674 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423fa4e-2a1f-4848-93be-1cbc916beda8 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:25.917949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423fa4e-2a1f-4848-93be-1cbc916beda8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:25.919104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:25.929380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423fa4e-2a1f-4848-93be-1cbc916beda8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:25.931003 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423fa4e-2a1f-4848-93be-1cbc916beda8 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:25.949831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-a423fa4e-2a1f-4848-93be-1cbc916beda8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:25.949831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:25.949831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:25.949831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:25.949831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:25.949831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:25.949831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:25.949831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:25.949831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:25.949831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:25.949831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:25.949831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:25.949831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:25.949831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:25.949831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:25.956241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:25.956241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:25.956241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:25.956241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:25.956241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:25.956241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:25.956241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:25.956241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:25.956241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:25.956241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:25.956241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:25.956241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:25.956241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:25.956241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:25.956241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:25.956241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:25.956241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:25.957395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:25.957395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:25.957395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:25.957395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:25.957395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 403/804] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:25.957395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add45a9e-6db0-4605-9b0a-e1700b1549a1 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:25.957395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add45a9e-6db0-4605-9b0a-e1700b1549a1 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:25.957395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add45a9e-6db0-4605-9b0a-e1700b1549a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:25.972953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-add45a9e-6db0-4605-9b0a-e1700b1549a1 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:25.973307 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ec1a0-0c42-41e6-baaf-52523a810794 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:25.974232 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-add45a9e-6db0-4605-9b0a-e1700b1549a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:26.008361 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cdbe3-ef88-42bd-8bca-2f2e4290c5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:26.009034 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cdbe3-ef88-42bd-8bca-2f2e4290c5ea None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:26.009354 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cdbe3-ef88-42bd-8bca-2f2e4290c5ea None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:26.009641 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cdbe3-ef88-42bd-8bca-2f2e4290c5ea None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:26.010451 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cdbe3-ef88-42bd-8bca-2f2e4290c5ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:26.010768 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cdbe3-ef88-42bd-8bca-2f2e4290c5ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:26.012194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cdbe3-ef88-42bd-8bca-2f2e4290c5ea None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:26.029248 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 402/805] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:26.029248 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cdbe3-ef88-42bd-8bca-2f2e4290c5ea None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:26.057177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 404/806] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:26.057177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add45a9e-6db0-4605-9b0a-e1700b1549a1 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:26.134044 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cdbe3-ef88-42bd-8bca-2f2e4290c5ea None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:26.148644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:26.153031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:26.160020 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add45a9e-6db0-4605-9b0a-e1700b1549a1 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:26.173103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e5f1b-c46a-4bc6-bdca-b56d21a0e245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:26.173931 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e5f1b-c46a-4bc6-bdca-b56d21a0e245 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:26.174226 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e5f1b-c46a-4bc6-bdca-b56d21a0e245 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:26.174512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e5f1b-c46a-4bc6-bdca-b56d21a0e245 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:26.177815 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e5f1b-c46a-4bc6-bdca-b56d21a0e245 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:26.178156 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e5f1b-c46a-4bc6-bdca-b56d21a0e245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:26.179595 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e5f1b-c46a-4bc6-bdca-b56d21a0e245 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:26.196580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 403/807] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:39:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:26.196580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e5f1b-c46a-4bc6-bdca-b56d21a0e245 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:26.199966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e260e4-6500-4476-a64f-fa959de8acb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:26.200642 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e260e4-6500-4476-a64f-fa959de8acb2 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:26.200934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e260e4-6500-4476-a64f-fa959de8acb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:26.201241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e260e4-6500-4476-a64f-fa959de8acb2 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:26.201980 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e260e4-6500-4476-a64f-fa959de8acb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:26.202292 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e260e4-6500-4476-a64f-fa959de8acb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:26.203665 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e260e4-6500-4476-a64f-fa959de8acb2 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:26.221745 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 405/808] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:26.223159 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e260e4-6500-4476-a64f-fa959de8acb2 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:26.333305 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e260e4-6500-4476-a64f-fa959de8acb2 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:26.368736 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b0f0f-1ab4-49e0-8326-40b50eac556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:26.369577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b0f0f-1ab4-49e0-8326-40b50eac556f None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:26.369865 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b0f0f-1ab4-49e0-8326-40b50eac556f None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:26.370145 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b0f0f-1ab4-49e0-8326-40b50eac556f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:26.370802 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b0f0f-1ab4-49e0-8326-40b50eac556f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:26.372199 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b0f0f-1ab4-49e0-8326-40b50eac556f None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:26.385251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-923b0f0f-1ab4-49e0-8326-40b50eac556f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 19:39:26.385251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:26.385251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:26.385251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:26.385251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:26.385251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:26.385251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:26.385251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:26.385251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 19:39:26.385251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:26.385251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:26.385251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:26.385251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:26.385251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:26.385251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:26.385251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:26.386230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:26.386230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:26.386230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:26.386230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:26.386230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:26.386230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:26.386230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:26.386230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:26.386230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:26.386230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:26.386230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:26.386230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:26.386230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:26.386230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:26.386230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:26.386230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:26.387151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:26.387151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:26.387151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:26.387151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:26.387151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:26.387151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:26.387151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:26.387151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:26.387151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:26.387151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:26.387151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:26.387151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:26.387151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:26.387151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 19:39:26.387151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:26.387151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 406/809] 10.222.0.13 () {56 vars in 1129 bytes} [Thu Jun 23 19:39:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:26.388693 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b0f0f-1ab4-49e0-8326-40b50eac556f None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:26.409533 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:26.423227 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e5f1b-c46a-4bc6-bdca-b56d21a0e245 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:26.459507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be9658-567c-4f1f-a195-6cab886d0e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:26.461192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be9658-567c-4f1f-a195-6cab886d0e79 None admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:26.461307 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be9658-567c-4f1f-a195-6cab886d0e79 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:26.461703 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be9658-567c-4f1f-a195-6cab886d0e79 None admin] PATH_INFO: `/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/fec6c1cbf48a44f9922bd82e714861c1/roles/e466769ed9af47889225dd8d77e896a5` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:26.477217 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be9658-567c-4f1f-a195-6cab886d0e79 None admin] RBAC: Authorizing `identity:create_grant(project_id=368f41dc1ae64e199b604ee72545c88e, user_id=fec6c1cbf48a44f9922bd82e714861c1, role_id=e466769ed9af47889225dd8d77e896a5)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:26.478597 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be9658-567c-4f1f-a195-6cab886d0e79 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:26.499784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b0f0f-1ab4-49e0-8326-40b50eac556f None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:26.534032 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b76a7-d804-4e1e-80a7-d7a732ad14e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:26.534818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b76a7-d804-4e1e-80a7-d7a732ad14e0 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:26.535099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b76a7-d804-4e1e-80a7-d7a732ad14e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:26.535375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b76a7-d804-4e1e-80a7-d7a732ad14e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:26.546185 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b76a7-d804-4e1e-80a7-d7a732ad14e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:26.547683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b76a7-d804-4e1e-80a7-d7a732ad14e0 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:26.566080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-404b76a7-d804-4e1e-80a7-d7a732ad14e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:26.566080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:26.566080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:26.566080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:26.566080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:26.566080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:26.566080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:26.566080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:26.566080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:26.566080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:26.566080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:26.566080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:26.566080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:26.566080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:26.566080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:26.567011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:26.567011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:26.567011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:26.567011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:26.567011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:26.567011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:26.567011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:26.567011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:26.567011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:26.567011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:26.567011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:26.567011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:26.567011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:26.567011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:26.567011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:26.567011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:26.567011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:26.567920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:26.567920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:26.567920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:26.567920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:26.567920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 407/810] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:26.568195 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b76a7-d804-4e1e-80a7-d7a732ad14e0 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:26.585442 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 404/811] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:39:26 2022] PUT /identity/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/fec6c1cbf48a44f9922bd82e714861c1/roles/e466769ed9af47889225dd8d77e896a5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:39:26.585442 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be9658-567c-4f1f-a195-6cab886d0e79 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:26.614472 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:26.659943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:26.696903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b76a7-d804-4e1e-80a7-d7a732ad14e0 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:26.710801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be9658-567c-4f1f-a195-6cab886d0e79 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:26.739155 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424f542-20a8-4a90-90d9-a36771029d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:26.739914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424f542-20a8-4a90-90d9-a36771029d7c None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:26.740202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424f542-20a8-4a90-90d9-a36771029d7c None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:26.740484 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424f542-20a8-4a90-90d9-a36771029d7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:26.750146 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424f542-20a8-4a90-90d9-a36771029d7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:26.751647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424f542-20a8-4a90-90d9-a36771029d7c None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:26.760499 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c8179-1d40-44cb-9479-72adf0bf8aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:26.761210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c8179-1d40-44cb-9479-72adf0bf8aab None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:26.761505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c8179-1d40-44cb-9479-72adf0bf8aab None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:26.761789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c8179-1d40-44cb-9479-72adf0bf8aab None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:26.762518 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c8179-1d40-44cb-9479-72adf0bf8aab None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:26.762845 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c8179-1d40-44cb-9479-72adf0bf8aab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:26.764231 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c8179-1d40-44cb-9479-72adf0bf8aab None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:26.769681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 405/812] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Jun 23 19:39:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:26.772601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-5424f542-20a8-4a90-90d9-a36771029d7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:26.772601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:26.772601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:26.772601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:26.772601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:26.772601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:26.772601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:26.772601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:26.772601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:26.772601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:26.772601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:26.772601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:26.772601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:26.772601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:26.772601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:26.773626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:26.773626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:26.773626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:26.773626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:26.773626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:26.773626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:26.773626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:26.773626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:26.773626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:26.773626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:26.773626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:26.773626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:26.773626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:26.773626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:26.773626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:26.773626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:26.773626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:26.774930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:26.774930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:26.774930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:26.774930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:26.774930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:26.774930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:26.774930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:26.774930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:26.775900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c8179-1d40-44cb-9479-72adf0bf8aab None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:26.777141 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 408/813] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:26.778273 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424f542-20a8-4a90-90d9-a36771029d7c None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:26.891987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:26.901311 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424f542-20a8-4a90-90d9-a36771029d7c None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:26.910483 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c8179-1d40-44cb-9479-72adf0bf8aab None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:26.931136 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:26.936982 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e374f7-54c8-415c-a5d5-b9fd35364045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:26.937689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e374f7-54c8-415c-a5d5-b9fd35364045 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:26.937960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e374f7-54c8-415c-a5d5-b9fd35364045 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:26.938247 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e374f7-54c8-415c-a5d5-b9fd35364045 None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:26.938961 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e374f7-54c8-415c-a5d5-b9fd35364045 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:26.945356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e374f7-54c8-415c-a5d5-b9fd35364045 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:26.945356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e374f7-54c8-415c-a5d5-b9fd35364045 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:26.946622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 409/814] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Jun 23 19:39:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:26.947417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e374f7-54c8-415c-a5d5-b9fd35364045 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:26.952041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d3a95-f685-4dad-b2f8-055be54a48b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:26.952935 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d3a95-f685-4dad-b2f8-055be54a48b1 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:26.953416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d3a95-f685-4dad-b2f8-055be54a48b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:26.953858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d3a95-f685-4dad-b2f8-055be54a48b1 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:26.954782 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d3a95-f685-4dad-b2f8-055be54a48b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:26.955086 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d3a95-f685-4dad-b2f8-055be54a48b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:26.956449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d3a95-f685-4dad-b2f8-055be54a48b1 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:26.969480 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 406/815] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:26.975238 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a6d91-eda5-4a44-b96a-af1810290bbc None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:26.975677 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a6d91-eda5-4a44-b96a-af1810290bbc None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:26.976201 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a6d91-eda5-4a44-b96a-af1810290bbc None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:26.981493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 407/816] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:26.981493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a6d91-eda5-4a44-b96a-af1810290bbc None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:27.055544 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e374f7-54c8-415c-a5d5-b9fd35364045 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:27.086203 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a6d91-eda5-4a44-b96a-af1810290bbc None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:27.090542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ccd1d-9e65-4a59-b020-476c07253dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:27.091211 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ccd1d-9e65-4a59-b020-476c07253dc7 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:27.091498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ccd1d-9e65-4a59-b020-476c07253dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:27.091776 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ccd1d-9e65-4a59-b020-476c07253dc7 None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:27.092568 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ccd1d-9e65-4a59-b020-476c07253dc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:27.092880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ccd1d-9e65-4a59-b020-476c07253dc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:27.094357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ccd1d-9e65-4a59-b020-476c07253dc7 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:27.112909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 410/817] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:27.112909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d66b2-316d-42b0-a713-76b1dc33fe9c None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:27.112909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d66b2-316d-42b0-a713-76b1dc33fe9c None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:27.112909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d66b2-316d-42b0-a713-76b1dc33fe9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:27.127401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-f90d66b2-316d-42b0-a713-76b1dc33fe9c None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:27.128587 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f90d66b2-316d-42b0-a713-76b1dc33fe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:27.129612 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac65e96-278a-4fc5-b682-904c74dfaefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:27.130273 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac65e96-278a-4fc5-b682-904c74dfaefb None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:27.130567 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac65e96-278a-4fc5-b682-904c74dfaefb None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:27.130837 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac65e96-278a-4fc5-b682-904c74dfaefb None admin] PATH_INFO: `/v3/endpoints` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:27.132444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac65e96-278a-4fc5-b682-904c74dfaefb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:27.133470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac65e96-278a-4fc5-b682-904c74dfaefb None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:27.181080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:27.198190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 411/818] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:27.199102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d66b2-316d-42b0-a713-76b1dc33fe9c None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:27.273220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 408/819] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 23 19:39:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:39:27.274335 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac65e96-278a-4fc5-b682-904c74dfaefb None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:27.282656 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:27.321891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d66b2-316d-42b0-a713-76b1dc33fe9c None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:27.378798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2713bd-1f0b-4de6-8dd9-6a861f57b91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:27.379720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2713bd-1f0b-4de6-8dd9-6a861f57b91f None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:27.380066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2713bd-1f0b-4de6-8dd9-6a861f57b91f None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:27.380408 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2713bd-1f0b-4de6-8dd9-6a861f57b91f None admin] PATH_INFO: `/v3/users/nova` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:27.390731 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2713bd-1f0b-4de6-8dd9-6a861f57b91f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:27.392881 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2713bd-1f0b-4de6-8dd9-6a861f57b91f None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:27.412228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-0a2713bd-1f0b-4de6-8dd9-6a861f57b91f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 19:39:27.412228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:27.412228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:27.412228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:27.412228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:27.412228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:27.412228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:27.412228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:27.412228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:27.412228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:27.412228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:27.412228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:27.412228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:27.412228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:27.412228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:27.412228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:27.413375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:27.413375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:27.413375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:27.413375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:27.413375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:27.413375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:27.413375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:27.413375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:27.413375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:27.413375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:27.413375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:27.413375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:27.413375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:27.413375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:27.413375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:27.413375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:27.413375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:27.413375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:27.414547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:27.414547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:27.414547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:27.414547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:27.414547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:27.414547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:27.414547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:27.414547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:27.414547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 19:39:27.414547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:27.414547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 412/820] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 23 19:39:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:27.415138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2713bd-1f0b-4de6-8dd9-6a861f57b91f None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:27.416352 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac65e96-278a-4fc5-b682-904c74dfaefb None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:27.464302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f91be-ee36-4f9a-8e23-2266fc7b021f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:27.465302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f91be-ee36-4f9a-8e23-2266fc7b021f None admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:27.465587 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f91be-ee36-4f9a-8e23-2266fc7b021f None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:27.465863 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f91be-ee36-4f9a-8e23-2266fc7b021f None admin] PATH_INFO: `/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/2cc53095a45e4136b37fb6e4e677eff9/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:27.467836 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f91be-ee36-4f9a-8e23-2266fc7b021f None admin] RBAC: Authorizing `identity:create_grant(project_id=368f41dc1ae64e199b604ee72545c88e, user_id=2cc53095a45e4136b37fb6e4e677eff9, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:27.469545 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f91be-ee36-4f9a-8e23-2266fc7b021f None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:27.472697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:27.531945 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2713bd-1f0b-4de6-8dd9-6a861f57b91f None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:27.544841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 409/821] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:39:27 2022] PUT /identity/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/2cc53095a45e4136b37fb6e4e677eff9/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:39:27.545784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f91be-ee36-4f9a-8e23-2266fc7b021f None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:27.580308 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe8146-81e7-4ec6-909f-631dca71fd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:27.581491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe8146-81e7-4ec6-909f-631dca71fd18 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:27.581963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe8146-81e7-4ec6-909f-631dca71fd18 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:27.582564 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe8146-81e7-4ec6-909f-631dca71fd18 None admin] PATH_INFO: `/v3/services/network` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:27.584341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe8146-81e7-4ec6-909f-631dca71fd18 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:27.586516 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe8146-81e7-4ec6-909f-631dca71fd18 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:27.603102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-eafe8146-81e7-4ec6-909f-631dca71fd18 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 19:39:27.603102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:27.603102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:27.603102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:27.603102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:27.603102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:27.603102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:27.603102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:27.603102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 19:39:27.603102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:27.603102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:27.603102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:27.603102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:27.603102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:27.603102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:27.603102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:27.603102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:27.604181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:27.604181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:27.604181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:27.604181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:27.604181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:27.604181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:27.604181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:27.604181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:27.604181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:27.604181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:27.604181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:27.604181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:27.604181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:27.604181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:27.604181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:27.604181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:27.605021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:27.605021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:27.605021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:27.605021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:27.605021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:27.605021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:27.605021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:27.605021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:27.605021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:27.605021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:27.605021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:27.605021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:27.605021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 19:39:27.605021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:27.608336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 413/822] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:27 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:27.613921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe8146-81e7-4ec6-909f-631dca71fd18 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:27.616500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:27.703875 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f91be-ee36-4f9a-8e23-2266fc7b021f None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:27.740329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe8146-81e7-4ec6-909f-631dca71fd18 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:27.744029 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:27.778968 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeeda1d-8ba4-4880-8584-4662d399a5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:27.779803 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeda1d-8ba4-4880-8584-4662d399a5d5 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:27.780184 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeda1d-8ba4-4880-8584-4662d399a5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:27.780591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeda1d-8ba4-4880-8584-4662d399a5d5 None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:27.781611 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeeda1d-8ba4-4880-8584-4662d399a5d5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:27.782034 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeeda1d-8ba4-4880-8584-4662d399a5d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:27.783589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeeda1d-8ba4-4880-8584-4662d399a5d5 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:27.784625 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fc704-4a33-407d-a583-7dbb4c844f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:27.785525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fc704-4a33-407d-a583-7dbb4c844f4b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:27.786015 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fc704-4a33-407d-a583-7dbb4c844f4b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:27.786523 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fc704-4a33-407d-a583-7dbb4c844f4b None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:27.787753 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fc704-4a33-407d-a583-7dbb4c844f4b None admin] RBAC: Adding query filter params (name=network) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:27.788407 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fc704-4a33-407d-a583-7dbb4c844f4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:27.790376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fc704-4a33-407d-a583-7dbb4c844f4b None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:27.796496 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 414/823] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 19:39:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:27.801674 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fc704-4a33-407d-a583-7dbb4c844f4b None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:27.821021 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 410/824] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 23 19:39:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:27.822495 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeeda1d-8ba4-4880-8584-4662d399a5d5 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:27.937428 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeeda1d-8ba4-4880-8584-4662d399a5d5 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:27.951209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fc704-4a33-407d-a583-7dbb4c844f4b None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:27.962859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:27.977864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639ee40-ec84-43d1-8eab-b6fe5eb401f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:27.979439 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639ee40-ec84-43d1-8eab-b6fe5eb401f5 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:27.979787 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639ee40-ec84-43d1-8eab-b6fe5eb401f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:27.980079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639ee40-ec84-43d1-8eab-b6fe5eb401f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:27.993004 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a70c2b-550d-4e63-b562-7d94884c8780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:27.993724 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70c2b-550d-4e63-b562-7d94884c8780 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:27.994015 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70c2b-550d-4e63-b562-7d94884c8780 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:27.994299 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70c2b-550d-4e63-b562-7d94884c8780 None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:27.995135 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a70c2b-550d-4e63-b562-7d94884c8780 None admin] RBAC: Adding query filter params (type=network) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:27.995449 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a70c2b-550d-4e63-b562-7d94884c8780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:27.996922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a70c2b-550d-4e63-b562-7d94884c8780 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:28.002547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 415/825] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 19:39:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:28.008858 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a70c2b-550d-4e63-b562-7d94884c8780 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:28.061825 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639ee40-ec84-43d1-8eab-b6fe5eb401f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:28.064183 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639ee40-ec84-43d1-8eab-b6fe5eb401f5 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:28.074385 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:28.181339 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 411/826] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:39:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 19:39:28.184081 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639ee40-ec84-43d1-8eab-b6fe5eb401f5 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:28.222130 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a70c2b-550d-4e63-b562-7d94884c8780 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:28.233614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:28.288567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04b666-3917-4574-a475-7ba045c1cac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:28.289259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04b666-3917-4574-a475-7ba045c1cac7 None admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:28.289548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04b666-3917-4574-a475-7ba045c1cac7 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:28.289830 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04b666-3917-4574-a475-7ba045c1cac7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:28.290579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04b666-3917-4574-a475-7ba045c1cac7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:28.291962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04b666-3917-4574-a475-7ba045c1cac7 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:28.338998 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639ee40-ec84-43d1-8eab-b6fe5eb401f5 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:28.374812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265a0e8-1e8c-4f68-a4fd-34d0f57e921a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:28.375613 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265a0e8-1e8c-4f68-a4fd-34d0f57e921a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:28.375901 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265a0e8-1e8c-4f68-a4fd-34d0f57e921a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:28.376177 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265a0e8-1e8c-4f68-a4fd-34d0f57e921a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:28.387056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265a0e8-1e8c-4f68-a4fd-34d0f57e921a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:28.388559 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265a0e8-1e8c-4f68-a4fd-34d0f57e921a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:28.412321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 416/827] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 23 19:39:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:39:28.417300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-f265a0e8-1e8c-4f68-a4fd-34d0f57e921a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:28.417300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:28.417300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:28.417300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:28.417300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:28.417300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:28.417300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:28.417300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:28.417300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:28.417300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:28.417300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:28.417300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:28.417300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:28.417300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:28.417300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:28.418243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:28.418243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:28.418243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:28.418243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:28.418243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:28.418243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:28.418243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:28.418243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:28.418243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:28.418243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:28.418243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:28.418243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:28.418243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:28.418243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:28.418243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:28.418243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:28.418243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:28.419400 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:28.419400 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:28.419400 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:28.419400 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:28.419400 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 412/828] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:28.426008 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04b666-3917-4574-a475-7ba045c1cac7 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:28.570794 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:28.592922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04b666-3917-4574-a475-7ba045c1cac7 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:28.641963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f650c-474b-40f3-b530-29cb4e3ba9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:28.642637 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f650c-474b-40f3-b530-29cb4e3ba9c8 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:28.642923 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f650c-474b-40f3-b530-29cb4e3ba9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:28.643203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f650c-474b-40f3-b530-29cb4e3ba9c8 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:28.643936 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f650c-474b-40f3-b530-29cb4e3ba9c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:28.644244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f650c-474b-40f3-b530-29cb4e3ba9c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:28.645726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f650c-474b-40f3-b530-29cb4e3ba9c8 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:28.658665 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 417/829] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:28.666430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265a0e8-1e8c-4f68-a4fd-34d0f57e921a None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:28.758056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:28.781622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0747135-8d5e-4357-8d3a-74bc72b29d30 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:28.782132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0747135-8d5e-4357-8d3a-74bc72b29d30 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:28.782209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0747135-8d5e-4357-8d3a-74bc72b29d30 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:28.783681 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 418/830] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:28.787448 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265a0e8-1e8c-4f68-a4fd-34d0f57e921a None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:28.789264 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54705e89-e6a0-4aac-96f7-70c8f85450d4 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:28.789558 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54705e89-e6a0-4aac-96f7-70c8f85450d4 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:28.789840 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54705e89-e6a0-4aac-96f7-70c8f85450d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:28.821263 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-54705e89-e6a0-4aac-96f7-70c8f85450d4 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:28.822419 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-54705e89-e6a0-4aac-96f7-70c8f85450d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:28.836691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47242aa-0228-422a-af00-46556919e0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:28.837723 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47242aa-0228-422a-af00-46556919e0f6 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:28.837896 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47242aa-0228-422a-af00-46556919e0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:28.838211 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47242aa-0228-422a-af00-46556919e0f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:28.845691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47242aa-0228-422a-af00-46556919e0f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:28.847265 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47242aa-0228-422a-af00-46556919e0f6 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:28.862736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-e47242aa-0228-422a-af00-46556919e0f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:28.862736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:28.862736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:28.862736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:28.862736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:28.862736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:28.862736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:28.862736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:28.862736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:28.862736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:28.862736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:28.862736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:28.862736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:28.862736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:28.862736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:28.863750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:28.863750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:28.863750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:28.863750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:28.863750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:28.863750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:28.863750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:28.863750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:28.863750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:28.863750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:28.863750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:28.863750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:28.863750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:28.863750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:28.863750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:28.863750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:28.863750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:28.864714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:28.864714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:28.864714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:28.864714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:28.864714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:28.864714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:28.864714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:28.864714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:28.864714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 413/831] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:28.876273 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47242aa-0228-422a-af00-46556919e0f6 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:28.918943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 419/832] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 19:39:28.942605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54705e89-e6a0-4aac-96f7-70c8f85450d4 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:29.019299 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47242aa-0228-422a-af00-46556919e0f6 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:29.024867 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:29.056238 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e990e-4090-4ade-b717-e7319cb83a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:29.056907 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e990e-4090-4ade-b717-e7319cb83a53 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:29.057248 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e990e-4090-4ade-b717-e7319cb83a53 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:29.057491 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e990e-4090-4ade-b717-e7319cb83a53 None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:29.058279 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e990e-4090-4ade-b717-e7319cb83a53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:29.058588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e990e-4090-4ade-b717-e7319cb83a53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:29.060023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e990e-4090-4ade-b717-e7319cb83a53 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:29.060267 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54705e89-e6a0-4aac-96f7-70c8f85450d4 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:29.061860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:29.079320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 414/833] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:29.082164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e990e-4090-4ade-b717-e7319cb83a53 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:29.115044 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58405fcd-a6aa-49b7-92cd-afdb10609874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:29.116580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58405fcd-a6aa-49b7-92cd-afdb10609874 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:29.116885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58405fcd-a6aa-49b7-92cd-afdb10609874 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:29.117237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58405fcd-a6aa-49b7-92cd-afdb10609874 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:29.130470 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58405fcd-a6aa-49b7-92cd-afdb10609874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:29.139493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-58405fcd-a6aa-49b7-92cd-afdb10609874 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:29.139493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:29.139493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:29.139493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:29.139493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:29.139493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:29.139493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:29.139493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:29.139493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:29.139493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:29.139493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:29.139493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:29.139493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:29.139493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:29.139493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:29.139493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:29.140782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:29.140782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:29.140782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:29.140782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:29.140782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:29.140782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:29.140782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:29.140782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:29.140782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:29.140782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:29.140782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:29.140782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:29.140782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:29.140782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:29.140782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:29.140782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:29.142053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:29.142053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:29.142053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:29.142053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:29.142053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:29.142053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:29.142053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:29.142053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:29.142053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:29.142053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:29.142053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:39:29.142053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:29.142053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 420/834] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:39:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:29.150119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58405fcd-a6aa-49b7-92cd-afdb10609874 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:29.215240 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e990e-4090-4ade-b717-e7319cb83a53 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:29.260971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250f713-1eae-4fec-b69e-4ef2e152c04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:29.261672 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250f713-1eae-4fec-b69e-4ef2e152c04e None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:29.261962 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250f713-1eae-4fec-b69e-4ef2e152c04e None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:29.262247 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250f713-1eae-4fec-b69e-4ef2e152c04e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:29.263781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250f713-1eae-4fec-b69e-4ef2e152c04e None admin] RBAC: Adding query filter params (role.id=76bd0cf7bf094e4fa3db121b96215004, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=83bff5cd7782423eaa0bc5b29b208ae7) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:29.264105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250f713-1eae-4fec-b69e-4ef2e152c04e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:29.265583 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250f713-1eae-4fec-b69e-4ef2e152c04e None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:29.266156 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58405fcd-a6aa-49b7-92cd-afdb10609874 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:29.277223 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 415/835] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:39:29 2022] GET /identity/v3/role_assignments?user.id=83bff5cd7782423eaa0bc5b29b208ae7&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=76bd0cf7bf094e4fa3db121b96215004 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:29.313827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2647b9-76dc-4d1b-8518-7c17b14d2fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:29.314913 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2647b9-76dc-4d1b-8518-7c17b14d2fea None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:29.315421 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2647b9-76dc-4d1b-8518-7c17b14d2fea None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:29.315907 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2647b9-76dc-4d1b-8518-7c17b14d2fea None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:29.316890 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2647b9-76dc-4d1b-8518-7c17b14d2fea None admin] RBAC: Adding query filter params (name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:29.317486 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2647b9-76dc-4d1b-8518-7c17b14d2fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:29.320145 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2647b9-76dc-4d1b-8518-7c17b14d2fea None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:29.322430 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:29.339436 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 421/836] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:39:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:29.339637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250f713-1eae-4fec-b69e-4ef2e152c04e None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:29.409565 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:29.451493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250f713-1eae-4fec-b69e-4ef2e152c04e None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:29.488856 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c16eb-2aef-4b73-b2ea-6ac1ef32e745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:29.489685 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c16eb-2aef-4b73-b2ea-6ac1ef32e745 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:29.489973 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c16eb-2aef-4b73-b2ea-6ac1ef32e745 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:29.490252 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c16eb-2aef-4b73-b2ea-6ac1ef32e745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:29.502200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c16eb-2aef-4b73-b2ea-6ac1ef32e745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:29.503658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c16eb-2aef-4b73-b2ea-6ac1ef32e745 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:29.522207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-b29c16eb-2aef-4b73-b2ea-6ac1ef32e745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:29.522207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:29.522207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:29.522207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:29.522207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:29.522207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:29.522207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:29.522207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:29.522207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:29.522207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:29.522207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:29.522207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:29.522207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:29.522207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:29.522207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:29.523153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:29.523153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:29.523153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:29.523153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:29.523153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:29.523153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:29.523153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:29.523153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:29.523153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:29.523153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:29.523153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:29.523153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:29.523153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:29.523153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:29.523153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:29.523153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:29.523153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:29.524479 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:29.524479 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:29.524479 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:29.524479 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:29.524479 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 416/837] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:29.529356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2647b9-76dc-4d1b-8518-7c17b14d2fea None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:29.638109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2647b9-76dc-4d1b-8518-7c17b14d2fea None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:29.675099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35568ea5-95cc-45c4-8b3d-2c9b259ff7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:29.675771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35568ea5-95cc-45c4-8b3d-2c9b259ff7e8 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:29.676058 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35568ea5-95cc-45c4-8b3d-2c9b259ff7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:29.676340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35568ea5-95cc-45c4-8b3d-2c9b259ff7e8 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:29.677084 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35568ea5-95cc-45c4-8b3d-2c9b259ff7e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:29.677435 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35568ea5-95cc-45c4-8b3d-2c9b259ff7e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:29.679372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35568ea5-95cc-45c4-8b3d-2c9b259ff7e8 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:29.691862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 422/838] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:29.697693 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c16eb-2aef-4b73-b2ea-6ac1ef32e745 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:29.708956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b76635-301c-4e71-b1d2-12d43cac401c None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:29.709284 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b76635-301c-4e71-b1d2-12d43cac401c None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:29.710092 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b76635-301c-4e71-b1d2-12d43cac401c None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:29.713760 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 423/839] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:39:29.719222 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad18fc-9ee6-4093-bc24-90b5abfef187 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:29.719799 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad18fc-9ee6-4093-bc24-90b5abfef187 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:29.720094 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad18fc-9ee6-4093-bc24-90b5abfef187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:29.737694 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-46ad18fc-9ee6-4093-bc24-90b5abfef187 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:29.739001 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-46ad18fc-9ee6-4093-bc24-90b5abfef187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:29.808062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:29.831264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c16eb-2aef-4b73-b2ea-6ac1ef32e745 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:29.837262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 424/840] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 19:39:29.846981 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:29.860759 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad18fc-9ee6-4093-bc24-90b5abfef187 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:29.883340 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588b5c2-3931-4240-b71b-35f089a826c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:29.884155 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588b5c2-3931-4240-b71b-35f089a826c1 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:29.884609 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588b5c2-3931-4240-b71b-35f089a826c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:29.885785 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588b5c2-3931-4240-b71b-35f089a826c1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:29.897079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588b5c2-3931-4240-b71b-35f089a826c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:29.898854 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588b5c2-3931-4240-b71b-35f089a826c1 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:29.916644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-0588b5c2-3931-4240-b71b-35f089a826c1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 19:39:29.916644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:29.916644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:29.916644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:29.916644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:29.916644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:29.916644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:29.916644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:29.916644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:29.916644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:29.916644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:29.916644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:29.916644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:29.916644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:29.916644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:29.916644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:29.917625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:29.917625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:29.917625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:29.917625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:29.917625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:29.917625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:29.917625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:29.917625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:29.917625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:29.917625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:29.917625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:29.917625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:29.917625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:29.917625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:29.917625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:29.917625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:29.917625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:29.917625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:29.918553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:29.918553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:29.918553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:29.918553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:29.918553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:29.918553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:29.918553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:29.918553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:29.918553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 19:39:29.918553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:29.921432 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 417/841] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 23 19:39:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:29.929342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588b5c2-3931-4240-b71b-35f089a826c1 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:29.981444 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad18fc-9ee6-4093-bc24-90b5abfef187 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:30.020443 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8437e5-be2e-4514-950b-b36a86b11c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:30.021957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8437e5-be2e-4514-950b-b36a86b11c5c None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:30.022336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8437e5-be2e-4514-950b-b36a86b11c5c None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:30.022826 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8437e5-be2e-4514-950b-b36a86b11c5c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:30.023691 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8437e5-be2e-4514-950b-b36a86b11c5c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:30.026298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8437e5-be2e-4514-950b-b36a86b11c5c None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:30.042428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-0f8437e5-be2e-4514-950b-b36a86b11c5c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 19:39:30.042428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:30.042428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:30.042428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:30.042428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:30.042428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:30.042428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:30.042428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:30.042428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 19:39:30.042428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:30.042428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:30.042428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:30.042428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:30.042428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:30.042428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:30.042428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:30.042428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:30.043548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:30.043548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:30.043548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:30.043548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:30.043548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:30.043548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:30.043548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:30.043548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:30.043548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:30.043548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:30.043548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:30.043548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:30.043548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:30.043548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:30.043548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:30.043548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:30.044393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:30.044393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:30.044393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:30.044393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:30.044393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:30.044393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:30.044393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:30.044393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:30.044393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:30.044393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:30.044393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:30.044393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:30.044393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 19:39:30.044393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:30.044393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 425/842] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:39:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:30.049580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8437e5-be2e-4514-950b-b36a86b11c5c None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:30.068308 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588b5c2-3931-4240-b71b-35f089a826c1 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:30.108958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691c45f-7644-41eb-88ad-a11d86acb778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:30.109993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691c45f-7644-41eb-88ad-a11d86acb778 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:30.110282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691c45f-7644-41eb-88ad-a11d86acb778 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:30.110708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691c45f-7644-41eb-88ad-a11d86acb778 None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:30.111541 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691c45f-7644-41eb-88ad-a11d86acb778 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:30.111851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691c45f-7644-41eb-88ad-a11d86acb778 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:30.113417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691c45f-7644-41eb-88ad-a11d86acb778 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:30.118136 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:30.133326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 418/843] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Jun 23 19:39:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:30.133326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36f8fe-ca2a-429b-b088-f03baa5ac6a2 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:30.133326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36f8fe-ca2a-429b-b088-f03baa5ac6a2 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:30.133629 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36f8fe-ca2a-429b-b088-f03baa5ac6a2 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:30.134935 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 419/844] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:30.136604 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36f8fe-ca2a-429b-b088-f03baa5ac6a2 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:30.169188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:30.177815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8437e5-be2e-4514-950b-b36a86b11c5c None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:30.216869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34ef79-f0ea-4922-9dac-6134d5790e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:30.217570 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34ef79-f0ea-4922-9dac-6134d5790e70 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:30.217867 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34ef79-f0ea-4922-9dac-6134d5790e70 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:30.218148 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34ef79-f0ea-4922-9dac-6134d5790e70 None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:30.218861 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34ef79-f0ea-4922-9dac-6134d5790e70 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:30.219180 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34ef79-f0ea-4922-9dac-6134d5790e70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:30.220557 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34ef79-f0ea-4922-9dac-6134d5790e70 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:30.229512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 426/845] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:39:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:30.229512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fbf78-34d5-492d-92f6-6a6d991d5214 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:30.229512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fbf78-34d5-492d-92f6-6a6d991d5214 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:30.229512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fbf78-34d5-492d-92f6-6a6d991d5214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:30.244880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-5a0fbf78-34d5-492d-92f6-6a6d991d5214 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:30.246086 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-5a0fbf78-34d5-492d-92f6-6a6d991d5214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:30.251769 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36f8fe-ca2a-429b-b088-f03baa5ac6a2 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:30.289821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90659368-cf6e-471a-a109-ae1acb3baff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:30.290729 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90659368-cf6e-471a-a109-ae1acb3baff9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:30.291900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90659368-cf6e-471a-a109-ae1acb3baff9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:30.292366 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90659368-cf6e-471a-a109-ae1acb3baff9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:30.313856 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 427/846] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:30.314681 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fbf78-34d5-492d-92f6-6a6d991d5214 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:30.367722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90659368-cf6e-471a-a109-ae1acb3baff9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:30.369376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90659368-cf6e-471a-a109-ae1acb3baff9 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:30.373708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:30.398721 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:30.429748 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fbf78-34d5-492d-92f6-6a6d991d5214 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:30.466541 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60547f-dcb2-4fa8-8bc6-7f18b521f14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:30.467214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60547f-dcb2-4fa8-8bc6-7f18b521f14d None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:30.467502 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60547f-dcb2-4fa8-8bc6-7f18b521f14d None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:30.467782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60547f-dcb2-4fa8-8bc6-7f18b521f14d None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:30.468495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60547f-dcb2-4fa8-8bc6-7f18b521f14d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:30.468803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60547f-dcb2-4fa8-8bc6-7f18b521f14d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:30.470194 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60547f-dcb2-4fa8-8bc6-7f18b521f14d None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:30.484307 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 428/847] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:39:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:30.484548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 420/848] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:39:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 19:39:30.484670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60547f-dcb2-4fa8-8bc6-7f18b521f14d None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:30.484768 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90659368-cf6e-471a-a109-ae1acb3baff9 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:30.609908 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90659368-cf6e-471a-a109-ae1acb3baff9 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:30.618883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60547f-dcb2-4fa8-8bc6-7f18b521f14d None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:30.648359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:30.649055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:30.655931 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb198e-53cd-4bdd-b95f-4a0b20a708f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:30.656727 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb198e-53cd-4bdd-b95f-4a0b20a708f6 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:30.657014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb198e-53cd-4bdd-b95f-4a0b20a708f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:30.657329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb198e-53cd-4bdd-b95f-4a0b20a708f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:30.658773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81243cd9-f426-41da-b0d4-7b6138d35831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:30.659633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81243cd9-f426-41da-b0d4-7b6138d35831 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:30.659924 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81243cd9-f426-41da-b0d4-7b6138d35831 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:30.660207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81243cd9-f426-41da-b0d4-7b6138d35831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:30.672334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb198e-53cd-4bdd-b95f-4a0b20a708f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:30.672859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81243cd9-f426-41da-b0d4-7b6138d35831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:30.674451 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81243cd9-f426-41da-b0d4-7b6138d35831 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:30.683089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-4afb198e-53cd-4bdd-b95f-4a0b20a708f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:39:30.683089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:30.683089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:30.683089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:30.683089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:30.683089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:30.683089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:30.683089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:30.683089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:30.683089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:30.683089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:30.683089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:30.683089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:30.683089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:30.683089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:30.683089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:30.684226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:30.684226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:30.684226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:30.684226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:30.684226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:30.684226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:30.684226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:30.684226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:30.684226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:30.684226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:30.684226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:30.684226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:30.684226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:30.684226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:30.684226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:30.684226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:30.685460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:30.685460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:30.685460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:30.685460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:30.685460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:30.685460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:30.685460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:30.685460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:30.685460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:30.685460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:30.685460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:39:30.685460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:30.685460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 429/849] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:39:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:30.689295 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb198e-53cd-4bdd-b95f-4a0b20a708f6 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:30.704229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-81243cd9-f426-41da-b0d4-7b6138d35831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:30.704229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:30.704229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:30.704229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:30.704229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:30.704229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:30.704229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:30.704229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:30.704229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:30.704229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:30.704229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:30.704229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:30.704229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:30.704229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:30.704229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:30.705192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:30.705192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:30.705192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:30.705192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:30.705192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:30.705192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:30.705192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:30.705192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:30.705192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:30.705192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:30.705192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:30.705192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:30.705192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:30.705192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:30.705192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:30.705192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:30.705192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:30.706127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:30.706127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:30.706127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:30.706127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:30.706127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 421/850] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:30.714082 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81243cd9-f426-41da-b0d4-7b6138d35831 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:30.807604 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb198e-53cd-4bdd-b95f-4a0b20a708f6 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:30.845471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69295a6-137c-494e-bef3-764ed566b86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:30.846249 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69295a6-137c-494e-bef3-764ed566b86c None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:30.846442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69295a6-137c-494e-bef3-764ed566b86c None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:30.846766 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69295a6-137c-494e-bef3-764ed566b86c None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:30.847554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69295a6-137c-494e-bef3-764ed566b86c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:30.847869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69295a6-137c-494e-bef3-764ed566b86c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:30.849313 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69295a6-137c-494e-bef3-764ed566b86c None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:30.853597 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81243cd9-f426-41da-b0d4-7b6138d35831 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:30.863364 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 430/851] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:39:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:30.864559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69295a6-137c-494e-bef3-764ed566b86c None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:30.901292 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2c2ab-14e2-41ba-936f-14963bccd856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:30.901971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2c2ab-14e2-41ba-936f-14963bccd856 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:30.902258 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2c2ab-14e2-41ba-936f-14963bccd856 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:30.902603 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2c2ab-14e2-41ba-936f-14963bccd856 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:30.903405 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2c2ab-14e2-41ba-936f-14963bccd856 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:30.903686 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2c2ab-14e2-41ba-936f-14963bccd856 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:30.905068 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2c2ab-14e2-41ba-936f-14963bccd856 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:30.911059 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:30.921972 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 422/852] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:30.923538 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2c2ab-14e2-41ba-936f-14963bccd856 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:30.971713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:31.021920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69295a6-137c-494e-bef3-764ed566b86c None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:31.049891 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2c2ab-14e2-41ba-936f-14963bccd856 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:31.070784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170aaac-d819-459a-9df2-0238ddaa51c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:31.071830 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170aaac-d819-459a-9df2-0238ddaa51c9 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:31.072260 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170aaac-d819-459a-9df2-0238ddaa51c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:31.072681 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170aaac-d819-459a-9df2-0238ddaa51c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:31.085559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170aaac-d819-459a-9df2-0238ddaa51c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:31.087196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170aaac-d819-459a-9df2-0238ddaa51c9 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:31.094495 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba571fd-6826-4099-9ad7-b7d28fb02d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:31.095478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba571fd-6826-4099-9ad7-b7d28fb02d71 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:31.096399 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba571fd-6826-4099-9ad7-b7d28fb02d71 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:31.096852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba571fd-6826-4099-9ad7-b7d28fb02d71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:31.104432 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba571fd-6826-4099-9ad7-b7d28fb02d71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:31.106100 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba571fd-6826-4099-9ad7-b7d28fb02d71 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:31.108457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-1170aaac-d819-459a-9df2-0238ddaa51c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:31.108457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:31.108457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:31.108457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:31.108457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:31.108457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:31.108457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:31.108457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:31.108457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:31.108457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:31.108457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:31.108457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:31.108457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:31.108457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:31.108457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:31.109432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:31.109432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:31.109432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:31.109432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:31.109432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:31.109432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:31.109432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:31.109432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:31.109432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:31.109432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:31.109432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:31.109432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:31.109432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:31.109432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:31.109432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:31.109432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:31.109432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:31.110313 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:31.110313 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:31.110313 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:31.110313 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:31.119340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 431/853] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:31.120361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170aaac-d819-459a-9df2-0238ddaa51c9 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:31.125296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-6ba571fd-6826-4099-9ad7-b7d28fb02d71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:31.125296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:31.125296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:31.125296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:31.125296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:31.125296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:31.125296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:31.125296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:31.125296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:31.125296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:31.125296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:31.125296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:31.125296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:31.125296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:31.125296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:31.126987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:31.126987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:31.126987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:31.126987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:31.126987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:31.126987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:31.126987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:31.126987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:31.126987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:31.126987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:31.126987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:31.126987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:31.126987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:31.126987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:31.126987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:31.126987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:31.126987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:31.127914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:31.127914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:31.127914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:31.127914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:31.127914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:31.127914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:31.127914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:31.127914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:31.136030 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 423/854] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:31.137544 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba571fd-6826-4099-9ad7-b7d28fb02d71 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:31.263770 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:31.288450 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:31.293540 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba571fd-6826-4099-9ad7-b7d28fb02d71 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:31.293983 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170aaac-d819-459a-9df2-0238ddaa51c9 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:31.336891 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7e568-ca51-4bf4-b4ee-fa6cd5b2ac3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:31.337952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7e568-ca51-4bf4-b4ee-fa6cd5b2ac3e None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:31.338442 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7e568-ca51-4bf4-b4ee-fa6cd5b2ac3e None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:31.338933 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7e568-ca51-4bf4-b4ee-fa6cd5b2ac3e None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:31.339959 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7e568-ca51-4bf4-b4ee-fa6cd5b2ac3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:31.340756 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7e568-ca51-4bf4-b4ee-fa6cd5b2ac3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:31.343161 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7e568-ca51-4bf4-b4ee-fa6cd5b2ac3e None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:31.349765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17342f03-4704-4a14-8c41-89a921d7fee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:31.350819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17342f03-4704-4a14-8c41-89a921d7fee5 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:31.351111 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17342f03-4704-4a14-8c41-89a921d7fee5 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:31.351476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17342f03-4704-4a14-8c41-89a921d7fee5 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:31.352240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17342f03-4704-4a14-8c41-89a921d7fee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:31.352551 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17342f03-4704-4a14-8c41-89a921d7fee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:31.353954 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17342f03-4704-4a14-8c41-89a921d7fee5 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:31.360740 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 424/855] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:31.369733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7e568-ca51-4bf4-b4ee-fa6cd5b2ac3e None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:31.384102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 432/856] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:31.385383 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17342f03-4704-4a14-8c41-89a921d7fee5 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:31.499657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7e568-ca51-4bf4-b4ee-fa6cd5b2ac3e None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:31.531564 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17342f03-4704-4a14-8c41-89a921d7fee5 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:31.541202 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a5898-2581-4a35-9d00-521450fea06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:31.541870 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a5898-2581-4a35-9d00-521450fea06d None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:31.542194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a5898-2581-4a35-9d00-521450fea06d None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:31.542432 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a5898-2581-4a35-9d00-521450fea06d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:31.543261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a5898-2581-4a35-9d00-521450fea06d None admin] RBAC: Adding query filter params (role.id=e466769ed9af47889225dd8d77e896a5, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=fec6c1cbf48a44f9922bd82e714861c1) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:31.543579 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a5898-2581-4a35-9d00-521450fea06d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:31.545123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a5898-2581-4a35-9d00-521450fea06d None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:31.552029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 425/857] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:39:31 2022] GET /identity/v3/role_assignments?user.id=fec6c1cbf48a44f9922bd82e714861c1&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=e466769ed9af47889225dd8d77e896a5 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:31.553924 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7033b24-1211-4fa0-9bd7-a4c81afd235c None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:31.554217 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7033b24-1211-4fa0-9bd7-a4c81afd235c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:31.554504 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7033b24-1211-4fa0-9bd7-a4c81afd235c None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:31.555942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 426/858] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:31.561655 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1580a35-1e41-4623-9dc0-ec803b788e4e None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:31.561976 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1580a35-1e41-4623-9dc0-ec803b788e4e None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:31.562233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1580a35-1e41-4623-9dc0-ec803b788e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:31.583639 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-e1580a35-1e41-4623-9dc0-ec803b788e4e None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:31.583972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12700ac-2c17-4ee5-bc09-3234f32a0c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:31.584811 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12700ac-2c17-4ee5-bc09-3234f32a0c74 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:31.585198 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12700ac-2c17-4ee5-bc09-3234f32a0c74 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:31.585479 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12700ac-2c17-4ee5-bc09-3234f32a0c74 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:31.586472 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e1580a35-1e41-4623-9dc0-ec803b788e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:31.595550 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12700ac-2c17-4ee5-bc09-3234f32a0c74 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:31.598114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12700ac-2c17-4ee5-bc09-3234f32a0c74 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:31.619293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:31.621806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-b12700ac-2c17-4ee5-bc09-3234f32a0c74 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 19:39:31.621806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:31.621806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:31.621806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:31.621806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:31.621806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:31.621806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:31.621806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:31.621806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:31.621806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:31.621806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:31.621806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:31.621806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:31.621806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:31.621806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:31.621806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:31.622797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:31.622797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:31.622797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:31.622797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:31.622797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:31.622797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:31.622797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:31.622797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:31.622797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:31.622797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:31.622797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:31.622797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:31.622797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:31.622797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:31.622797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:31.622797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:31.622797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:31.622797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:31.623784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:31.623784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:31.623784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:31.623784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:31.623784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:31.623784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:31.623784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:31.623784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:31.623784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 19:39:31.623784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:31.626429 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 433/859] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:39:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:31.638723 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12700ac-2c17-4ee5-bc09-3234f32a0c74 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:31.641721 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:31.684057 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 427/860] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 19:39:31.701215 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1580a35-1e41-4623-9dc0-ec803b788e4e None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:31.773199 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12700ac-2c17-4ee5-bc09-3234f32a0c74 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:31.818206 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582d3d3-c99e-43b3-96ca-b03b5fe5d0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:31.819838 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582d3d3-c99e-43b3-96ca-b03b5fe5d0cf None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:31.820297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582d3d3-c99e-43b3-96ca-b03b5fe5d0cf None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:31.820925 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582d3d3-c99e-43b3-96ca-b03b5fe5d0cf None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:31.821834 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582d3d3-c99e-43b3-96ca-b03b5fe5d0cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:31.822209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582d3d3-c99e-43b3-96ca-b03b5fe5d0cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:31.824212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582d3d3-c99e-43b3-96ca-b03b5fe5d0cf None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:31.840854 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1580a35-1e41-4623-9dc0-ec803b788e4e None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:31.848627 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 434/861] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Jun 23 19:39:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:31.854969 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582d3d3-c99e-43b3-96ca-b03b5fe5d0cf None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:31.892683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b17fa2-6fce-492e-8fd3-b00e860994f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:31.893895 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b17fa2-6fce-492e-8fd3-b00e860994f2 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:31.894296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b17fa2-6fce-492e-8fd3-b00e860994f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:31.894647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b17fa2-6fce-492e-8fd3-b00e860994f2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:31.895433 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b17fa2-6fce-492e-8fd3-b00e860994f2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:31.900539 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b17fa2-6fce-492e-8fd3-b00e860994f2 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:31.919387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-36b17fa2-6fce-492e-8fd3-b00e860994f2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 19:39:31.919387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:31.919387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:31.919387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:31.919387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:31.919387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:31.919387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:31.919387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:31.919387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 19:39:31.919387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:31.919387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:31.919387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:31.919387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:31.919387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:31.919387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:31.919387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:31.920580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:31.920580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:31.920580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:31.920580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:31.920580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:31.920580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:31.920580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:31.920580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:31.920580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:31.920580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:31.920580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:31.920580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:31.920580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:31.920580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:31.920580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:31.920580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:31.921847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:31.921847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:31.921847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:31.921847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:31.921847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:31.921847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:31.921847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:31.921847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:31.921847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:31.921847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:31.921847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:31.921847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:31.921847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:31.921847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 19:39:31.921847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:31.921847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 428/862] 10.222.0.13 () {56 vars in 1132 bytes} [Thu Jun 23 19:39:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:31.930189 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b17fa2-6fce-492e-8fd3-b00e860994f2 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:31.935838 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:31.953515 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:31.998978 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582d3d3-c99e-43b3-96ca-b03b5fe5d0cf None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:32.038260 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70240d-eac1-450a-a99e-640703b2f18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:32.039027 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70240d-eac1-450a-a99e-640703b2f18a None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:32.039424 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70240d-eac1-450a-a99e-640703b2f18a None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:32.039801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70240d-eac1-450a-a99e-640703b2f18a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:32.048015 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b17fa2-6fce-492e-8fd3-b00e860994f2 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:32.087116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893546d9-28a7-4215-ac0d-8b1f3cefb32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:32.088120 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893546d9-28a7-4215-ac0d-8b1f3cefb32f None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:32.088554 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893546d9-28a7-4215-ac0d-8b1f3cefb32f None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:32.088979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893546d9-28a7-4215-ac0d-8b1f3cefb32f None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:32.090057 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893546d9-28a7-4215-ac0d-8b1f3cefb32f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:32.090620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893546d9-28a7-4215-ac0d-8b1f3cefb32f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:32.092258 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893546d9-28a7-4215-ac0d-8b1f3cefb32f None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:32.103157 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 429/863] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 19:39:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:32.104529 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893546d9-28a7-4215-ac0d-8b1f3cefb32f None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:32.114054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70240d-eac1-450a-a99e-640703b2f18a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:32.115727 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70240d-eac1-450a-a99e-640703b2f18a None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:32.179013 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:32.201325 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:32.228727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893546d9-28a7-4215-ac0d-8b1f3cefb32f None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:32.232227 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 435/864] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:39:31 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 19:39:32.237480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70240d-eac1-450a-a99e-640703b2f18a None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:32.273399 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdc25e-11e8-4ba9-b4e6-f5a2f201ec35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:32.274151 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdc25e-11e8-4ba9-b4e6-f5a2f201ec35 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:32.274440 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdc25e-11e8-4ba9-b4e6-f5a2f201ec35 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:32.274727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdc25e-11e8-4ba9-b4e6-f5a2f201ec35 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:32.275905 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdc25e-11e8-4ba9-b4e6-f5a2f201ec35 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:32.276358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdc25e-11e8-4ba9-b4e6-f5a2f201ec35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:32.277850 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdc25e-11e8-4ba9-b4e6-f5a2f201ec35 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:32.293178 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 430/865] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 19:39:32 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:32.356631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70240d-eac1-450a-a99e-640703b2f18a None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:32.396041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad6a9d-9531-470b-9bf9-84d74a114e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:32.396854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad6a9d-9531-470b-9bf9-84d74a114e72 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:32.397290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad6a9d-9531-470b-9bf9-84d74a114e72 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:32.398044 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad6a9d-9531-470b-9bf9-84d74a114e72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:32.409930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad6a9d-9531-470b-9bf9-84d74a114e72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:32.411434 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad6a9d-9531-470b-9bf9-84d74a114e72 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:32.432620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-21ad6a9d-9531-470b-9bf9-84d74a114e72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:32.432620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:32.432620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:32.432620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:32.432620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:32.432620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:32.432620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:32.432620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:32.432620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:32.432620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:32.432620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:32.432620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:32.432620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:32.432620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:32.432620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:32.433636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:32.433636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:32.433636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:32.433636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:32.433636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:32.433636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:32.433636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:32.433636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:32.433636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:32.433636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:32.433636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:32.433636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:32.433636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:32.433636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:32.433636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:32.433636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:32.433636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:32.434538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:32.434538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:32.434538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:32.434538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:32.434538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 436/866] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:32.439917 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdc25e-11e8-4ba9-b4e6-f5a2f201ec35 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:32.548176 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdc25e-11e8-4ba9-b4e6-f5a2f201ec35 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:32.582734 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392091bc-a53c-48be-9191-0de4b6725a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:32.583400 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392091bc-a53c-48be-9191-0de4b6725a07 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:32.583687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392091bc-a53c-48be-9191-0de4b6725a07 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:32.583963 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392091bc-a53c-48be-9191-0de4b6725a07 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:32.585232 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392091bc-a53c-48be-9191-0de4b6725a07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:32.585603 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392091bc-a53c-48be-9191-0de4b6725a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:32.587034 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392091bc-a53c-48be-9191-0de4b6725a07 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:32.599746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 431/867] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:32.606270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad6a9d-9531-470b-9bf9-84d74a114e72 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:32.630676 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:32.720539 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad6a9d-9531-470b-9bf9-84d74a114e72 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:32.744358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103caa28-f47b-4aaa-a6af-523fda86de9f None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:32.744689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103caa28-f47b-4aaa-a6af-523fda86de9f None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:32.744928 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103caa28-f47b-4aaa-a6af-523fda86de9f None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:32.746563 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 432/868] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:32.751628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f69926-0d8f-45f1-8d33-73afb28bed96 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:32.752000 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f69926-0d8f-45f1-8d33-73afb28bed96 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:32.752275 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f69926-0d8f-45f1-8d33-73afb28bed96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:32.759693 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ceef37-665f-4c48-826d-4205cbb0f2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:32.760493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ceef37-665f-4c48-826d-4205cbb0f2a5 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:32.760778 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ceef37-665f-4c48-826d-4205cbb0f2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:32.761056 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ceef37-665f-4c48-826d-4205cbb0f2a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:32.764945 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:32.768512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ceef37-665f-4c48-826d-4205cbb0f2a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:32.770009 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ceef37-665f-4c48-826d-4205cbb0f2a5 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:32.774153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-47f69926-0d8f-45f1-8d33-73afb28bed96 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:32.779964 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-47f69926-0d8f-45f1-8d33-73afb28bed96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:32.785070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-22ceef37-665f-4c48-826d-4205cbb0f2a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:32.785070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:32.785070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:32.785070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:32.785070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:32.785070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:32.785070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:32.785070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:32.785070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:32.785070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:32.785070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:32.785070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:32.785070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:32.785070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:32.785070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:32.785974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:32.785974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:32.785974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:32.785974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:32.785974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:32.785974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:32.785974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:32.785974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:32.785974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:32.785974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:32.785974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:32.785974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:32.785974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:32.785974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:32.785974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:32.785974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:32.785974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:32.787270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:32.787270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:32.787270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:32.787270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:32.787270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:32.787270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:32.787270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:32.787270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:32.787270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 437/869] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:32.792439 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ceef37-665f-4c48-826d-4205cbb0f2a5 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:32.870933 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 433/870] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:32.889558 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:32.893058 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f69926-0d8f-45f1-8d33-73afb28bed96 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:32.937089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ceef37-665f-4c48-826d-4205cbb0f2a5 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:32.981717 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2734580-cb60-44ce-a668-ac74868cd21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:32.982379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2734580-cb60-44ce-a668-ac74868cd21b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:32.982833 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2734580-cb60-44ce-a668-ac74868cd21b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:32.983126 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2734580-cb60-44ce-a668-ac74868cd21b None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:32.983937 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2734580-cb60-44ce-a668-ac74868cd21b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:32.984638 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2734580-cb60-44ce-a668-ac74868cd21b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:32.986413 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2734580-cb60-44ce-a668-ac74868cd21b None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:33.003034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 438/871] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:33.004139 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f69926-0d8f-45f1-8d33-73afb28bed96 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:33.011882 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2734580-cb60-44ce-a668-ac74868cd21b None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:33.046815 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd33d9-c14e-4cd5-b835-1c2bc06ec693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:33.047591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd33d9-c14e-4cd5-b835-1c2bc06ec693 None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:33.047945 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd33d9-c14e-4cd5-b835-1c2bc06ec693 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:33.048291 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd33d9-c14e-4cd5-b835-1c2bc06ec693 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:33.049104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd33d9-c14e-4cd5-b835-1c2bc06ec693 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:33.050596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd33d9-c14e-4cd5-b835-1c2bc06ec693 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:33.054187 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:33.113960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2734580-cb60-44ce-a668-ac74868cd21b None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:33.126536 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 434/872] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 19:39:32 2022] POST /identity/v3/services => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:39:33.275655 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:33.286978 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6d2e0-fae9-4cd4-a0af-6fe2a4880d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:33.292984 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6d2e0-fae9-4cd4-a0af-6fe2a4880d0b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:33.292984 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6d2e0-fae9-4cd4-a0af-6fe2a4880d0b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:33.292984 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6d2e0-fae9-4cd4-a0af-6fe2a4880d0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:33.292984 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6d2e0-fae9-4cd4-a0af-6fe2a4880d0b None admin] RBAC: Adding query filter params (role.id=76bd0cf7bf094e4fa3db121b96215004, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=2cc53095a45e4136b37fb6e4e677eff9) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:33.292984 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6d2e0-fae9-4cd4-a0af-6fe2a4880d0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:33.292984 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6d2e0-fae9-4cd4-a0af-6fe2a4880d0b None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:33.299318 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 439/873] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:39:33 2022] GET /identity/v3/role_assignments?user.id=2cc53095a45e4136b37fb6e4e677eff9&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=76bd0cf7bf094e4fa3db121b96215004 => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:33.795435 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c0c59-d439-460b-9a6b-649e41a9cdd4 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:33.795739 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c0c59-d439-460b-9a6b-649e41a9cdd4 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:33.796010 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c0c59-d439-460b-9a6b-649e41a9cdd4 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:33.797574 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 435/874] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:33.802947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459fe84-95dd-485f-87be-8202b27dca52 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:33.804070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459fe84-95dd-485f-87be-8202b27dca52 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:33.804788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459fe84-95dd-485f-87be-8202b27dca52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:33.822178 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-b459fe84-95dd-485f-87be-8202b27dca52 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:33.823648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-b459fe84-95dd-485f-87be-8202b27dca52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:33.901229 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 440/875] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:33 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:33.919079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c0c59-d439-460b-9a6b-649e41a9cdd4 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:34.030218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c0c59-d439-460b-9a6b-649e41a9cdd4 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:34.067066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c16228-cb66-46a2-9124-1bb86909a593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:34.068208 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c16228-cb66-46a2-9124-1bb86909a593 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:34.068695 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c16228-cb66-46a2-9124-1bb86909a593 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:34.069624 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c16228-cb66-46a2-9124-1bb86909a593 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:34.080843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c16228-cb66-46a2-9124-1bb86909a593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:34.090109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-d0c16228-cb66-46a2-9124-1bb86909a593 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 19:39:34.090109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:34.090109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:34.090109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:34.090109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:34.090109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:34.090109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:34.090109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:34.090109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:34.090109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:34.090109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:34.090109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:34.090109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:34.090109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:34.090109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:34.090109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:34.091073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:34.091073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:34.091073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:34.091073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:34.091073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:34.091073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:34.091073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:34.091073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:34.091073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:34.091073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:34.091073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:34.091073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:34.091073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:34.091073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:34.091073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:34.091073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:34.091943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:34.091943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:34.091943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:34.091943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:34.091943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:34.091943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:34.091943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:34.091943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:34.091943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:34.091943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:34.091943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 19:39:34.091943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:34.094767 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 436/876] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Jun 23 19:39:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:34.101729 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459fe84-95dd-485f-87be-8202b27dca52 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:34.212722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459fe84-95dd-485f-87be-8202b27dca52 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:34.236824 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:34.249075 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467d08d-0e60-45c5-b55b-0c0065e75350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:34.250029 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467d08d-0e60-45c5-b55b-0c0065e75350 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:34.254380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467d08d-0e60-45c5-b55b-0c0065e75350 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:34.254380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467d08d-0e60-45c5-b55b-0c0065e75350 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:34.254380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467d08d-0e60-45c5-b55b-0c0065e75350 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:34.254380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467d08d-0e60-45c5-b55b-0c0065e75350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:34.254380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467d08d-0e60-45c5-b55b-0c0065e75350 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:34.262024 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 441/877] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 23 19:39:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:34.267369 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c16228-cb66-46a2-9124-1bb86909a593 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:34.330393 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:34.379223 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c16228-cb66-46a2-9124-1bb86909a593 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:34.415938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca488055-4f22-45ad-b2a3-950861bf4f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:34.416740 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca488055-4f22-45ad-b2a3-950861bf4f7e None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:34.417082 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca488055-4f22-45ad-b2a3-950861bf4f7e None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:34.417390 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca488055-4f22-45ad-b2a3-950861bf4f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:34.428501 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca488055-4f22-45ad-b2a3-950861bf4f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:34.430591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca488055-4f22-45ad-b2a3-950861bf4f7e None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:34.448914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-ca488055-4f22-45ad-b2a3-950861bf4f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:34.448914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:34.448914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:34.448914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:34.448914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:34.448914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:34.448914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:34.448914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:34.448914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:34.448914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:34.448914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:34.448914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:34.448914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:34.448914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:34.448914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:34.450094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:34.450094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:34.450094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:34.450094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:34.450094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:34.450094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:34.450094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:34.450094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:34.450094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:34.450094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:34.450094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:34.450094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:34.450094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:34.450094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:34.450094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:34.450094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:34.450094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:34.451216 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:34.451216 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:34.451216 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:34.451216 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:34.452922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137875c-2a3f-4f08-9832-e04ae8175fa5 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:34.453384 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137875c-2a3f-4f08-9832-e04ae8175fa5 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:34.453767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137875c-2a3f-4f08-9832-e04ae8175fa5 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:34.455202 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 437/878] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:34.455562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 442/879] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:34.456591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca488055-4f22-45ad-b2a3-950861bf4f7e None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:34.461770 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaa985-da1a-4030-a8ca-a6beecc21584 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:34.462234 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaa985-da1a-4030-a8ca-a6beecc21584 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:34.462586 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaa985-da1a-4030-a8ca-a6beecc21584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:34.479903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-66aaa985-da1a-4030-a8ca-a6beecc21584 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:34.481245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-66aaa985-da1a-4030-a8ca-a6beecc21584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:34.561445 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 443/880] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:34 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:34.564051 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca488055-4f22-45ad-b2a3-950861bf4f7e None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:34.574034 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:34.578797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaa985-da1a-4030-a8ca-a6beecc21584 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:34.599762 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4047b-f081-4096-a23b-542e4c1d3015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:34.601507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4047b-f081-4096-a23b-542e4c1d3015 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:34.601810 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4047b-f081-4096-a23b-542e4c1d3015 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:34.602082 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4047b-f081-4096-a23b-542e4c1d3015 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:34.603013 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4047b-f081-4096-a23b-542e4c1d3015 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:34.603192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4047b-f081-4096-a23b-542e4c1d3015 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:34.604697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4047b-f081-4096-a23b-542e4c1d3015 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:34.623451 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 438/881] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:34.624734 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4047b-f081-4096-a23b-542e4c1d3015 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:34.688436 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaa985-da1a-4030-a8ca-a6beecc21584 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:34.703416 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:34.724894 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90fa5f-08bb-45e5-a442-804deb1d63df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:34.725901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90fa5f-08bb-45e5-a442-804deb1d63df None admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:34.726422 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90fa5f-08bb-45e5-a442-804deb1d63df None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:34.726944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90fa5f-08bb-45e5-a442-804deb1d63df None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:34.727220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4047b-f081-4096-a23b-542e4c1d3015 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:34.728086 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90fa5f-08bb-45e5-a442-804deb1d63df None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:34.729670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90fa5f-08bb-45e5-a442-804deb1d63df None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:34.763144 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7843f03-7327-4db5-b3d1-81599d44f598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:34.764006 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7843f03-7327-4db5-b3d1-81599d44f598 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:34.764286 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7843f03-7327-4db5-b3d1-81599d44f598 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:34.764561 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7843f03-7327-4db5-b3d1-81599d44f598 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:34.771775 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7843f03-7327-4db5-b3d1-81599d44f598 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:34.773944 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7843f03-7327-4db5-b3d1-81599d44f598 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:34.789277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-e7843f03-7327-4db5-b3d1-81599d44f598 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 19:39:34.789277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:34.789277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:34.789277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:34.789277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:34.789277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:34.789277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:34.789277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:34.789277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:34.789277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:34.789277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:34.789277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:34.789277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:34.789277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:34.789277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:34.789277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:34.790229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:34.790229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:34.790229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:34.790229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:34.790229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:34.790229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:34.790229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:34.790229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:34.790229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:34.790229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:34.790229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:34.790229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:34.790229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:34.790229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:34.790229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:34.790229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:34.790229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:34.790229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:34.791194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:34.791194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:34.791194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:34.791194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:34.791194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:34.791194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:34.791194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:34.791194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:34.791194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 19:39:34.791194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:34.793232 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 439/882] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 23 19:39:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:34.796260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7843f03-7327-4db5-b3d1-81599d44f598 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:34.811082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 444/883] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 19:39:34 2022] POST /identity/v3/services => generated 269 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:39:34.835690 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:34.931422 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7843f03-7327-4db5-b3d1-81599d44f598 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:34.981087 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35558d0-710a-46c8-b63b-561dd1ba47e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:34.982043 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35558d0-710a-46c8-b63b-561dd1ba47e6 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:34.982502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35558d0-710a-46c8-b63b-561dd1ba47e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:34.982927 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35558d0-710a-46c8-b63b-561dd1ba47e6 None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:34.983909 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35558d0-710a-46c8-b63b-561dd1ba47e6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:34.984376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35558d0-710a-46c8-b63b-561dd1ba47e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:34.985992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35558d0-710a-46c8-b63b-561dd1ba47e6 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:35.006289 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 440/884] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Jun 23 19:39:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:35.012473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90fa5f-08bb-45e5-a442-804deb1d63df None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:35.123051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90fa5f-08bb-45e5-a442-804deb1d63df None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:35.158779 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542ea28-690c-4ab4-91e3-9393556d1d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:35.159398 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542ea28-690c-4ab4-91e3-9393556d1d04 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:35.159683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542ea28-690c-4ab4-91e3-9393556d1d04 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:35.159959 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542ea28-690c-4ab4-91e3-9393556d1d04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:35.206771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:35.233769 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542ea28-690c-4ab4-91e3-9393556d1d04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:35.235219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542ea28-690c-4ab4-91e3-9393556d1d04 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:35.345322 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 445/885] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:39:35 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 19:39:35.350792 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35558d0-710a-46c8-b63b-561dd1ba47e6 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:35.359812 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cff0e-0764-44f6-b436-7578ffe717b4 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:35.360102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cff0e-0764-44f6-b436-7578ffe717b4 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:35.360967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cff0e-0764-44f6-b436-7578ffe717b4 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:35.363067 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 446/886] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:39:35.370171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e8ac0-3f61-450d-832a-bf91920702df None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:35.370472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e8ac0-3f61-450d-832a-bf91920702df None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:35.370757 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e8ac0-3f61-450d-832a-bf91920702df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:35.390580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-5c7e8ac0-3f61-450d-832a-bf91920702df None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:35.392099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-5c7e8ac0-3f61-450d-832a-bf91920702df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:35.446702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:35.465198 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 447/887] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 19:39:35.466748 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750b94e-9273-4fbe-b704-4d3fb2737b25 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:35.467039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750b94e-9273-4fbe-b704-4d3fb2737b25 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:35.467316 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750b94e-9273-4fbe-b704-4d3fb2737b25 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:35.472649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 448/888] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:35.472799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35558d0-710a-46c8-b63b-561dd1ba47e6 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:35.473768 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab94a5-ae3e-417f-8db4-94d60f8cc62a None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:35.474050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab94a5-ae3e-417f-8db4-94d60f8cc62a None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:35.474326 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab94a5-ae3e-417f-8db4-94d60f8cc62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:35.487790 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:35.492005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-22ab94a5-ae3e-417f-8db4-94d60f8cc62a None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:35.493210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-22ab94a5-ae3e-417f-8db4-94d60f8cc62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:35.512689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c4591-ce4c-45e6-85aa-1694229cc7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:35.513516 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c4591-ce4c-45e6-85aa-1694229cc7c7 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:35.513805 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c4591-ce4c-45e6-85aa-1694229cc7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:35.514086 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c4591-ce4c-45e6-85aa-1694229cc7c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:35.525066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c4591-ce4c-45e6-85aa-1694229cc7c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:35.526526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c4591-ce4c-45e6-85aa-1694229cc7c7 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:35.544396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-3d3c4591-ce4c-45e6-85aa-1694229cc7c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:35.544396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:35.544396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:35.544396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:35.544396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:35.544396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:35.544396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:35.544396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:35.544396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:35.544396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:35.544396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:35.544396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:35.544396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:35.544396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:35.544396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:35.545374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:35.545374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:35.545374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:35.545374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:35.545374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:35.545374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:35.545374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:35.545374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:35.545374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:35.545374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:35.545374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:35.545374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:35.545374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:35.545374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:35.545374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:35.545374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:35.545374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:35.551268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:35.551268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:35.551268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:35.551268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:35.551268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 441/889] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:35.551268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c4591-ce4c-45e6-85aa-1694229cc7c7 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:35.565545 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 449/890] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 19:39:35.566754 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab94a5-ae3e-417f-8db4-94d60f8cc62a None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:35.668764 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c4591-ce4c-45e6-85aa-1694229cc7c7 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:35.670691 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab94a5-ae3e-417f-8db4-94d60f8cc62a None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:35.706806 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaf81d-4f8f-4399-af5d-dba51e44d8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:35.707080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a48460-1fe3-440d-a59d-b7878d44744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:35.707527 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaf81d-4f8f-4399-af5d-dba51e44d8b9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:35.707644 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a48460-1fe3-440d-a59d-b7878d44744f None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:35.707814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaf81d-4f8f-4399-af5d-dba51e44d8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:35.707989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a48460-1fe3-440d-a59d-b7878d44744f None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:35.708082 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaf81d-4f8f-4399-af5d-dba51e44d8b9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:35.708228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a48460-1fe3-440d-a59d-b7878d44744f None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:35.708725 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aaf81d-4f8f-4399-af5d-dba51e44d8b9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:35.708932 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a48460-1fe3-440d-a59d-b7878d44744f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:35.709275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a48460-1fe3-440d-a59d-b7878d44744f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:35.710657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aaf81d-4f8f-4399-af5d-dba51e44d8b9 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:35.711220 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a48460-1fe3-440d-a59d-b7878d44744f None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:35.712421 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:35.712789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:35.723261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-d2aaf81d-4f8f-4399-af5d-dba51e44d8b9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 19:39:35.723261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:35.723261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:35.723261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:35.723261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:35.723261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:35.723261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:35.723261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:35.723261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 19:39:35.723261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:35.723261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:35.723261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:35.723261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:35.723261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:35.723261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:35.723261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:35.723261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:35.729089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:35.729089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:35.729089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:35.729089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:35.729089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:35.729089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:35.729089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:35.729089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:35.729089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:35.729089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:35.729089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:35.729089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:35.729089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:35.729089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:35.729089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:35.729089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:35.730103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:35.730103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:35.730103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:35.730103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:35.730103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:35.730103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:35.730103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:35.730103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:35.730103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:35.730103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:35.730103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:35.730103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:35.730103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 19:39:35.730103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:35.730834 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 450/891] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:35.730915 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 442/892] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:39:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:35.730984 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a48460-1fe3-440d-a59d-b7878d44744f None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:35.732062 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaf81d-4f8f-4399-af5d-dba51e44d8b9 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:35.836148 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a48460-1fe3-440d-a59d-b7878d44744f None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:35.837455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaf81d-4f8f-4399-af5d-dba51e44d8b9 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:35.872439 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2685b2f-c191-47c3-9530-01e77971b2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:35.873416 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2685b2f-c191-47c3-9530-01e77971b2eb None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:35.873798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2685b2f-c191-47c3-9530-01e77971b2eb None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:35.874142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2685b2f-c191-47c3-9530-01e77971b2eb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:35.874554 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbcebf-ac63-4776-8a36-2be85837f1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:35.874943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2685b2f-c191-47c3-9530-01e77971b2eb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:35.875871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbcebf-ac63-4776-8a36-2be85837f1b5 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:35.876331 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbcebf-ac63-4776-8a36-2be85837f1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:35.876480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2685b2f-c191-47c3-9530-01e77971b2eb None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:35.876932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbcebf-ac63-4776-8a36-2be85837f1b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:35.886067 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dbcebf-ac63-4776-8a36-2be85837f1b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:35.887585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dbcebf-ac63-4776-8a36-2be85837f1b5 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:35.889775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-d2685b2f-c191-47c3-9530-01e77971b2eb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 19:39:35.889775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:35.889775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:35.889775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:35.889775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:35.889775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:35.889775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:35.889775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:35.889775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 19:39:35.889775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:35.889775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:35.889775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:35.889775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:35.889775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:35.889775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:35.889775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:35.889775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:35.890771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:35.890771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:35.890771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:35.890771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:35.890771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:35.890771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:35.890771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:35.890771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:35.890771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:35.890771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:35.890771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:35.890771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:35.890771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:35.890771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:35.890771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:35.890771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:35.891609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:35.891609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:35.891609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:35.891609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:35.891609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:35.891609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:35.891609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:35.891609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:35.891609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:35.891609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:35.891609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:35.891609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:35.891609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 19:39:35.891609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:35.891609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 451/893] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 19:39:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:35.893105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2685b2f-c191-47c3-9530-01e77971b2eb None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:35.909971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-c1dbcebf-ac63-4776-8a36-2be85837f1b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:35.909971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:35.909971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:35.909971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:35.909971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:35.909971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:35.909971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:35.909971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:35.909971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:35.909971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:35.909971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:35.909971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:35.909971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:35.909971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:35.909971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:35.910880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:35.910880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:35.910880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:35.910880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:35.910880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:35.910880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:35.910880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:35.910880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:35.910880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:35.910880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:35.910880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:35.910880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:35.910880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:35.910880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:35.910880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:35.910880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:35.910880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:35.911774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:35.911774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:35.911774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:35.911774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:35.911774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:35.911774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:35.911774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:35.911774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:35.911774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 443/894] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:35.913068 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbcebf-ac63-4776-8a36-2be85837f1b5 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:35.965102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:35.979046 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:36.010105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2685b2f-c191-47c3-9530-01e77971b2eb None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:36.026544 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbcebf-ac63-4776-8a36-2be85837f1b5 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:36.045227 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74431fd6-0c28-490d-8e82-f1a5a36172b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:36.045856 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74431fd6-0c28-490d-8e82-f1a5a36172b1 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:36.046134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74431fd6-0c28-490d-8e82-f1a5a36172b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:36.046408 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74431fd6-0c28-490d-8e82-f1a5a36172b1 None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:36.047114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74431fd6-0c28-490d-8e82-f1a5a36172b1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:36.047420 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74431fd6-0c28-490d-8e82-f1a5a36172b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:36.048784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74431fd6-0c28-490d-8e82-f1a5a36172b1 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:36.058472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 452/895] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:39:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:36.059326 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74431fd6-0c28-490d-8e82-f1a5a36172b1 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:36.062215 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a63b6e-919a-46c9-842d-9ecf9ff39edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:36.062885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a63b6e-919a-46c9-842d-9ecf9ff39edd None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:36.063179 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a63b6e-919a-46c9-842d-9ecf9ff39edd None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:36.063462 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a63b6e-919a-46c9-842d-9ecf9ff39edd None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:36.064179 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a63b6e-919a-46c9-842d-9ecf9ff39edd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:36.064491 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a63b6e-919a-46c9-842d-9ecf9ff39edd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:36.065904 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a63b6e-919a-46c9-842d-9ecf9ff39edd None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:36.075847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 444/896] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 23 19:39:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:36.075847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a63b6e-919a-46c9-842d-9ecf9ff39edd None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:36.171218 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74431fd6-0c28-490d-8e82-f1a5a36172b1 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:36.174418 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a63b6e-919a-46c9-842d-9ecf9ff39edd None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:36.196498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:36.199539 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:36.208524 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff07bc-b4e5-42b3-9bae-67da796ceab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:36.210869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff07bc-b4e5-42b3-9bae-67da796ceab4 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:36.211357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff07bc-b4e5-42b3-9bae-67da796ceab4 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:36.211723 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76006a-5fa5-4bf0-acd8-bbf77615c4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:36.212026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff07bc-b4e5-42b3-9bae-67da796ceab4 None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:36.212376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76006a-5fa5-4bf0-acd8-bbf77615c4ab None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:36.212658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76006a-5fa5-4bf0-acd8-bbf77615c4ab None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:36.212934 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76006a-5fa5-4bf0-acd8-bbf77615c4ab None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:36.213585 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff07bc-b4e5-42b3-9bae-67da796ceab4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:36.213690 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76006a-5fa5-4bf0-acd8-bbf77615c4ab None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:36.213950 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76006a-5fa5-4bf0-acd8-bbf77615c4ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:36.214359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff07bc-b4e5-42b3-9bae-67da796ceab4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:36.215361 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76006a-5fa5-4bf0-acd8-bbf77615c4ab None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:36.216241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff07bc-b4e5-42b3-9bae-67da796ceab4 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:36.220041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 445/897] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:39:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:36.220874 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76006a-5fa5-4bf0-acd8-bbf77615c4ab None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:36.231472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 453/898] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:36.232501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff07bc-b4e5-42b3-9bae-67da796ceab4 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:36.330998 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76006a-5fa5-4bf0-acd8-bbf77615c4ab None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:36.343849 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff07bc-b4e5-42b3-9bae-67da796ceab4 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:36.367176 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d687b5a-45c5-4981-83f7-0bf7c85ff551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:36.367844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d687b5a-45c5-4981-83f7-0bf7c85ff551 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:36.368131 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d687b5a-45c5-4981-83f7-0bf7c85ff551 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:36.368410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d687b5a-45c5-4981-83f7-0bf7c85ff551 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:36.369113 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d687b5a-45c5-4981-83f7-0bf7c85ff551 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:36.369457 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d687b5a-45c5-4981-83f7-0bf7c85ff551 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:36.370821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d687b5a-45c5-4981-83f7-0bf7c85ff551 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:36.375822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 446/899] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 23 19:39:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:36.380640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977aaf85-373c-4528-a4e8-77c7f42432f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:36.381392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977aaf85-373c-4528-a4e8-77c7f42432f5 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:36.381861 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977aaf85-373c-4528-a4e8-77c7f42432f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:36.382454 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977aaf85-373c-4528-a4e8-77c7f42432f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:36.382545 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d687b5a-45c5-4981-83f7-0bf7c85ff551 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:36.382933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977aaf85-373c-4528-a4e8-77c7f42432f5 None admin] RBAC: Adding query filter params (interface=public, service_id=b46e3b2ab7de4993a5616f6ef6c770c1, region_id=RegionOne) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:36.383246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977aaf85-373c-4528-a4e8-77c7f42432f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:36.384658 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977aaf85-373c-4528-a4e8-77c7f42432f5 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:36.398877 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 454/900] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 23 19:39:36 2022] GET /identity/v3/endpoints?service_id=b46e3b2ab7de4993a5616f6ef6c770c1&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:36.400311 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977aaf85-373c-4528-a4e8-77c7f42432f5 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:36.463381 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:36.467167 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:36.528370 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d687b5a-45c5-4981-83f7-0bf7c85ff551 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:36.542241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977aaf85-373c-4528-a4e8-77c7f42432f5 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:36.577953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c6e09-f0b7-4375-866d-12eaab2b46bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:36.578620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c6e09-f0b7-4375-866d-12eaab2b46bb None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:36.578916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c6e09-f0b7-4375-866d-12eaab2b46bb None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:36.579197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c6e09-f0b7-4375-866d-12eaab2b46bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:36.580032 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c6e09-f0b7-4375-866d-12eaab2b46bb None admin] RBAC: Adding query filter params (role.id=cebd4ad2da474d8b9183c4a7587119c8, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=fec6c1cbf48a44f9922bd82e714861c1) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:36.580348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c6e09-f0b7-4375-866d-12eaab2b46bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:36.581815 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c6e09-f0b7-4375-866d-12eaab2b46bb None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:36.582302 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c69fd-4d8e-4e7f-8732-5f3090d94dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:36.583090 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c69fd-4d8e-4e7f-8732-5f3090d94dae None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:36.583478 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c69fd-4d8e-4e7f-8732-5f3090d94dae None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:36.583861 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c69fd-4d8e-4e7f-8732-5f3090d94dae None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:36.585346 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c69fd-4d8e-4e7f-8732-5f3090d94dae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:36.586907 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c69fd-4d8e-4e7f-8732-5f3090d94dae None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:36.589365 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 447/901] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:39:36 2022] GET /identity/v3/role_assignments?user.id=fec6c1cbf48a44f9922bd82e714861c1&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=cebd4ad2da474d8b9183c4a7587119c8 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:36.598130 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 455/902] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 23 19:39:36 2022] GET /identity/v3/services => generated 1268 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:39:36.924968 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9a8ea-f4c7-4c57-92a6-6cb355bfd99f None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:36.925353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9a8ea-f4c7-4c57-92a6-6cb355bfd99f None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:36.925559 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9a8ea-f4c7-4c57-92a6-6cb355bfd99f None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:36.927193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 448/903] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:36.932433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1a9af-363d-4fec-9dec-3436eabe54cb None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:36.932729 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1a9af-363d-4fec-9dec-3436eabe54cb None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:36.933012 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1a9af-363d-4fec-9dec-3436eabe54cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:36.950788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-07f1a9af-363d-4fec-9dec-3436eabe54cb None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:36.951987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-07f1a9af-363d-4fec-9dec-3436eabe54cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:37.029416 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 456/904] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:37.052267 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9a8ea-f4c7-4c57-92a6-6cb355bfd99f None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:37.165432 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9a8ea-f4c7-4c57-92a6-6cb355bfd99f None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:37.180868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:37.211912 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425deb8-9329-42f3-bc58-c13c4aa76f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:37.212731 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425deb8-9329-42f3-bc58-c13c4aa76f4a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:37.213013 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425deb8-9329-42f3-bc58-c13c4aa76f4a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:37.213318 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425deb8-9329-42f3-bc58-c13c4aa76f4a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:37.213977 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425deb8-9329-42f3-bc58-c13c4aa76f4a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:37.215359 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425deb8-9329-42f3-bc58-c13c4aa76f4a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:37.228657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-9425deb8-9329-42f3-bc58-c13c4aa76f4a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 19:39:37.228657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:37.228657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:37.228657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:37.228657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:37.228657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:37.228657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:37.228657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:37.228657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 19:39:37.228657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:37.228657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:37.228657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:37.228657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:37.228657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:37.228657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:37.228657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:37.230824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:37.230824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:37.230824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:37.230824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:37.230824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:37.230824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:37.230824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:37.230824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:37.230824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:37.230824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:37.230824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:37.230824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:37.230824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:37.230824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:37.230824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:37.230824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:37.238548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:37.238548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:37.238548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:37.238548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:37.238548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:37.238548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:37.238548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:37.238548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:37.238548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:37.238548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:37.238548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:37.238548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:37.238548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:37.238548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 19:39:37.238548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:37.238548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 449/905] 10.222.0.13 () {56 vars in 1132 bytes} [Thu Jun 23 19:39:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:37.240507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1a9af-363d-4fec-9dec-3436eabe54cb None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:37.278817 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:37.339621 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1a9af-363d-4fec-9dec-3436eabe54cb None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:37.376847 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166803f-bb4d-41b5-b80a-ed1fe80a1224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:37.377569 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166803f-bb4d-41b5-b80a-ed1fe80a1224 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:37.377889 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166803f-bb4d-41b5-b80a-ed1fe80a1224 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:37.378233 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166803f-bb4d-41b5-b80a-ed1fe80a1224 None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:37.378958 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166803f-bb4d-41b5-b80a-ed1fe80a1224 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:37.379271 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166803f-bb4d-41b5-b80a-ed1fe80a1224 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:37.380653 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166803f-bb4d-41b5-b80a-ed1fe80a1224 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:37.386908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 457/906] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 19:39:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:37.392583 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425deb8-9329-42f3-bc58-c13c4aa76f4a None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:37.498762 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425deb8-9329-42f3-bc58-c13c4aa76f4a None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:37.532751 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638952b-be91-4ddd-9695-5f9de87ed68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:37.533446 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638952b-be91-4ddd-9695-5f9de87ed68e None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:37.533732 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638952b-be91-4ddd-9695-5f9de87ed68e None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:37.534012 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638952b-be91-4ddd-9695-5f9de87ed68e None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:37.534719 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638952b-be91-4ddd-9695-5f9de87ed68e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:37.535025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638952b-be91-4ddd-9695-5f9de87ed68e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:37.536395 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638952b-be91-4ddd-9695-5f9de87ed68e None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:37.542288 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 450/907] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 19:39:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:37.555382 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166803f-bb4d-41b5-b80a-ed1fe80a1224 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:37.663232 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166803f-bb4d-41b5-b80a-ed1fe80a1224 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:37.665608 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:37.698961 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1ea06-9897-4bed-8536-153064800d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:37.699666 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1ea06-9897-4bed-8536-153064800d57 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:37.699956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1ea06-9897-4bed-8536-153064800d57 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:37.700242 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1ea06-9897-4bed-8536-153064800d57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:37.701029 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1ea06-9897-4bed-8536-153064800d57 None admin] RBAC: Adding query filter params (interface=public, service_id=c09f1228e92549c4bb81441e22ca386a, region_id=RegionOne) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:37.701369 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1ea06-9897-4bed-8536-153064800d57 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:37.702745 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1ea06-9897-4bed-8536-153064800d57 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:37.708147 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 458/908] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 23 19:39:37 2022] GET /identity/v3/endpoints?service_id=c09f1228e92549c4bb81441e22ca386a&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:37.714000 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638952b-be91-4ddd-9695-5f9de87ed68e None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:37.760115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:37.823079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638952b-be91-4ddd-9695-5f9de87ed68e None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:37.859232 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fdba5-aefa-409e-bcb1-6b354c745ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:37.860009 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fdba5-aefa-409e-bcb1-6b354c745ea2 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:37.860297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fdba5-aefa-409e-bcb1-6b354c745ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:37.860577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fdba5-aefa-409e-bcb1-6b354c745ea2 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:37.861288 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fdba5-aefa-409e-bcb1-6b354c745ea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:37.862675 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fdba5-aefa-409e-bcb1-6b354c745ea2 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:37.868891 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 451/909] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 23 19:39:37 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:39:38.526566 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714409ce-6e0f-4adc-a2de-600ef674d76a None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:38.526566 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714409ce-6e0f-4adc-a2de-600ef674d76a None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:38.526566 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714409ce-6e0f-4adc-a2de-600ef674d76a None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:38.526566 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 459/910] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:38.538494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b871c0-cd06-43e4-a5ce-88f18678393e None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:38.538494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b871c0-cd06-43e4-a5ce-88f18678393e None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:38.538494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b871c0-cd06-43e4-a5ce-88f18678393e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:38.551455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-16b871c0-cd06-43e4-a5ce-88f18678393e None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:38.552922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-16b871c0-cd06-43e4-a5ce-88f18678393e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:38.622428 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 452/911] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:38.645705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714409ce-6e0f-4adc-a2de-600ef674d76a None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:38.754992 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714409ce-6e0f-4adc-a2de-600ef674d76a None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:38.777332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd8a23-6d4c-41bb-bc62-dda2ad2b849c None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:38.777932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd8a23-6d4c-41bb-bc62-dda2ad2b849c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:38.778410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd8a23-6d4c-41bb-bc62-dda2ad2b849c None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:38.780401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 453/912] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:39:38.785368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c313d-36c5-47f3-b59d-d6f2a4b54fc9 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:38.785869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c313d-36c5-47f3-b59d-d6f2a4b54fc9 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:38.786345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c313d-36c5-47f3-b59d-d6f2a4b54fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:38.791485 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd523419-4f46-4362-a5c4-670f32154806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:38.792156 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd523419-4f46-4362-a5c4-670f32154806 None admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:38.792445 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd523419-4f46-4362-a5c4-670f32154806 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:38.792728 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd523419-4f46-4362-a5c4-670f32154806 None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:38.793503 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd523419-4f46-4362-a5c4-670f32154806 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:38.794880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd523419-4f46-4362-a5c4-670f32154806 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:38.805735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-ba8c313d-36c5-47f3-b59d-d6f2a4b54fc9 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:38.806991 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ba8c313d-36c5-47f3-b59d-d6f2a4b54fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:38.835890 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:38.871297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 460/913] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 19:39:38 2022] POST /identity/v3/services => generated 241 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:39:38.871297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a66d12-5e2e-49d9-a0bc-6636d9cd2636 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:38.871297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a66d12-5e2e-49d9-a0bc-6636d9cd2636 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:38.871297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a66d12-5e2e-49d9-a0bc-6636d9cd2636 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:38.871297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 461/914] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:38.879213 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b2a4b-3e10-4bd2-a66a-e52f420e918e None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:38.879644 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b2a4b-3e10-4bd2-a66a-e52f420e918e None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:38.880036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b2a4b-3e10-4bd2-a66a-e52f420e918e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:38.902656 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 454/915] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 19:39:38.907290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-953b2a4b-3e10-4bd2-a66a-e52f420e918e None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:38.908891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-953b2a4b-3e10-4bd2-a66a-e52f420e918e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:38.923808 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c313d-36c5-47f3-b59d-d6f2a4b54fc9 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:38.936162 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:38.994246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 462/916] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:39.030735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b2a4b-3e10-4bd2-a66a-e52f420e918e None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:39.071704 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c313d-36c5-47f3-b59d-d6f2a4b54fc9 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:39.118786 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb645174-2cf9-477e-af25-6f3427d7775a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:39.119883 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb645174-2cf9-477e-af25-6f3427d7775a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:39.120366 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb645174-2cf9-477e-af25-6f3427d7775a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:39.120906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb645174-2cf9-477e-af25-6f3427d7775a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:39.121838 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb645174-2cf9-477e-af25-6f3427d7775a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:39.123416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb645174-2cf9-477e-af25-6f3427d7775a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:39.136852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-fb645174-2cf9-477e-af25-6f3427d7775a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 19:39:39.136852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:39.136852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:39.136852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:39.136852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:39.136852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:39.136852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:39.136852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:39.136852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 19:39:39.136852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:39.136852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:39.136852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:39.136852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:39.136852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:39.136852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:39.136852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:39.136852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:39.137942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:39.137942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:39.137942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:39.137942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:39.137942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:39.137942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:39.137942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:39.137942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:39.137942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:39.137942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:39.137942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:39.137942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:39.137942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:39.137942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:39.137942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:39.137942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:39.138789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:39.138789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:39.138789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:39.138789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:39.138789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:39.138789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:39.138789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:39.138789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:39.138789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:39.138789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:39.138789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:39.138789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:39.138789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 19:39:39.138789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:39.141628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 455/917] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:39:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:39.154397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb645174-2cf9-477e-af25-6f3427d7775a None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:39.172676 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b2a4b-3e10-4bd2-a66a-e52f420e918e None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:39.213624 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:39.229717 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d05f89-75a7-4945-a6b6-dfd39c70d6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:39.230553 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d05f89-75a7-4945-a6b6-dfd39c70d6a1 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:39.232676 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d05f89-75a7-4945-a6b6-dfd39c70d6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:39.232676 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d05f89-75a7-4945-a6b6-dfd39c70d6a1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:39.269183 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d05f89-75a7-4945-a6b6-dfd39c70d6a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:39.271547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-88d05f89-75a7-4945-a6b6-dfd39c70d6a1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 19:39:39.271547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:39.271547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:39.271547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:39.271547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:39.271547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:39.271547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:39.271547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:39.271547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:39.271547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:39.271547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:39.271547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:39.271547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:39.271547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:39.271547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:39.271547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:39.272534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:39.272534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:39.272534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:39.272534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:39.272534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:39.272534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:39.272534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:39.272534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:39.272534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:39.272534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:39.272534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:39.272534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:39.272534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:39.272534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:39.272534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:39.272534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:39.273393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:39.273393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:39.273393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:39.273393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:39.273393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:39.273393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:39.273393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:39.273393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:39.273393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:39.273393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:39.273393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 19:39:39.273393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:39.273393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 463/918] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Jun 23 19:39:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:39.286528 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d05f89-75a7-4945-a6b6-dfd39c70d6a1 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:39.327236 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:39.360235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb645174-2cf9-477e-af25-6f3427d7775a None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:39.425519 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e29ca6-1183-47ca-9e20-ec89b02be957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:39.425761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d05f89-75a7-4945-a6b6-dfd39c70d6a1 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:39.427916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e29ca6-1183-47ca-9e20-ec89b02be957 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:39.429745 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e29ca6-1183-47ca-9e20-ec89b02be957 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:39.430876 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e29ca6-1183-47ca-9e20-ec89b02be957 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:39.432309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e29ca6-1183-47ca-9e20-ec89b02be957 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:39.434205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e29ca6-1183-47ca-9e20-ec89b02be957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:39.436391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e29ca6-1183-47ca-9e20-ec89b02be957 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:39.450739 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 456/919] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:39:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:39.462497 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e29ca6-1183-47ca-9e20-ec89b02be957 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:39.471518 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3dc5c7-e889-48df-a7e9-32acac8b8d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:39.474674 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dc5c7-e889-48df-a7e9-32acac8b8d11 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:39.480114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dc5c7-e889-48df-a7e9-32acac8b8d11 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:39.481329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dc5c7-e889-48df-a7e9-32acac8b8d11 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:39.482285 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3dc5c7-e889-48df-a7e9-32acac8b8d11 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:39.482755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3dc5c7-e889-48df-a7e9-32acac8b8d11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:39.485034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3dc5c7-e889-48df-a7e9-32acac8b8d11 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:39.505209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 464/920] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 23 19:39:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:39.514530 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3dc5c7-e889-48df-a7e9-32acac8b8d11 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:39.626470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:39.633318 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:39.643108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e29ca6-1183-47ca-9e20-ec89b02be957 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:39.653301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3dc5c7-e889-48df-a7e9-32acac8b8d11 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:39.689245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f829d1-19b2-40e0-bf79-cc64657cdffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:39.690344 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f829d1-19b2-40e0-bf79-cc64657cdffc None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:39.690813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f829d1-19b2-40e0-bf79-cc64657cdffc None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:39.690920 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b934edb-f6f3-44fd-ac54-5bab192306dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:39.691431 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f829d1-19b2-40e0-bf79-cc64657cdffc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:39.691692 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b934edb-f6f3-44fd-ac54-5bab192306dd None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:39.692054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b934edb-f6f3-44fd-ac54-5bab192306dd None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:39.692402 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b934edb-f6f3-44fd-ac54-5bab192306dd None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:39.693408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b934edb-f6f3-44fd-ac54-5bab192306dd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:39.693822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b934edb-f6f3-44fd-ac54-5bab192306dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:39.698021 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b934edb-f6f3-44fd-ac54-5bab192306dd None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:39.710208 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 457/921] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 19:39:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:39.711037 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f829d1-19b2-40e0-bf79-cc64657cdffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:39.711572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b934edb-f6f3-44fd-ac54-5bab192306dd None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:39.712968 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f829d1-19b2-40e0-bf79-cc64657cdffc None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:39.731491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-e1f829d1-19b2-40e0-bf79-cc64657cdffc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:39.731491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:39.731491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:39.731491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:39.731491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:39.731491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:39.731491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:39.731491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:39.731491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:39.731491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:39.731491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:39.731491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:39.731491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:39.731491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:39.731491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:39.732425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:39.732425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:39.732425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:39.732425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:39.732425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:39.732425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:39.732425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:39.732425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:39.732425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:39.732425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:39.732425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:39.732425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:39.732425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:39.732425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:39.732425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:39.732425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:39.732425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:39.733432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:39.733432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:39.733432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:39.733432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:39.735640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 465/922] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:39.741960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f829d1-19b2-40e0-bf79-cc64657cdffc None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:39.824036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b934edb-f6f3-44fd-ac54-5bab192306dd None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:39.867331 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094c742-afaf-496b-a0ab-7044a2f8037f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:39.868278 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094c742-afaf-496b-a0ab-7044a2f8037f None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:39.868575 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094c742-afaf-496b-a0ab-7044a2f8037f None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:39.868862 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094c742-afaf-496b-a0ab-7044a2f8037f None admin] PATH_INFO: `/v3/endpoints` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:39.870146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094c742-afaf-496b-a0ab-7044a2f8037f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:39.871827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094c742-afaf-496b-a0ab-7044a2f8037f None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:39.880015 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f829d1-19b2-40e0-bf79-cc64657cdffc None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:39.916818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:39.922311 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c6386-90fb-42cd-b2aa-e5bb072cead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:39.922976 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c6386-90fb-42cd-b2aa-e5bb072cead1 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:39.923262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c6386-90fb-42cd-b2aa-e5bb072cead1 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:39.923539 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c6386-90fb-42cd-b2aa-e5bb072cead1 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:39.926438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c6386-90fb-42cd-b2aa-e5bb072cead1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:39.926438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c6386-90fb-42cd-b2aa-e5bb072cead1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:39.926438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c6386-90fb-42cd-b2aa-e5bb072cead1 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:39.938246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 466/923] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:39.943558 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c6386-90fb-42cd-b2aa-e5bb072cead1 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:39.957670 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 458/924] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 23 19:39:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:39:40.031394 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e466aaf-51a8-493e-b29c-8ea466718827 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:40.031730 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e466aaf-51a8-493e-b29c-8ea466718827 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:40.033403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e466aaf-51a8-493e-b29c-8ea466718827 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:40.034533 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 459/925] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:40.043354 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e0d97-6d83-492c-b13d-50ef4e0280d3 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:40.043793 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e0d97-6d83-492c-b13d-50ef4e0280d3 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:40.044188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e0d97-6d83-492c-b13d-50ef4e0280d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:40.064232 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-429e0d97-6d83-492c-b13d-50ef4e0280d3 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:40.065420 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-429e0d97-6d83-492c-b13d-50ef4e0280d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:40.069814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:40.071826 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c6386-90fb-42cd-b2aa-e5bb072cead1 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:40.121001 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf2e19-1c27-45c4-bc27-aedc48bb4e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:40.122197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf2e19-1c27-45c4-bc27-aedc48bb4e0e None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:40.122855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf2e19-1c27-45c4-bc27-aedc48bb4e0e None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:40.123338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf2e19-1c27-45c4-bc27-aedc48bb4e0e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:40.136205 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf2e19-1c27-45c4-bc27-aedc48bb4e0e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:40.137692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf2e19-1c27-45c4-bc27-aedc48bb4e0e None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:40.155925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 460/926] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 19:39:40.156109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-ecdf2e19-1c27-45c4-bc27-aedc48bb4e0e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 19:39:40.156109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:40.156109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:40.156109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:40.156109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:40.156109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:40.156109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:40.156109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:40.156109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:40.156109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:40.156109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:40.156109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:40.156109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:40.156109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:40.156109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:40.156109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:40.156998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:40.156998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:40.156998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:40.156998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:40.156998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:40.156998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:40.156998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:40.156998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:40.156998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:40.156998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:40.156998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:40.156998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:40.156998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:40.156998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:40.156998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:40.156998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:40.156998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:40.156998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:40.158293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:40.158293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:40.158293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:40.158293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:40.158293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:40.158293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:40.158293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:40.158293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:40.158293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 19:39:40.158293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:40.158293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 467/927] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 23 19:39:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:40.162410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e0d97-6d83-492c-b13d-50ef4e0280d3 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:40.181084 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf2e19-1c27-45c4-bc27-aedc48bb4e0e None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:40.248020 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:40.271318 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e0d97-6d83-492c-b13d-50ef4e0280d3 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:40.311498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf2e19-1c27-45c4-bc27-aedc48bb4e0e None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:40.316055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573db64b-4c1f-4530-8f4f-8a1ec3b1e774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:40.316732 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573db64b-4c1f-4530-8f4f-8a1ec3b1e774 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:40.317016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573db64b-4c1f-4530-8f4f-8a1ec3b1e774 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:40.317322 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573db64b-4c1f-4530-8f4f-8a1ec3b1e774 None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:40.318154 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573db64b-4c1f-4530-8f4f-8a1ec3b1e774 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:40.318461 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573db64b-4c1f-4530-8f4f-8a1ec3b1e774 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:40.321624 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573db64b-4c1f-4530-8f4f-8a1ec3b1e774 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:40.332757 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:40.345260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 461/928] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Jun 23 19:39:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:40.351910 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573db64b-4c1f-4530-8f4f-8a1ec3b1e774 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:40.356442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950dc30-76ae-4fa4-826c-4b706bad4d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:40.357300 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950dc30-76ae-4fa4-826c-4b706bad4d16 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:40.357588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950dc30-76ae-4fa4-826c-4b706bad4d16 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:40.357865 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950dc30-76ae-4fa4-826c-4b706bad4d16 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:40.358561 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950dc30-76ae-4fa4-826c-4b706bad4d16 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:40.359985 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950dc30-76ae-4fa4-826c-4b706bad4d16 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:40.378131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-a950dc30-76ae-4fa4-826c-4b706bad4d16 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 19:39:40.378131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:40.378131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:40.378131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:40.378131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:40.378131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:40.378131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:40.378131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:40.378131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 19:39:40.378131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:40.378131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:40.378131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:40.378131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:40.378131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:40.378131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:40.378131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:40.379127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:40.379127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:40.379127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:40.379127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:40.379127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:40.379127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:40.379127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:40.379127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:40.379127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:40.379127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:40.379127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:40.379127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:40.379127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:40.379127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:40.379127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:40.379127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:40.379991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:40.379991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:40.379991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:40.379991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:40.379991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:40.379991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:40.379991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:40.379991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:40.379991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:40.379991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:40.379991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:40.379991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:40.379991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:40.379991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 19:39:40.379991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:40.385244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 468/929] 10.222.0.13 () {56 vars in 1132 bytes} [Thu Jun 23 19:39:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:40.387524 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950dc30-76ae-4fa4-826c-4b706bad4d16 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:40.481221 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573db64b-4c1f-4530-8f4f-8a1ec3b1e774 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:40.508709 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950dc30-76ae-4fa4-826c-4b706bad4d16 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:40.519704 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459a727-6d16-47dc-aba6-89f7e95968fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:40.520511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459a727-6d16-47dc-aba6-89f7e95968fc None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:40.520797 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459a727-6d16-47dc-aba6-89f7e95968fc None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:40.521077 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459a727-6d16-47dc-aba6-89f7e95968fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:40.522250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:40.532911 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459a727-6d16-47dc-aba6-89f7e95968fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:40.534618 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459a727-6d16-47dc-aba6-89f7e95968fc None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:40.546125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00a31c-6164-4998-a03b-f88fabfa4e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:40.546795 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a31c-6164-4998-a03b-f88fabfa4e1f None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:40.547078 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a31c-6164-4998-a03b-f88fabfa4e1f None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:40.547356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a31c-6164-4998-a03b-f88fabfa4e1f None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:40.548177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00a31c-6164-4998-a03b-f88fabfa4e1f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:40.548482 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00a31c-6164-4998-a03b-f88fabfa4e1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:40.549888 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00a31c-6164-4998-a03b-f88fabfa4e1f None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:40.559353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-1459a727-6d16-47dc-aba6-89f7e95968fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:40.559353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:40.559353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:40.559353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:40.559353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:40.559353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:40.559353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:40.559353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:40.559353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:40.559353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:40.559353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:40.559353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:40.559353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:40.559353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:40.559353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:40.560311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:40.560311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:40.560311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:40.560311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:40.560311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:40.560311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:40.560311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:40.560311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:40.560311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:40.560311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:40.560311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:40.560311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:40.560311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:40.560311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:40.560311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:40.560311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:40.560311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:40.561280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:40.561280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:40.561280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:40.561280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:40.561519 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 469/930] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 19:39:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:40.563654 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 462/931] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:40.564574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00a31c-6164-4998-a03b-f88fabfa4e1f None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:40.566328 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459a727-6d16-47dc-aba6-89f7e95968fc None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:40.623665 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:40.677281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00a31c-6164-4998-a03b-f88fabfa4e1f None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:40.679370 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459a727-6d16-47dc-aba6-89f7e95968fc None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:40.714978 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45358d-8a28-491f-95cb-dec7e135ce8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:40.715702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45358d-8a28-491f-95cb-dec7e135ce8e None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:40.716000 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45358d-8a28-491f-95cb-dec7e135ce8e None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:40.716268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45358d-8a28-491f-95cb-dec7e135ce8e None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:40.717038 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45358d-8a28-491f-95cb-dec7e135ce8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:40.717381 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45358d-8a28-491f-95cb-dec7e135ce8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:40.718858 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45358d-8a28-491f-95cb-dec7e135ce8e None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:40.721191 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df60ef-0396-4e3a-a1fc-2ae112bc3e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:40.722210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df60ef-0396-4e3a-a1fc-2ae112bc3e96 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:40.722717 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df60ef-0396-4e3a-a1fc-2ae112bc3e96 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:40.723215 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df60ef-0396-4e3a-a1fc-2ae112bc3e96 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:40.724139 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df60ef-0396-4e3a-a1fc-2ae112bc3e96 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:40.724665 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df60ef-0396-4e3a-a1fc-2ae112bc3e96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:40.726332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df60ef-0396-4e3a-a1fc-2ae112bc3e96 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:40.736941 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 463/932] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 19:39:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:40.737897 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 470/933] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:40.738804 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df60ef-0396-4e3a-a1fc-2ae112bc3e96 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:40.738915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45358d-8a28-491f-95cb-dec7e135ce8e None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:40.779269 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:40.847587 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df60ef-0396-4e3a-a1fc-2ae112bc3e96 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:40.849606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45358d-8a28-491f-95cb-dec7e135ce8e None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:40.886657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aef4d-9413-4863-bc0d-ee251634ef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:40.887480 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aef4d-9413-4863-bc0d-ee251634ef16 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:40.887979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aef4d-9413-4863-bc0d-ee251634ef16 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:40.888115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aef4d-9413-4863-bc0d-ee251634ef16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:40.893207 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da7389-1691-40f7-b86a-43b52d2ab0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:40.894158 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da7389-1691-40f7-b86a-43b52d2ab0d4 None admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:40.894666 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da7389-1691-40f7-b86a-43b52d2ab0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:40.898524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2aef4d-9413-4863-bc0d-ee251634ef16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:40.898524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2aef4d-9413-4863-bc0d-ee251634ef16 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:40.899019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da7389-1691-40f7-b86a-43b52d2ab0d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:40.900000 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da7389-1691-40f7-b86a-43b52d2ab0d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:40.901881 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da7389-1691-40f7-b86a-43b52d2ab0d4 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:40.914708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:40.916953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-be2aef4d-9413-4863-bc0d-ee251634ef16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:40.916953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:40.916953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:40.916953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:40.916953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:40.916953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:40.916953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:40.916953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:40.916953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:40.916953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:40.916953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:40.916953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:40.916953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:40.916953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:40.916953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:40.917900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:40.917900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:40.917900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:40.917900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:40.917900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:40.917900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:40.917900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:40.917900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:40.917900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:40.917900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:40.917900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:40.917900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:40.917900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:40.917900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:40.917900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:40.917900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:40.917900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:40.918926 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:40.918926 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:40.918926 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:40.918926 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:40.918926 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:40.918926 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:40.918926 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:40.918926 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:40.923164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 464/934] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:40.923851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aef4d-9413-4863-bc0d-ee251634ef16 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:40.988531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 471/935] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 23 19:39:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:39:41.046636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aef4d-9413-4863-bc0d-ee251634ef16 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:41.076355 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d31c7d-adf7-418f-9a2a-e7b916805c1a None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:41.076666 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d31c7d-adf7-418f-9a2a-e7b916805c1a None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:41.076920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d31c7d-adf7-418f-9a2a-e7b916805c1a None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:41.082832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 472/936] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:41.084245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faae13-fff8-4109-b323-e47bf8be4c8f None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:41.084642 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faae13-fff8-4109-b323-e47bf8be4c8f None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:41.084922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faae13-fff8-4109-b323-e47bf8be4c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:41.094383 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ff17b-fa29-4aa9-92ae-543c636e51f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:41.095449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ff17b-fa29-4aa9-92ae-543c636e51f0 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:41.095890 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ff17b-fa29-4aa9-92ae-543c636e51f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:41.096973 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ff17b-fa29-4aa9-92ae-543c636e51f0 None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:41.097976 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ff17b-fa29-4aa9-92ae-543c636e51f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:41.098634 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ff17b-fa29-4aa9-92ae-543c636e51f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:41.100884 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ff17b-fa29-4aa9-92ae-543c636e51f0 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:41.103314 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-09faae13-fff8-4109-b323-e47bf8be4c8f None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:41.104548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-09faae13-fff8-4109-b323-e47bf8be4c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:41.117398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 465/937] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:41.124889 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ff17b-fa29-4aa9-92ae-543c636e51f0 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:41.181102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:41.203892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 473/938] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:41.230178 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09faae13-fff8-4109-b323-e47bf8be4c8f None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:41.259892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:41.263173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ff17b-fa29-4aa9-92ae-543c636e51f0 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:41.301632 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591c647-aa8a-4f6c-b92e-3cb2d0f896ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:41.302702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591c647-aa8a-4f6c-b92e-3cb2d0f896ea None admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:41.303087 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591c647-aa8a-4f6c-b92e-3cb2d0f896ea None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:41.303637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591c647-aa8a-4f6c-b92e-3cb2d0f896ea None admin] PATH_INFO: `/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/fec6c1cbf48a44f9922bd82e714861c1/roles/cebd4ad2da474d8b9183c4a7587119c8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:41.306102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591c647-aa8a-4f6c-b92e-3cb2d0f896ea None admin] RBAC: Authorizing `identity:create_grant(project_id=368f41dc1ae64e199b604ee72545c88e, user_id=fec6c1cbf48a44f9922bd82e714861c1, role_id=cebd4ad2da474d8b9183c4a7587119c8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:41.307609 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591c647-aa8a-4f6c-b92e-3cb2d0f896ea None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:41.348387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09faae13-fff8-4109-b323-e47bf8be4c8f None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:41.389222 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e87e48-b8c2-447c-aa69-1d58759bc685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:41.389222 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e87e48-b8c2-447c-aa69-1d58759bc685 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:41.389222 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e87e48-b8c2-447c-aa69-1d58759bc685 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:41.389222 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e87e48-b8c2-447c-aa69-1d58759bc685 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:41.389707 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e87e48-b8c2-447c-aa69-1d58759bc685 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:41.389920 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 466/939] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:39:41 2022] PUT /identity/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/fec6c1cbf48a44f9922bd82e714861c1/roles/cebd4ad2da474d8b9183c4a7587119c8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:39:41.390704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e87e48-b8c2-447c-aa69-1d58759bc685 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:41.404743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-87e87e48-b8c2-447c-aa69-1d58759bc685 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 19:39:41.404743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:41.404743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:41.404743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:41.404743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:41.404743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:41.404743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:41.404743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:41.404743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 19:39:41.404743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:41.404743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:41.404743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:41.404743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:41.404743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:41.404743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:41.404743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:41.404743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:41.406050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:41.406050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:41.406050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:41.406050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:41.406050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:41.406050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:41.406050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:41.406050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:41.406050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:41.406050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:41.406050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:41.406050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:41.406050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:41.406050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:41.406050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:41.406050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:41.407110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:41.407110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:41.407110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:41.407110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:41.407110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:41.407110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:41.407110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:41.407110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:41.407110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:41.407110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:41.407110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:41.407110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:41.407110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 19:39:41.407110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:41.409515 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 474/940] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 19:39:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:41.416060 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591c647-aa8a-4f6c-b92e-3cb2d0f896ea None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:41.527967 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:41.538682 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591c647-aa8a-4f6c-b92e-3cb2d0f896ea None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:41.575896 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f4af5-5156-48b3-97cf-2fab67815867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:41.576706 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f4af5-5156-48b3-97cf-2fab67815867 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:41.577102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f4af5-5156-48b3-97cf-2fab67815867 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:41.577574 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f4af5-5156-48b3-97cf-2fab67815867 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:41.578345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f4af5-5156-48b3-97cf-2fab67815867 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:41.578739 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f4af5-5156-48b3-97cf-2fab67815867 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:41.580171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f4af5-5156-48b3-97cf-2fab67815867 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:41.586087 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 467/941] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 23 19:39:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:41.592725 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e87e48-b8c2-447c-aa69-1d58759bc685 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:41.687227 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:41.703605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e87e48-b8c2-447c-aa69-1d58759bc685 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:41.739348 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6dd83-8a7b-4137-be75-c5eec6930377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:41.740028 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6dd83-8a7b-4137-be75-c5eec6930377 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:41.740314 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6dd83-8a7b-4137-be75-c5eec6930377 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:41.740594 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6dd83-8a7b-4137-be75-c5eec6930377 None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:41.741428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6dd83-8a7b-4137-be75-c5eec6930377 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:41.741737 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6dd83-8a7b-4137-be75-c5eec6930377 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:41.743125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6dd83-8a7b-4137-be75-c5eec6930377 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:41.748709 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 475/942] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 23 19:39:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:41.754702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f4af5-5156-48b3-97cf-2fab67815867 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:41.863151 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f4af5-5156-48b3-97cf-2fab67815867 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:41.905926 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538d549-2ff3-498f-9866-4428c8d373cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:41.906602 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538d549-2ff3-498f-9866-4428c8d373cc None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:41.906890 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538d549-2ff3-498f-9866-4428c8d373cc None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:41.907171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538d549-2ff3-498f-9866-4428c8d373cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:41.907994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538d549-2ff3-498f-9866-4428c8d373cc None admin] RBAC: Adding query filter params (interface=public, service_id=554e9fbe8cf0407284af63daaaea7edd, region_id=RegionOne) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:41.908310 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538d549-2ff3-498f-9866-4428c8d373cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:41.909738 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538d549-2ff3-498f-9866-4428c8d373cc None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:41.915795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 468/943] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 23 19:39:41 2022] GET /identity/v3/endpoints?service_id=554e9fbe8cf0407284af63daaaea7edd&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:41.921335 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6dd83-8a7b-4137-be75-c5eec6930377 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:42.029593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6dd83-8a7b-4137-be75-c5eec6930377 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:42.065722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54e46a-ae94-45c6-8751-ee10e3828110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:42.066454 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54e46a-ae94-45c6-8751-ee10e3828110 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:42.066744 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54e46a-ae94-45c6-8751-ee10e3828110 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:42.067031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54e46a-ae94-45c6-8751-ee10e3828110 None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:42.067761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54e46a-ae94-45c6-8751-ee10e3828110 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:42.070087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54e46a-ae94-45c6-8751-ee10e3828110 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:42.076919 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 476/944] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 23 19:39:41 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:39:42.187991 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b304883-3ac2-4fd3-9d54-44c60203b1db None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:42.188310 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b304883-3ac2-4fd3-9d54-44c60203b1db None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:42.188546 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b304883-3ac2-4fd3-9d54-44c60203b1db None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:42.190269 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 469/945] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:42.197325 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3be45-824c-405d-8098-57b0b60485d8 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:42.197614 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3be45-824c-405d-8098-57b0b60485d8 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:42.197900 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3be45-824c-405d-8098-57b0b60485d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:42.217081 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-52f3be45-824c-405d-8098-57b0b60485d8 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:42.218335 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-52f3be45-824c-405d-8098-57b0b60485d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:42.230042 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:42.292844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 477/946] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:42.317433 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b304883-3ac2-4fd3-9d54-44c60203b1db None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:42.339040 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:42.425840 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b304883-3ac2-4fd3-9d54-44c60203b1db None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:42.462280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80e9ee-dc25-4836-b9ec-561725b4b724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:42.462869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80e9ee-dc25-4836-b9ec-561725b4b724 None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:42.463157 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80e9ee-dc25-4836-b9ec-561725b4b724 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:42.463439 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80e9ee-dc25-4836-b9ec-561725b4b724 None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:42.464147 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80e9ee-dc25-4836-b9ec-561725b4b724 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:42.465622 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80e9ee-dc25-4836-b9ec-561725b4b724 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:42.467096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: WARNING keystone.server.flask.common [None req-7d80e9ee-dc25-4836-b9ec-561725b4b724 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 23 19:39:42.514350 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.sql.core [None req-7d80e9ee-dc25-4836-b9ec-561725b4b724 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 19:39:42.514350 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 19:39:42.514350 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [parameters: {'id': 'e1dca8591eb2402fb75a40e6b2eb9d9f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 19:39:42.514350 dv-cinder-847274-2-smb devstack@keystone.service[91966]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91966) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 19:39:42.522397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-7d80e9ee-dc25-4836-b9ec-561725b4b724 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e1dca8591eb2402fb75a40e6b2eb9d9f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e1dca8591eb2402fb75a40e6b2eb9d9f. Jun 23 19:39:42.522397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:42.522397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 19:39:42.522397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 19:39:42.522397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 19:39:42.522397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 19:39:42.522397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 19:39:42.522397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 19:39:42.522397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 19:39:42.522397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application conn.query(q) Jun 23 19:39:42.522397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 19:39:42.522397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 19:39:42.522397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 19:39:42.523225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application result.read() Jun 23 19:39:42.523225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 19:39:42.523225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 19:39:42.523225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 19:39:42.523225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 19:39:42.523225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 19:39:42.523225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 19:39:42.523225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 19:39:42.523225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 19:39:42.523225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 19:39:42.523225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:42.523225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 19:39:42.523225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:42.523225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:42.523225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 19:39:42.523225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 19:39:42.523225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 23 19:39:42.523225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 23 19:39:42.524588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 19:39:42.524588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application next(self.gen) Jun 23 19:39:42.524588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 19:39:42.524588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application yield resource Jun 23 19:39:42.524588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 19:39:42.524588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application next(self.gen) Jun 23 19:39:42.524588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 19:39:42.524588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 19:39:42.524588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 19:39:42.524588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 19:39:42.524588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 19:39:42.524588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise self.value Jun 23 19:39:42.524588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 19:39:42.524588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 19:39:42.524588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 19:39:42.524588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application session.commit() Jun 23 19:39:42.524588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 19:39:42.525798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 19:39:42.525798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 19:39:42.525798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 19:39:42.525798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 19:39:42.525798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self.session.flush() Jun 23 19:39:42.525798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 19:39:42.525798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 19:39:42.525798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 19:39:42.525798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 19:39:42.525798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 19:39:42.525798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application compat.raise_( Jun 23 19:39:42.525798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 19:39:42.525798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception Jun 23 19:39:42.525798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 19:39:42.525798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 19:39:42.525798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 19:39:42.525798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 19:39:42.526708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 19:39:42.526708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 19:39:42.526708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 19:39:42.526708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 19:39:42.526708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 19:39:42.526708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 19:39:42.526708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 19:39:42.526708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 19:39:42.526708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 19:39:42.526708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 19:39:42.526708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 19:39:42.526708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 19:39:42.526708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 19:39:42.526708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 19:39:42.526708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 19:39:42.527494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 19:39:42.527494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 19:39:42.527494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception Jun 23 19:39:42.527494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 19:39:42.527494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 19:39:42.527494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 19:39:42.527494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 19:39:42.527494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 19:39:42.527494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 19:39:42.527494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 19:39:42.527494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application conn.query(q) Jun 23 19:39:42.527494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 19:39:42.527494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 19:39:42.527494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 19:39:42.527494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application result.read() Jun 23 19:39:42.527494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 19:39:42.527494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 19:39:42.528349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 19:39:42.528349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 19:39:42.528349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 19:39:42.528349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 19:39:42.528349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 19:39:42.528349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 19:39:42.528349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 19:39:42.528349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 19:39:42.528349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [parameters: {'id': 'e1dca8591eb2402fb75a40e6b2eb9d9f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 19:39:42.528349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 19:39:42.528349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:42.528349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:42.528349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:42.528349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:42.528349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 23 19:39:42.530827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 23 19:39:42.530827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 19:39:42.530827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 19:39:42.530827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 23 19:39:42.530827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:42.530827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:42.530827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:42.530827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:42.530827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:42.530827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:42.530827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:42.530827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:42.530827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:42.530827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:42.530827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:42.530827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:42.530827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:42.532960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:42.532960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 23 19:39:42.532960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 23 19:39:42.532960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:42.532960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:42.532960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 23 19:39:42.532960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 23 19:39:42.532960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e1dca8591eb2402fb75a40e6b2eb9d9f. Jun 23 19:39:42.532960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:42.532960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 470/947] 10.222.0.13 () {60 vars in 1140 bytes} [Thu Jun 23 19:39:42 2022] POST /identity/v3/projects => generated 262 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:42.534249 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3be45-824c-405d-8098-57b0b60485d8 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:42.645354 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3be45-824c-405d-8098-57b0b60485d8 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:42.683281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9592fd-aacf-4bb6-893a-7e0fb4e1bf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:42.684154 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9592fd-aacf-4bb6-893a-7e0fb4e1bf43 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:42.684441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9592fd-aacf-4bb6-893a-7e0fb4e1bf43 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:42.684721 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9592fd-aacf-4bb6-893a-7e0fb4e1bf43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:42.692405 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9592fd-aacf-4bb6-893a-7e0fb4e1bf43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:42.694737 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9592fd-aacf-4bb6-893a-7e0fb4e1bf43 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:42.708726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-6e9592fd-aacf-4bb6-893a-7e0fb4e1bf43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:42.708726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:42.708726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:42.708726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:42.708726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:42.708726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:42.708726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:42.708726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:42.708726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:42.708726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:42.708726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:42.708726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:42.708726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:42.708726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:42.708726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:42.711392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:42.711392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:42.711392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:42.711392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:42.711392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:42.711392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:42.711392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:42.711392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:42.711392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:42.711392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:42.711392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:42.711392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:42.711392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:42.711392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:42.711392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:42.711392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:42.711392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:42.713690 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:42.713690 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:42.713690 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:42.713690 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:42.713690 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:42.713690 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:42.713690 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:42.713690 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:42.713690 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 478/948] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:42.718861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80e9ee-dc25-4836-b9ec-561725b4b724 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:42.799861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:42.826202 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80e9ee-dc25-4836-b9ec-561725b4b724 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:42.861280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a885740-bad3-48a2-8feb-cb26aee77c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:42.861957 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a885740-bad3-48a2-8feb-cb26aee77c14 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:42.862242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a885740-bad3-48a2-8feb-cb26aee77c14 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:42.862523 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a885740-bad3-48a2-8feb-cb26aee77c14 None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:42.863285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a885740-bad3-48a2-8feb-cb26aee77c14 None admin] RBAC: Adding query filter params (name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:42.863597 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a885740-bad3-48a2-8feb-cb26aee77c14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:42.865254 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a885740-bad3-48a2-8feb-cb26aee77c14 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:42.887073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 471/949] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 19:39:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:43.146605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63e782-b16b-4a12-a6a5-1e13d4300500 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:43.147507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63e782-b16b-4a12-a6a5-1e13d4300500 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:43.147688 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63e782-b16b-4a12-a6a5-1e13d4300500 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:43.149359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 479/950] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:43.154785 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f3d36-4fb1-4f07-8959-6596f444edc3 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:43.155079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f3d36-4fb1-4f07-8959-6596f444edc3 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:43.155361 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f3d36-4fb1-4f07-8959-6596f444edc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:43.173031 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-097f3d36-4fb1-4f07-8959-6596f444edc3 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:43.174591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-097f3d36-4fb1-4f07-8959-6596f444edc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:43.243163 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 472/951] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:43.264974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63e782-b16b-4a12-a6a5-1e13d4300500 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:43.269465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:43.378503 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63e782-b16b-4a12-a6a5-1e13d4300500 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:43.415755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e319ff4-a1c6-404f-bc80-ca98946729bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:43.416467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e319ff4-a1c6-404f-bc80-ca98946729bb None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:43.416750 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e319ff4-a1c6-404f-bc80-ca98946729bb None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:43.417030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e319ff4-a1c6-404f-bc80-ca98946729bb None admin] PATH_INFO: `/v3/services/compute` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:43.417815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e319ff4-a1c6-404f-bc80-ca98946729bb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:43.419270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e319ff4-a1c6-404f-bc80-ca98946729bb None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:43.432347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-4e319ff4-a1c6-404f-bc80-ca98946729bb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 19:39:43.432347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:43.432347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:43.432347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:43.432347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:43.432347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:43.432347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:43.432347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:43.432347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 19:39:43.432347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:43.432347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:43.432347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:43.432347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:43.432347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:43.432347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:43.432347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:43.432347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:43.433649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:43.433649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:43.433649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:43.433649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:43.433649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:43.433649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:43.433649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:43.433649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:43.433649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:43.433649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:43.433649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:43.433649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:43.433649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:43.433649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:43.433649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:43.433649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:43.434862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:43.434862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:43.434862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:43.434862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:43.434862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:43.434862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:43.434862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:43.434862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:43.434862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:43.434862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:43.434862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:43.434862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:43.434862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 19:39:43.434862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:43.434862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 480/952] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:43.439534 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f3d36-4fb1-4f07-8959-6596f444edc3 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:43.503354 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:43.544438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f3d36-4fb1-4f07-8959-6596f444edc3 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:43.581005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14491be2-4ba9-4cac-9626-d4b2d46a0d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:43.581774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14491be2-4ba9-4cac-9626-d4b2d46a0d12 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:43.582062 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14491be2-4ba9-4cac-9626-d4b2d46a0d12 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:43.582351 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14491be2-4ba9-4cac-9626-d4b2d46a0d12 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:43.583109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14491be2-4ba9-4cac-9626-d4b2d46a0d12 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:43.583424 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14491be2-4ba9-4cac-9626-d4b2d46a0d12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:43.585471 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14491be2-4ba9-4cac-9626-d4b2d46a0d12 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:43.590841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 473/953] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 19:39:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:43.596139 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e319ff4-a1c6-404f-bc80-ca98946729bb None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:43.615378 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef493822-5e4a-49ea-8553-cd5f44732022 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:43.615738 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef493822-5e4a-49ea-8553-cd5f44732022 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:43.616169 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef493822-5e4a-49ea-8553-cd5f44732022 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:43.617743 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 474/954] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:43.623981 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201d545-119f-408c-ae77-42028dd67ce7 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:43.624687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201d545-119f-408c-ae77-42028dd67ce7 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:43.625366 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201d545-119f-408c-ae77-42028dd67ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:43.647101 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-0201d545-119f-408c-ae77-42028dd67ce7 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:43.649325 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-0201d545-119f-408c-ae77-42028dd67ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:43.669456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:43.712931 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e319ff4-a1c6-404f-bc80-ca98946729bb None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:43.736762 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 475/955] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 19:39:43.755967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dac190-1dc5-4324-a2a1-c6edc0d88852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:43.756789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dac190-1dc5-4324-a2a1-c6edc0d88852 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:43.757082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dac190-1dc5-4324-a2a1-c6edc0d88852 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:43.757399 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dac190-1dc5-4324-a2a1-c6edc0d88852 None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:43.758120 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dac190-1dc5-4324-a2a1-c6edc0d88852 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:43.758434 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dac190-1dc5-4324-a2a1-c6edc0d88852 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:43.759822 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dac190-1dc5-4324-a2a1-c6edc0d88852 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:43.764902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 481/956] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 19:39:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:43.766231 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201d545-119f-408c-ae77-42028dd67ce7 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:43.837981 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:43.884245 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201d545-119f-408c-ae77-42028dd67ce7 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:43.924058 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9dbe1-781c-4ea5-bf90-6b487a9feec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:43.924815 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9dbe1-781c-4ea5-bf90-6b487a9feec6 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:43.925100 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9dbe1-781c-4ea5-bf90-6b487a9feec6 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:43.925410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9dbe1-781c-4ea5-bf90-6b487a9feec6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:43.937318 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9dbe1-781c-4ea5-bf90-6b487a9feec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:43.946056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-d0d9dbe1-781c-4ea5-bf90-6b487a9feec6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 19:39:43.946056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:43.946056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:43.946056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:43.946056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:43.946056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:43.946056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:43.946056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:43.946056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:43.946056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:43.946056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:43.946056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:43.946056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:43.946056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:43.946056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:43.946056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:43.946992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:43.946992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:43.946992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:43.946992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:43.946992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:43.946992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:43.946992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:43.946992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:43.946992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:43.946992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:43.946992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:43.946992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:43.946992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:43.946992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:43.946992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:43.946992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:43.947827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:43.947827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:43.947827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:43.947827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:43.947827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:43.947827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:43.947827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:43.947827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:43.947827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:43.947827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:43.947827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 19:39:43.947827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:43.947827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 476/957] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Jun 23 19:39:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:43.954283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dac190-1dc5-4324-a2a1-c6edc0d88852 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:44.061394 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dac190-1dc5-4324-a2a1-c6edc0d88852 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:44.092126 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:44.097421 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af246fe-0bf9-45b4-8b92-849afad77e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:44.098129 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af246fe-0bf9-45b4-8b92-849afad77e6b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:44.104158 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af246fe-0bf9-45b4-8b92-849afad77e6b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:44.104158 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af246fe-0bf9-45b4-8b92-849afad77e6b None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:44.104158 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af246fe-0bf9-45b4-8b92-849afad77e6b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:44.104158 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af246fe-0bf9-45b4-8b92-849afad77e6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:44.104158 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af246fe-0bf9-45b4-8b92-849afad77e6b None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:44.111136 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 482/958] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 23 19:39:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:44.116475 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9dbe1-781c-4ea5-bf90-6b487a9feec6 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:44.231113 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9dbe1-781c-4ea5-bf90-6b487a9feec6 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:44.249823 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:44.267843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bebe1-7743-407d-831b-97bf82d2fb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:44.268651 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bebe1-7743-407d-831b-97bf82d2fb62 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:44.268932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bebe1-7743-407d-831b-97bf82d2fb62 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:44.269237 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bebe1-7743-407d-831b-97bf82d2fb62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:44.280779 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bebe1-7743-407d-831b-97bf82d2fb62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:44.282270 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bebe1-7743-407d-831b-97bf82d2fb62 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:44.299285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-446bebe1-7743-407d-831b-97bf82d2fb62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:44.299285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:44.299285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:44.299285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:44.299285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:44.299285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:44.299285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:44.299285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:44.299285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:44.299285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:44.299285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:44.299285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:44.299285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:44.299285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:44.299285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:44.300293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:44.300293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:44.300293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:44.300293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:44.300293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:44.300293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:44.300293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:44.300293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:44.300293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:44.300293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:44.300293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:44.300293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:44.300293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:44.300293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:44.300293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:44.300293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:44.300293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:44.301465 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:44.301465 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:44.301465 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:44.301465 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:44.301465 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 477/959] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:44.306759 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af246fe-0bf9-45b4-8b92-849afad77e6b None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:44.326710 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa277c-b459-40e5-9031-26e47789c0db None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:44.327047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa277c-b459-40e5-9031-26e47789c0db None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:44.327586 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa277c-b459-40e5-9031-26e47789c0db None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:44.329270 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 478/960] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:39:44.336463 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f0e81-4581-4d2b-895f-1d87ba9a8172 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:44.337297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f0e81-4581-4d2b-895f-1d87ba9a8172 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:44.338309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f0e81-4581-4d2b-895f-1d87ba9a8172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:44.358887 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-935f0e81-4581-4d2b-895f-1d87ba9a8172 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:44.360367 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-935f0e81-4581-4d2b-895f-1d87ba9a8172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:44.427997 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af246fe-0bf9-45b4-8b92-849afad77e6b None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:44.448723 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 479/961] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 19:39:44.471246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314efda-12e2-4208-97a1-aba34a5b68c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:44.472115 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314efda-12e2-4208-97a1-aba34a5b68c0 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:44.472408 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314efda-12e2-4208-97a1-aba34a5b68c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:44.472691 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314efda-12e2-4208-97a1-aba34a5b68c0 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:44.472798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f0e81-4581-4d2b-895f-1d87ba9a8172 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:44.473501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314efda-12e2-4208-97a1-aba34a5b68c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:44.473817 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314efda-12e2-4208-97a1-aba34a5b68c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:44.475375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314efda-12e2-4208-97a1-aba34a5b68c0 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:44.488078 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 483/962] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:44.495033 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314efda-12e2-4208-97a1-aba34a5b68c0 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:44.569989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:44.577446 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:44.581108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f0e81-4581-4d2b-895f-1d87ba9a8172 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:44.618195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167dbe8-6824-4eae-b5eb-0b0e1213aa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:44.619244 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167dbe8-6824-4eae-b5eb-0b0e1213aa70 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:44.619699 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167dbe8-6824-4eae-b5eb-0b0e1213aa70 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:44.620148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167dbe8-6824-4eae-b5eb-0b0e1213aa70 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:44.620962 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167dbe8-6824-4eae-b5eb-0b0e1213aa70 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:44.622725 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167dbe8-6824-4eae-b5eb-0b0e1213aa70 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:44.628988 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314efda-12e2-4208-97a1-aba34a5b68c0 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:44.636647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-c167dbe8-6824-4eae-b5eb-0b0e1213aa70 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 19:39:44.636647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:44.636647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:44.636647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:44.636647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:44.636647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:44.636647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:44.636647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:44.636647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 19:39:44.636647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:44.636647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:44.636647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:44.636647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:44.636647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:44.636647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:44.636647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:44.636647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:44.637952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:44.637952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:44.637952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:44.637952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:44.637952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:44.637952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:44.637952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:44.637952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:44.637952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:44.637952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:44.637952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:44.637952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:44.637952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:44.637952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:44.637952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:44.637952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:44.638872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:44.638872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:44.638872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:44.638872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:44.638872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:44.638872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:44.638872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:44.638872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:44.638872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:44.638872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:44.638872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:44.638872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:44.638872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 19:39:44.638872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:44.646005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 480/963] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 19:39:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:44.647899 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167dbe8-6824-4eae-b5eb-0b0e1213aa70 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:44.666469 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf913a33-3bda-414e-a1fd-ee196503a5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:44.667600 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf913a33-3bda-414e-a1fd-ee196503a5be None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:44.668079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf913a33-3bda-414e-a1fd-ee196503a5be None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:44.668512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf913a33-3bda-414e-a1fd-ee196503a5be None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:44.677138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf913a33-3bda-414e-a1fd-ee196503a5be None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:44.679501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf913a33-3bda-414e-a1fd-ee196503a5be None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:44.695722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-bf913a33-3bda-414e-a1fd-ee196503a5be None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 19:39:44.695722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:44.695722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:44.695722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:44.695722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:44.695722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:44.695722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:44.695722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:44.695722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:44.695722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:44.695722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:44.695722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:44.695722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:44.695722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:44.695722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:44.695722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:44.696891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:44.696891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:44.696891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:44.696891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:44.696891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:44.696891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:44.696891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:44.696891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:44.696891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:44.696891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:44.696891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:44.696891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:44.696891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:44.696891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:44.696891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:44.696891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:44.696891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:44.696891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:44.697950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:44.697950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:44.697950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:44.697950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:44.697950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:44.697950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:44.697950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:44.697950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:44.697950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 19:39:44.697950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:44.700325 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 484/964] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 23 19:39:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:44.707265 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf913a33-3bda-414e-a1fd-ee196503a5be None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:44.770851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167dbe8-6824-4eae-b5eb-0b0e1213aa70 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:44.807732 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef35c83-5977-4cf4-b5f3-5dbe3005a633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:44.808831 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef35c83-5977-4cf4-b5f3-5dbe3005a633 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:44.809309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef35c83-5977-4cf4-b5f3-5dbe3005a633 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:44.809801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef35c83-5977-4cf4-b5f3-5dbe3005a633 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:44.810709 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef35c83-5977-4cf4-b5f3-5dbe3005a633 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:44.811184 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef35c83-5977-4cf4-b5f3-5dbe3005a633 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:44.812706 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef35c83-5977-4cf4-b5f3-5dbe3005a633 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:44.823118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 481/965] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 23 19:39:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:44.824628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef35c83-5977-4cf4-b5f3-5dbe3005a633 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:44.827678 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf913a33-3bda-414e-a1fd-ee196503a5be None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:44.843942 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:44.863414 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:44.867099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69063aaf-1b44-4479-9bb8-15ee97b74e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:44.867962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69063aaf-1b44-4479-9bb8-15ee97b74e5a None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:44.868406 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69063aaf-1b44-4479-9bb8-15ee97b74e5a None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:44.868904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69063aaf-1b44-4479-9bb8-15ee97b74e5a None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:44.870007 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69063aaf-1b44-4479-9bb8-15ee97b74e5a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:44.870477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69063aaf-1b44-4479-9bb8-15ee97b74e5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:44.877847 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69063aaf-1b44-4479-9bb8-15ee97b74e5a None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:44.905619 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 485/966] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Jun 23 19:39:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:44.911177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69063aaf-1b44-4479-9bb8-15ee97b74e5a None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:44.957398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef35c83-5977-4cf4-b5f3-5dbe3005a633 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:45.002162 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3d282-c5e6-4d95-8b22-0617a24dffa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:45.003768 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3d282-c5e6-4d95-8b22-0617a24dffa5 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:45.004293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3d282-c5e6-4d95-8b22-0617a24dffa5 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:45.004784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3d282-c5e6-4d95-8b22-0617a24dffa5 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:45.006809 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3d282-c5e6-4d95-8b22-0617a24dffa5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:45.007529 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3d282-c5e6-4d95-8b22-0617a24dffa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:45.009818 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3d282-c5e6-4d95-8b22-0617a24dffa5 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:45.016834 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 482/967] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 23 19:39:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:45.023170 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3d282-c5e6-4d95-8b22-0617a24dffa5 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:45.033818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69063aaf-1b44-4479-9bb8-15ee97b74e5a None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:45.076689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956d337-a80b-413d-8ced-9832eca6691a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:45.077668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956d337-a80b-413d-8ced-9832eca6691a None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:45.078174 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956d337-a80b-413d-8ced-9832eca6691a None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:45.078696 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956d337-a80b-413d-8ced-9832eca6691a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:45.121783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:45.123278 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:45.133263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3d282-c5e6-4d95-8b22-0617a24dffa5 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:45.150674 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956d337-a80b-413d-8ced-9832eca6691a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:45.152497 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956d337-a80b-413d-8ced-9832eca6691a None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:45.169921 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08682db-9c55-4022-a057-b295b6c4315b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:45.171817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08682db-9c55-4022-a057-b295b6c4315b None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:45.171817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08682db-9c55-4022-a057-b295b6c4315b None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:45.171817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08682db-9c55-4022-a057-b295b6c4315b None admin] PATH_INFO: `/v3/endpoints` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:45.172070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08682db-9c55-4022-a057-b295b6c4315b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:45.173412 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08682db-9c55-4022-a057-b295b6c4315b None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:45.240431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 483/968] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 23 19:39:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:39:45.250825 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19350e0-2b80-4d19-8184-39f54c72cd31 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:45.251137 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19350e0-2b80-4d19-8184-39f54c72cd31 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:45.251392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19350e0-2b80-4d19-8184-39f54c72cd31 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:45.252807 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 484/969] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:45.262696 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f588fb-5368-4a93-aaec-3affcb8833aa None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:45.263057 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f588fb-5368-4a93-aaec-3affcb8833aa None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:45.263249 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 486/970] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:39:44 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 19:39:45.263364 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f588fb-5368-4a93-aaec-3affcb8833aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:45.268727 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956d337-a80b-413d-8ced-9832eca6691a None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:45.288545 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-c0f588fb-5368-4a93-aaec-3affcb8833aa None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:45.289691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-c0f588fb-5368-4a93-aaec-3affcb8833aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:45.360860 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:45.388445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 485/971] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:45.411864 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956d337-a80b-413d-8ced-9832eca6691a None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:45.413987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f588fb-5368-4a93-aaec-3affcb8833aa None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:45.458750 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9c61f-49ec-43c0-a5c5-aef39320854d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:45.459706 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9c61f-49ec-43c0-a5c5-aef39320854d None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:45.460235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9c61f-49ec-43c0-a5c5-aef39320854d None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:45.460587 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9c61f-49ec-43c0-a5c5-aef39320854d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:45.477674 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9c61f-49ec-43c0-a5c5-aef39320854d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:45.479231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9c61f-49ec-43c0-a5c5-aef39320854d None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:45.498613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-0ba9c61f-49ec-43c0-a5c5-aef39320854d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:45.498613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:45.498613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:45.498613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:45.498613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:45.498613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:45.498613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:45.498613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:45.498613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:45.498613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:45.498613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:45.498613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:45.498613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:45.498613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:45.498613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:45.499575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:45.499575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:45.499575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:45.499575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:45.499575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:45.499575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:45.499575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:45.499575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:45.499575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:45.499575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:45.499575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:45.499575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:45.499575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:45.499575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:45.499575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:45.499575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:45.499575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:45.500495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:45.500495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:45.500495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:45.500495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:45.500495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 487/972] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:45.505870 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9c61f-49ec-43c0-a5c5-aef39320854d None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:45.513666 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:45.543098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f588fb-5368-4a93-aaec-3affcb8833aa None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:45.582489 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230618b-ba8b-40bd-ae48-6848e0419e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:45.583573 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230618b-ba8b-40bd-ae48-6848e0419e03 None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:45.583861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230618b-ba8b-40bd-ae48-6848e0419e03 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:45.584142 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230618b-ba8b-40bd-ae48-6848e0419e03 None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:45.585546 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230618b-ba8b-40bd-ae48-6848e0419e03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:45.587058 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230618b-ba8b-40bd-ae48-6848e0419e03 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:45.626404 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9c61f-49ec-43c0-a5c5-aef39320854d None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:45.627368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.sql.core [None req-c230618b-ba8b-40bd-ae48-6848e0419e03 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 19:39:45.627368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 19:39:45.627368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [parameters: {'user_id': '1449e957ace244168f95b9dfc68e8539', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 19:39:45.627368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91966) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 19:39:45.637337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-c230618b-ba8b-40bd-ae48-6848e0419e03 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 19:39:45.637337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:45.637337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 19:39:45.637337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 19:39:45.637337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 19:39:45.637337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 19:39:45.637337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 19:39:45.637337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 19:39:45.637337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 19:39:45.637337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application conn.query(q) Jun 23 19:39:45.637337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 19:39:45.637337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 19:39:45.637337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 19:39:45.637337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application result.read() Jun 23 19:39:45.637337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 19:39:45.638293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 19:39:45.638293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 19:39:45.638293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 19:39:45.638293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 19:39:45.638293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 19:39:45.638293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 19:39:45.638293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 19:39:45.638293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 19:39:45.638293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:45.638293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 19:39:45.638293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:45.638293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:45.638293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 19:39:45.638293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 19:39:45.638293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 23 19:39:45.638293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 23 19:39:45.638293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 19:39:45.638293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application next(self.gen) Jun 23 19:39:45.639938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 19:39:45.639938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application yield resource Jun 23 19:39:45.639938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 19:39:45.639938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application next(self.gen) Jun 23 19:39:45.639938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 19:39:45.639938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 19:39:45.639938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 19:39:45.639938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 19:39:45.639938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 19:39:45.639938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise self.value Jun 23 19:39:45.639938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 19:39:45.639938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 19:39:45.639938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 19:39:45.639938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application session.commit() Jun 23 19:39:45.639938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 19:39:45.639938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 19:39:45.639938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 19:39:45.640877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 19:39:45.640877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 19:39:45.640877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self.session.flush() Jun 23 19:39:45.640877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 19:39:45.640877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 19:39:45.640877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 19:39:45.640877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 19:39:45.640877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 19:39:45.640877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application compat.raise_( Jun 23 19:39:45.640877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 19:39:45.640877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception Jun 23 19:39:45.640877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 19:39:45.640877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 19:39:45.640877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 19:39:45.640877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 19:39:45.640877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 19:39:45.640877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 19:39:45.641835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 19:39:45.641835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 19:39:45.641835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 23 19:39:45.641835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 23 19:39:45.641835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 19:39:45.641835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 19:39:45.641835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 19:39:45.641835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 19:39:45.641835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 19:39:45.641835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 19:39:45.641835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 19:39:45.641835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 19:39:45.641835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 19:39:45.641835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 19:39:45.641835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 19:39:45.641835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception Jun 23 19:39:45.642735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 19:39:45.642735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 19:39:45.642735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 19:39:45.642735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 19:39:45.642735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 19:39:45.642735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 19:39:45.642735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 19:39:45.642735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application conn.query(q) Jun 23 19:39:45.642735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 19:39:45.642735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 19:39:45.642735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 19:39:45.642735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application result.read() Jun 23 19:39:45.642735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 19:39:45.642735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 19:39:45.642735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 19:39:45.642735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 19:39:45.644937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 19:39:45.644937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 19:39:45.644937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 19:39:45.644937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 19:39:45.644937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 19:39:45.644937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 19:39:45.644937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [parameters: {'user_id': '1449e957ace244168f95b9dfc68e8539', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 19:39:45.644937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 19:39:45.644937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:45.644937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:45.644937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:45.644937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:45.644937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:45.644937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:45.644937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:45.647635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:45.647635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:45.647635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:45.647635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:45.647635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:45.647635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:45.647635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:45.647635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 23 19:39:45.647635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 23 19:39:45.647635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:45.647635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:45.647635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:45.647635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:45.647635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:45.647635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:45.647635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 23 19:39:45.647635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 23 19:39:45.649867 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 23 19:39:45.649867 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 23 19:39:45.649867 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 19:39:45.649867 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 19:39:45.649867 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 19:39:45.649867 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:45.649867 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 486/973] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Jun 23 19:39:45 2022] POST /identity/v3/users => generated 160 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:45.649867 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230618b-ba8b-40bd-ae48-6848e0419e03 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:45.663303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:45.675750 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360bc70-6c59-4b74-87fb-b24d30eb63d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:45.676827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360bc70-6c59-4b74-87fb-b24d30eb63d9 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:45.677356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360bc70-6c59-4b74-87fb-b24d30eb63d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:45.677880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360bc70-6c59-4b74-87fb-b24d30eb63d9 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:45.678854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360bc70-6c59-4b74-87fb-b24d30eb63d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:45.679373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360bc70-6c59-4b74-87fb-b24d30eb63d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:45.681144 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360bc70-6c59-4b74-87fb-b24d30eb63d9 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:45.695791 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 488/974] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:45.705287 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360bc70-6c59-4b74-87fb-b24d30eb63d9 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:45.767172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230618b-ba8b-40bd-ae48-6848e0419e03 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:45.804214 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efcf30-f3dc-4a73-b86f-3c90fe66bb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:45.804948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efcf30-f3dc-4a73-b86f-3c90fe66bb91 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:45.805268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efcf30-f3dc-4a73-b86f-3c90fe66bb91 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:45.805546 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efcf30-f3dc-4a73-b86f-3c90fe66bb91 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:45.808692 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:45.813623 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360bc70-6c59-4b74-87fb-b24d30eb63d9 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:45.818187 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efcf30-f3dc-4a73-b86f-3c90fe66bb91 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:45.818187 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efcf30-f3dc-4a73-b86f-3c90fe66bb91 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:45.831680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-51efcf30-f3dc-4a73-b86f-3c90fe66bb91 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 19:39:45.831680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:45.831680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:45.831680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:45.831680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:45.831680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:45.831680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:45.831680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:45.831680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:45.831680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:45.831680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:45.831680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:45.831680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:45.831680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:45.831680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:45.831680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:45.832662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:45.832662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:45.832662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:45.832662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:45.832662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:45.832662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:45.832662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:45.832662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:45.832662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:45.832662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:45.832662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:45.832662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:45.832662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:45.832662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:45.832662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:45.832662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:45.832662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:45.832662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:45.834025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:45.834025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:45.834025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:45.834025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:45.834025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:45.834025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:45.834025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:45.834025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:45.834025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 19:39:45.834025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:45.834025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 487/975] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:39:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:45.839381 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efcf30-f3dc-4a73-b86f-3c90fe66bb91 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:45.854324 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97be16b-67ba-448b-9988-20b797dc0f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:45.855277 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97be16b-67ba-448b-9988-20b797dc0f15 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:45.855662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97be16b-67ba-448b-9988-20b797dc0f15 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:45.856038 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97be16b-67ba-448b-9988-20b797dc0f15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:45.863788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97be16b-67ba-448b-9988-20b797dc0f15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:45.867232 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97be16b-67ba-448b-9988-20b797dc0f15 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:45.882823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-b97be16b-67ba-448b-9988-20b797dc0f15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:45.882823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:45.882823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:45.882823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:45.882823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:45.882823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:45.882823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:45.882823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:45.882823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:45.882823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:45.882823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:45.882823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:45.882823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:45.882823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:45.882823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:45.883939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:45.883939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:45.883939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:45.883939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:45.883939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:45.883939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:45.883939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:45.883939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:45.883939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:45.883939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:45.883939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:45.883939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:45.883939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:45.883939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:45.883939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:45.883939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:45.883939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:45.885231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:45.885231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:45.885231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:45.885231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:45.885231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:45.885231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:45.885231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:45.885231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:45.885231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 489/976] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:45.893813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97be16b-67ba-448b-9988-20b797dc0f15 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:45.939764 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:45.957212 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efcf30-f3dc-4a73-b86f-3c90fe66bb91 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:45.992082 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607733b-d25e-4202-b6b8-d935bc79f75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:45.992758 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607733b-d25e-4202-b6b8-d935bc79f75f None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:45.993051 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607733b-d25e-4202-b6b8-d935bc79f75f None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:45.993361 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607733b-d25e-4202-b6b8-d935bc79f75f None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:45.994169 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607733b-d25e-4202-b6b8-d935bc79f75f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:45.994479 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607733b-d25e-4202-b6b8-d935bc79f75f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:45.995928 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607733b-d25e-4202-b6b8-d935bc79f75f None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:45.996071 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97be16b-67ba-448b-9988-20b797dc0f15 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:46.031771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c396d76-decf-4089-a6d6-19fda551c08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:46.032529 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c396d76-decf-4089-a6d6-19fda551c08f None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:46.032883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c396d76-decf-4089-a6d6-19fda551c08f None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:46.033256 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c396d76-decf-4089-a6d6-19fda551c08f None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:46.041641 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 488/977] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 19:39:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:46.041855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c396d76-decf-4089-a6d6-19fda551c08f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:46.041855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c396d76-decf-4089-a6d6-19fda551c08f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:46.042038 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c84f0-06de-4b6c-b087-1205e623faf6 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:46.042038 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c84f0-06de-4b6c-b087-1205e623faf6 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:46.042038 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c84f0-06de-4b6c-b087-1205e623faf6 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:46.042364 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c396d76-decf-4089-a6d6-19fda551c08f None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:46.042451 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 489/978] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:46.046990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b54c7-b414-4d1d-bb9f-63edb4376764 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:46.047282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b54c7-b414-4d1d-bb9f-63edb4376764 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:46.047566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b54c7-b414-4d1d-bb9f-63edb4376764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:46.059024 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 490/979] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:46.065592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c396d76-decf-4089-a6d6-19fda551c08f None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:46.074346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-8b3b54c7-b414-4d1d-bb9f-63edb4376764 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:46.075974 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-8b3b54c7-b414-4d1d-bb9f-63edb4376764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:46.138459 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:46.165274 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 490/980] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 19:39:46.189908 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b54c7-b414-4d1d-bb9f-63edb4376764 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:46.199049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c396d76-decf-4089-a6d6-19fda551c08f None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:46.202364 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:46.244109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a422b-c195-470a-bd14-01c5d19c7edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:46.244774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a422b-c195-470a-bd14-01c5d19c7edd None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:46.245057 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a422b-c195-470a-bd14-01c5d19c7edd None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:46.245367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a422b-c195-470a-bd14-01c5d19c7edd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:46.246202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a422b-c195-470a-bd14-01c5d19c7edd None admin] RBAC: Adding query filter params (role.id=cebd4ad2da474d8b9183c4a7587119c8, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=fec6c1cbf48a44f9922bd82e714861c1) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:46.246515 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a422b-c195-470a-bd14-01c5d19c7edd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:46.247952 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a422b-c195-470a-bd14-01c5d19c7edd None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:46.261257 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 491/981] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:39:46 2022] GET /identity/v3/role_assignments?user.id=fec6c1cbf48a44f9922bd82e714861c1&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=cebd4ad2da474d8b9183c4a7587119c8 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:46.325390 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b54c7-b414-4d1d-bb9f-63edb4376764 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:46.367275 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc3d34-3a83-4b09-9000-64662171b8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:46.367965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc3d34-3a83-4b09-9000-64662171b8f3 None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:46.368249 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc3d34-3a83-4b09-9000-64662171b8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:46.368528 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc3d34-3a83-4b09-9000-64662171b8f3 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:46.369313 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc3d34-3a83-4b09-9000-64662171b8f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:46.370708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc3d34-3a83-4b09-9000-64662171b8f3 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:46.459076 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 491/982] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 19:39:46 2022] POST /identity/v3/services => generated 242 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:39:47.457283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e2113-6950-48d0-afb7-1f592ba7a08a None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:47.457832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e2113-6950-48d0-afb7-1f592ba7a08a None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:47.457832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e2113-6950-48d0-afb7-1f592ba7a08a None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:47.459372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 492/983] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:47.465551 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489f2b6-b5b4-4360-9970-c1e1ccd4c9e9 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:47.465951 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489f2b6-b5b4-4360-9970-c1e1ccd4c9e9 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:47.466133 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489f2b6-b5b4-4360-9970-c1e1ccd4c9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:47.482980 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-7489f2b6-b5b4-4360-9970-c1e1ccd4c9e9 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:47.484153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-7489f2b6-b5b4-4360-9970-c1e1ccd4c9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:47.526889 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:47.560552 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 492/984] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:47.585038 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e2113-6950-48d0-afb7-1f592ba7a08a None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:47.688633 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e2113-6950-48d0-afb7-1f592ba7a08a None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:47.721746 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05a824-8402-496c-8d54-523c17960d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:47.722480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05a824-8402-496c-8d54-523c17960d8a None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:47.722767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05a824-8402-496c-8d54-523c17960d8a None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:47.723131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05a824-8402-496c-8d54-523c17960d8a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:47.723788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05a824-8402-496c-8d54-523c17960d8a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:47.725341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05a824-8402-496c-8d54-523c17960d8a None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:47.737068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-cc05a824-8402-496c-8d54-523c17960d8a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 19:39:47.737068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:47.737068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:47.737068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:47.737068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:47.737068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:47.737068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:47.737068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:47.737068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 19:39:47.737068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:47.737068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:47.737068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:47.737068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:47.737068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:47.737068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:47.737068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:47.737068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:47.738069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:47.738069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:47.738069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:47.738069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:47.738069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:47.738069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:47.738069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:47.738069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:47.738069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:47.738069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:47.738069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:47.738069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:47.738069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:47.738069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:47.738069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:47.738069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:47.738920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:47.738920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:47.738920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:47.738920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:47.738920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:47.738920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:47.738920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:47.738920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:47.738920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:47.738920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:47.738920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:47.738920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:47.738920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 19:39:47.738920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:47.741549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 493/985] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 19:39:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:47.744765 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489f2b6-b5b4-4360-9970-c1e1ccd4c9e9 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:47.846243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489f2b6-b5b4-4360-9970-c1e1ccd4c9e9 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:47.883604 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91f610-f790-4298-9d72-f96fa04dfcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:47.884278 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91f610-f790-4298-9d72-f96fa04dfcf5 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:47.884567 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91f610-f790-4298-9d72-f96fa04dfcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:47.884850 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91f610-f790-4298-9d72-f96fa04dfcf5 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:47.885601 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91f610-f790-4298-9d72-f96fa04dfcf5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:47.885914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91f610-f790-4298-9d72-f96fa04dfcf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:47.887344 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91f610-f790-4298-9d72-f96fa04dfcf5 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:47.897502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 493/986] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 23 19:39:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:47.898599 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05a824-8402-496c-8d54-523c17960d8a None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:47.933535 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:48.006113 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05a824-8402-496c-8d54-523c17960d8a None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:48.041626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555135d-f0f2-4e59-b898-4175575bdf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:48.042298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555135d-f0f2-4e59-b898-4175575bdf60 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:48.042587 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555135d-f0f2-4e59-b898-4175575bdf60 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:48.042871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555135d-f0f2-4e59-b898-4175575bdf60 None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:48.043584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555135d-f0f2-4e59-b898-4175575bdf60 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:48.044071 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555135d-f0f2-4e59-b898-4175575bdf60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:48.045481 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555135d-f0f2-4e59-b898-4175575bdf60 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:48.055105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 494/987] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 23 19:39:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:48.056619 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91f610-f790-4298-9d72-f96fa04dfcf5 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:48.093516 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:48.160612 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91f610-f790-4298-9d72-f96fa04dfcf5 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:48.195101 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60db95-4090-4bef-876d-1e672444f833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:48.195843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60db95-4090-4bef-876d-1e672444f833 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:48.196130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60db95-4090-4bef-876d-1e672444f833 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:48.196412 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60db95-4090-4bef-876d-1e672444f833 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:48.197236 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60db95-4090-4bef-876d-1e672444f833 None admin] RBAC: Adding query filter params (interface=admin, service_id=554e9fbe8cf0407284af63daaaea7edd, region_id=RegionOne) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:48.197552 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60db95-4090-4bef-876d-1e672444f833 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:48.198922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60db95-4090-4bef-876d-1e672444f833 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:48.204375 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 494/988] 10.222.0.13 () {56 vars in 1249 bytes} [Thu Jun 23 19:39:48 2022] GET /identity/v3/endpoints?service_id=554e9fbe8cf0407284af63daaaea7edd&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:48.210712 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555135d-f0f2-4e59-b898-4175575bdf60 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:48.306658 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:48.313088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555135d-f0f2-4e59-b898-4175575bdf60 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:48.336890 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafdc7c-3d71-4192-9b30-ef1ea296db9a None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:48.337251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafdc7c-3d71-4192-9b30-ef1ea296db9a None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:48.337493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafdc7c-3d71-4192-9b30-ef1ea296db9a None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:48.338992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 495/989] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:39:48.343847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216baa0-08cc-4e0d-963c-d87e85f8f2b4 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:48.344136 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216baa0-08cc-4e0d-963c-d87e85f8f2b4 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:48.344419 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216baa0-08cc-4e0d-963c-d87e85f8f2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:48.351628 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d213b-28a6-413f-aa01-f92f1245777e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:48.352296 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d213b-28a6-413f-aa01-f92f1245777e None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:48.352582 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d213b-28a6-413f-aa01-f92f1245777e None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:48.352865 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d213b-28a6-413f-aa01-f92f1245777e None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:48.353609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d213b-28a6-413f-aa01-f92f1245777e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:48.354989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d213b-28a6-413f-aa01-f92f1245777e None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:48.361202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 495/990] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 23 19:39:48 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:39:48.363304 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-b216baa0-08cc-4e0d-963c-d87e85f8f2b4 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:48.364730 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-b216baa0-08cc-4e0d-963c-d87e85f8f2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:48.441317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 496/991] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:48.465402 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d213b-28a6-413f-aa01-f92f1245777e None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:48.526237 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a9ecc-ba81-488d-a2fb-35179be04e0b None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:48.526753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a9ecc-ba81-488d-a2fb-35179be04e0b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:48.526851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a9ecc-ba81-488d-a2fb-35179be04e0b None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:48.528299 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 497/992] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:48.533012 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1016d53-5427-41e3-b5e9-e9f615d5c5f1 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:48.533333 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1016d53-5427-41e3-b5e9-e9f615d5c5f1 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:48.533618 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1016d53-5427-41e3-b5e9-e9f615d5c5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:48.552447 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-b1016d53-5427-41e3-b5e9-e9f615d5c5f1 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:48.553740 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-b1016d53-5427-41e3-b5e9-e9f615d5c5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:48.573813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d213b-28a6-413f-aa01-f92f1245777e None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:48.578291 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:48.614090 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e20002-e31c-4c37-b016-97e238b58799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:48.614879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e20002-e31c-4c37-b016-97e238b58799 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:48.615161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e20002-e31c-4c37-b016-97e238b58799 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:48.615786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e20002-e31c-4c37-b016-97e238b58799 None admin] PATH_INFO: `/v3/services/image` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:48.616686 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e20002-e31c-4c37-b016-97e238b58799 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:48.618091 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e20002-e31c-4c37-b016-97e238b58799 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:48.624026 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 498/993] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 19:39:48.630134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-11e20002-e31c-4c37-b016-97e238b58799 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 19:39:48.630134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:48.630134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:48.630134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:48.630134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:48.630134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:48.630134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:48.630134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:48.630134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 19:39:48.630134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:48.630134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:48.630134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:48.630134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:48.630134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:48.630134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:48.630134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:48.630134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:48.631157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:48.631157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:48.631157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:48.631157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:48.631157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:48.631157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:48.631157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:48.631157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:48.631157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:48.631157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:48.631157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:48.631157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:48.631157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:48.631157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:48.631157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:48.631157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:48.632827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:48.632827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:48.632827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:48.632827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:48.632827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:48.632827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:48.632827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:48.632827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:48.632827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:48.632827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:48.632827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:48.632827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:48.632827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 19:39:48.632827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:48.634254 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 496/994] 10.222.0.13 () {56 vars in 1105 bytes} [Thu Jun 23 19:39:48 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:48.637620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1016d53-5427-41e3-b5e9-e9f615d5c5f1 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:48.650832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e20002-e31c-4c37-b016-97e238b58799 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:48.677850 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:48.747705 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1016d53-5427-41e3-b5e9-e9f615d5c5f1 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:48.758264 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e20002-e31c-4c37-b016-97e238b58799 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:48.787039 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3fd53-ce78-4143-a4e1-c6edfe25fd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:48.787948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3fd53-ce78-4143-a4e1-c6edfe25fd30 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:48.788462 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3fd53-ce78-4143-a4e1-c6edfe25fd30 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:48.788582 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3fd53-ce78-4143-a4e1-c6edfe25fd30 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:48.789271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3fd53-ce78-4143-a4e1-c6edfe25fd30 None admin] RBAC: Adding query filter params (name=image) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:48.789586 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3fd53-ce78-4143-a4e1-c6edfe25fd30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:48.790961 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3fd53-ce78-4143-a4e1-c6edfe25fd30 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:48.793631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8f713-e5cf-4f13-8602-cabbd20de453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:48.794422 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8f713-e5cf-4f13-8602-cabbd20de453 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:48.794706 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8f713-e5cf-4f13-8602-cabbd20de453 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:48.794983 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8f713-e5cf-4f13-8602-cabbd20de453 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:48.795636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8f713-e5cf-4f13-8602-cabbd20de453 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:48.796095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 499/995] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:48.796991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8f713-e5cf-4f13-8602-cabbd20de453 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:48.801507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3fd53-ce78-4143-a4e1-c6edfe25fd30 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:48.809014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-eba8f713-e5cf-4f13-8602-cabbd20de453 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 19:39:48.809014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:48.809014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:48.809014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:48.809014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:48.809014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:48.809014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:48.809014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:48.809014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 19:39:48.809014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:48.809014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:48.809014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:48.809014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:48.809014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:48.809014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:48.809014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:48.809014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:48.810197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:48.810197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:48.810197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:48.810197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:48.810197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:48.810197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:48.810197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:48.810197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:48.810197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:48.810197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:48.810197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:48.810197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:48.810197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:48.810197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:48.810197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:48.810197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:48.811132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:48.811132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:48.811132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:48.811132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:48.811132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:48.811132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:48.811132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:48.811132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:48.811132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:48.811132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:48.811132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:48.811132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:48.811132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 19:39:48.811132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:48.811132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 497/996] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:48.815862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8f713-e5cf-4f13-8602-cabbd20de453 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:48.833754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:48.981529 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3fd53-ce78-4143-a4e1-c6edfe25fd30 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:49.002524 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:49.014927 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8f713-e5cf-4f13-8602-cabbd20de453 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:49.019932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce55e55-230e-41fe-8224-ddb1453e7f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:49.020598 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce55e55-230e-41fe-8224-ddb1453e7f79 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:49.022055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce55e55-230e-41fe-8224-ddb1453e7f79 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:49.022055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce55e55-230e-41fe-8224-ddb1453e7f79 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:49.022256 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce55e55-230e-41fe-8224-ddb1453e7f79 None admin] RBAC: Adding query filter params (type=image) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:49.023038 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce55e55-230e-41fe-8224-ddb1453e7f79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:49.024476 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce55e55-230e-41fe-8224-ddb1453e7f79 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:49.037188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 500/997] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:48 2022] GET /identity/v3/services?type=image => generated 122 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:49.050404 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03459ff1-e273-4f54-8020-789aca3a6e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:49.051142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03459ff1-e273-4f54-8020-789aca3a6e6e None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:49.051432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03459ff1-e273-4f54-8020-789aca3a6e6e None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:49.051713 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03459ff1-e273-4f54-8020-789aca3a6e6e None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:49.052447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03459ff1-e273-4f54-8020-789aca3a6e6e None admin] RBAC: Adding query filter params (name=compute) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:49.052767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03459ff1-e273-4f54-8020-789aca3a6e6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:49.054929 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03459ff1-e273-4f54-8020-789aca3a6e6e None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:49.061672 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 498/998] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 19:39:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:49.067232 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce55e55-230e-41fe-8224-ddb1453e7f79 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:49.161379 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:49.177853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce55e55-230e-41fe-8224-ddb1453e7f79 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:49.217264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943faa42-f9a9-4206-aab1-e3d401fab5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:49.217939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943faa42-f9a9-4206-aab1-e3d401fab5ae None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:49.218226 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943faa42-f9a9-4206-aab1-e3d401fab5ae None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:49.218504 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943faa42-f9a9-4206-aab1-e3d401fab5ae None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:49.219221 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943faa42-f9a9-4206-aab1-e3d401fab5ae None admin] RBAC: Adding query filter params (type=compute) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:49.219529 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943faa42-f9a9-4206-aab1-e3d401fab5ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:49.220913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943faa42-f9a9-4206-aab1-e3d401fab5ae None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:49.225985 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 501/999] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 19:39:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:49.231913 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03459ff1-e273-4f54-8020-789aca3a6e6e None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:49.335983 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03459ff1-e273-4f54-8020-789aca3a6e6e None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:49.370187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4cd30-4be7-4f51-8258-e40aa92b13ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:49.370849 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4cd30-4be7-4f51-8258-e40aa92b13ee None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:49.371159 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4cd30-4be7-4f51-8258-e40aa92b13ee None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:49.371440 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4cd30-4be7-4f51-8258-e40aa92b13ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:49.372233 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4cd30-4be7-4f51-8258-e40aa92b13ee None admin] RBAC: Adding query filter params (interface=public, service_id=87104e73bff04cf39c4b27e2e3c9652d, region_id=RegionOne) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:49.372547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4cd30-4be7-4f51-8258-e40aa92b13ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:49.374047 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4cd30-4be7-4f51-8258-e40aa92b13ee None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:49.384156 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 499/1000] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 23 19:39:49 2022] GET /identity/v3/endpoints?service_id=87104e73bff04cf39c4b27e2e3c9652d&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:49.385466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943faa42-f9a9-4206-aab1-e3d401fab5ae None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:49.488255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943faa42-f9a9-4206-aab1-e3d401fab5ae None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:49.525412 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780cfe5-1a8b-4c6c-9428-13f6908b49ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:49.526077 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780cfe5-1a8b-4c6c-9428-13f6908b49ae None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:49.526359 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780cfe5-1a8b-4c6c-9428-13f6908b49ae None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:49.526887 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780cfe5-1a8b-4c6c-9428-13f6908b49ae None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:49.527299 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780cfe5-1a8b-4c6c-9428-13f6908b49ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:49.528658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780cfe5-1a8b-4c6c-9428-13f6908b49ae None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:49.535130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 502/1001] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 23 19:39:49 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:39:50.435731 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3613a-6583-4c1f-b8d1-0796636194a2 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:50.436284 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3613a-6583-4c1f-b8d1-0796636194a2 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:50.436284 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3613a-6583-4c1f-b8d1-0796636194a2 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:50.437861 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 500/1002] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:50.442784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfdfcd-2b6e-408b-93c5-610b39f17da7 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:50.443082 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfdfcd-2b6e-408b-93c5-610b39f17da7 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:50.443371 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfdfcd-2b6e-408b-93c5-610b39f17da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:50.461638 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-0ebfdfcd-2b6e-408b-93c5-610b39f17da7 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:50.462822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-0ebfdfcd-2b6e-408b-93c5-610b39f17da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:50.472162 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:50.532049 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 503/1003] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:50.555520 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3613a-6583-4c1f-b8d1-0796636194a2 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:50.574849 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:50.662327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3613a-6583-4c1f-b8d1-0796636194a2 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:50.696731 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a0fa8-6da1-4c46-a961-61d7e6c3e74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:50.697487 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a0fa8-6da1-4c46-a961-61d7e6c3e74e None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:50.697779 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a0fa8-6da1-4c46-a961-61d7e6c3e74e None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:50.698061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a0fa8-6da1-4c46-a961-61d7e6c3e74e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:50.698720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a0fa8-6da1-4c46-a961-61d7e6c3e74e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:50.700097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a0fa8-6da1-4c46-a961-61d7e6c3e74e None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:50.712615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-414a0fa8-6da1-4c46-a961-61d7e6c3e74e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 19:39:50.712615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:50.712615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:50.712615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:50.712615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:50.712615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:50.712615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:50.712615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:50.712615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 19:39:50.712615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:50.712615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:50.712615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:50.712615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:50.712615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:50.712615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:50.712615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:50.712615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:50.713662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:50.713662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:50.713662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:50.713662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:50.713662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:50.713662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:50.713662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:50.713662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:50.713662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:50.713662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:50.713662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:50.713662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:50.713662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:50.713662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:50.713662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:50.713662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:50.714521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:50.714521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:50.714521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:50.714521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:50.714521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:50.714521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:50.714521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:50.714521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:50.714521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:50.714521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:50.714521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:50.714521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:50.714521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 19:39:50.714521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:50.717511 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 501/1004] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 19:39:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:50.719720 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfdfcd-2b6e-408b-93c5-610b39f17da7 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:50.822222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfdfcd-2b6e-408b-93c5-610b39f17da7 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:50.855990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5e05e-3e80-4b18-9f64-e46c7348dafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:50.856602 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5e05e-3e80-4b18-9f64-e46c7348dafc None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:50.856882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5e05e-3e80-4b18-9f64-e46c7348dafc None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:50.857171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5e05e-3e80-4b18-9f64-e46c7348dafc None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:50.857881 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5e05e-3e80-4b18-9f64-e46c7348dafc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:50.858184 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5e05e-3e80-4b18-9f64-e46c7348dafc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:50.859537 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5e05e-3e80-4b18-9f64-e46c7348dafc None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:50.869271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 504/1005] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 23 19:39:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:50.870220 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a0fa8-6da1-4c46-a961-61d7e6c3e74e None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:50.958583 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:50.978298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a0fa8-6da1-4c46-a961-61d7e6c3e74e None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:51.013030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1215df-9fc1-4436-af0b-3c75004a8b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:51.013755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1215df-9fc1-4436-af0b-3c75004a8b99 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:51.014047 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1215df-9fc1-4436-af0b-3c75004a8b99 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:51.014330 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1215df-9fc1-4436-af0b-3c75004a8b99 None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:51.015049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1215df-9fc1-4436-af0b-3c75004a8b99 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:51.015362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1215df-9fc1-4436-af0b-3c75004a8b99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:51.016808 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1215df-9fc1-4436-af0b-3c75004a8b99 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:51.025515 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 502/1006] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 23 19:39:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:51.028013 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5e05e-3e80-4b18-9f64-e46c7348dafc None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:51.039520 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:51.090271 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cc508-5ad7-4a1d-a967-56f360c5509f None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:51.090597 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cc508-5ad7-4a1d-a967-56f360c5509f None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:51.090842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cc508-5ad7-4a1d-a967-56f360c5509f None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:51.092354 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 503/1007] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:51.096921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaee539-4025-4292-98ec-98aec7d7372e None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:51.097249 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaee539-4025-4292-98ec-98aec7d7372e None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:51.097532 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaee539-4025-4292-98ec-98aec7d7372e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:51.114514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-daaee539-4025-4292-98ec-98aec7d7372e None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:51.116390 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-daaee539-4025-4292-98ec-98aec7d7372e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:51.137005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5e05e-3e80-4b18-9f64-e46c7348dafc None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:51.174934 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca5a05-9811-45fa-93d3-bc2feed7413d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:51.175599 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca5a05-9811-45fa-93d3-bc2feed7413d None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:51.175917 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca5a05-9811-45fa-93d3-bc2feed7413d None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:51.176189 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca5a05-9811-45fa-93d3-bc2feed7413d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:51.176980 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca5a05-9811-45fa-93d3-bc2feed7413d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:51.179199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca5a05-9811-45fa-93d3-bc2feed7413d None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:51.185072 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 504/1008] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:51.209076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaee539-4025-4292-98ec-98aec7d7372e None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:51.252789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 505/1009] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 23 19:39:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:39:51.288770 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:51.315657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaee539-4025-4292-98ec-98aec7d7372e None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:51.360780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08678086-6c5a-4558-bffd-fad5386d6c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:51.361575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08678086-6c5a-4558-bffd-fad5386d6c4a None admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:51.361865 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08678086-6c5a-4558-bffd-fad5386d6c4a None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:51.362144 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08678086-6c5a-4558-bffd-fad5386d6c4a None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:51.362873 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08678086-6c5a-4558-bffd-fad5386d6c4a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:51.364271 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08678086-6c5a-4558-bffd-fad5386d6c4a None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:51.434253 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 505/1010] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 19:39:51 2022] POST /identity/v3/services => generated 242 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:39:51.613474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d7f55-0457-4ce2-90ff-7caba37caae0 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:51.613974 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d7f55-0457-4ce2-90ff-7caba37caae0 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:51.613974 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d7f55-0457-4ce2-90ff-7caba37caae0 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:51.615349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 506/1011] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:51.621327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada008cd-32f1-44b6-8048-1000f9a53de9 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:51.621790 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada008cd-32f1-44b6-8048-1000f9a53de9 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:51.621974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada008cd-32f1-44b6-8048-1000f9a53de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:51.639581 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-ada008cd-32f1-44b6-8048-1000f9a53de9 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:51.640776 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ada008cd-32f1-44b6-8048-1000f9a53de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:51.716335 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 506/1012] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:51 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:51.739770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d7f55-0457-4ce2-90ff-7caba37caae0 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:51.810492 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:51.845203 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d7f55-0457-4ce2-90ff-7caba37caae0 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:51.881852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdbdfd-0ab9-41ed-a619-bfc701abe070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:51.883090 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdbdfd-0ab9-41ed-a619-bfc701abe070 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:51.883619 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdbdfd-0ab9-41ed-a619-bfc701abe070 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:51.884114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdbdfd-0ab9-41ed-a619-bfc701abe070 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:51.884988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdbdfd-0ab9-41ed-a619-bfc701abe070 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:51.886602 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdbdfd-0ab9-41ed-a619-bfc701abe070 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:51.899949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-43cdbdfd-0ab9-41ed-a619-bfc701abe070 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 19:39:51.899949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:51.899949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:51.899949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:51.899949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:51.899949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:51.899949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:51.899949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:51.899949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 19:39:51.899949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:51.899949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:51.899949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:51.899949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:51.899949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:51.899949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:51.899949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:51.899949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:51.900922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:51.900922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:51.900922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:51.900922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:51.900922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:51.900922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:51.900922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:51.900922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:51.900922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:51.900922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:51.900922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:51.900922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:51.900922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:51.900922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:51.900922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:51.900922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:51.905813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:51.905813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:51.905813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:51.905813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:51.905813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:51.905813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:51.905813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:51.905813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:51.905813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:51.905813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:51.905813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:51.905813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:51.905813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 19:39:51.905813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:51.905813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 507/1013] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:51.909481 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada008cd-32f1-44b6-8048-1000f9a53de9 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:51.966400 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:52.010971 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada008cd-32f1-44b6-8048-1000f9a53de9 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:52.046105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49158d-cbf3-48cc-b197-d6c94f72cd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:52.046770 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49158d-cbf3-48cc-b197-d6c94f72cd90 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:52.047056 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49158d-cbf3-48cc-b197-d6c94f72cd90 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:52.047335 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49158d-cbf3-48cc-b197-d6c94f72cd90 None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:52.048046 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49158d-cbf3-48cc-b197-d6c94f72cd90 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:52.048353 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49158d-cbf3-48cc-b197-d6c94f72cd90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:52.049760 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49158d-cbf3-48cc-b197-d6c94f72cd90 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:52.059841 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 507/1014] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 19:39:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:52.061373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdbdfd-0ab9-41ed-a619-bfc701abe070 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:52.163481 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdbdfd-0ab9-41ed-a619-bfc701abe070 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:52.192182 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:52.198603 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aa87e-0e95-444a-a905-dcc8429c8ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:52.199272 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aa87e-0e95-444a-a905-dcc8429c8ba7 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:52.199559 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aa87e-0e95-444a-a905-dcc8429c8ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:52.199836 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aa87e-0e95-444a-a905-dcc8429c8ba7 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:52.200536 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432aa87e-0e95-444a-a905-dcc8429c8ba7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:52.200843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432aa87e-0e95-444a-a905-dcc8429c8ba7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:52.202253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432aa87e-0e95-444a-a905-dcc8429c8ba7 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:52.207083 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 508/1015] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 19:39:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:52.212968 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49158d-cbf3-48cc-b197-d6c94f72cd90 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:52.313484 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49158d-cbf3-48cc-b197-d6c94f72cd90 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:52.333776 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:52.348335 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f91813-4979-4966-b5d3-cc82c883e67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:52.348995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f91813-4979-4966-b5d3-cc82c883e67d None admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:52.349311 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f91813-4979-4966-b5d3-cc82c883e67d None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:52.349592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f91813-4979-4966-b5d3-cc82c883e67d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:52.351058 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f91813-4979-4966-b5d3-cc82c883e67d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:52.352434 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f91813-4979-4966-b5d3-cc82c883e67d None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:52.429275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 508/1016] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 23 19:39:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:39:53.352851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b3555-5ca4-471d-b2e3-b7abbbe76aff None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:53.353394 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b3555-5ca4-471d-b2e3-b7abbbe76aff None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:53.353394 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b3555-5ca4-471d-b2e3-b7abbbe76aff None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:53.354876 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 509/1017] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:53.359854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b546c-7167-4b95-b954-5d61d27ddc57 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:53.360233 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b546c-7167-4b95-b954-5d61d27ddc57 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:53.360427 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b546c-7167-4b95-b954-5d61d27ddc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:53.377024 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-d09b546c-7167-4b95-b954-5d61d27ddc57 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:53.378249 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d09b546c-7167-4b95-b954-5d61d27ddc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:53.451916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 509/1018] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:53.475561 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b3555-5ca4-471d-b2e3-b7abbbe76aff None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:53.532768 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012df14-7e9f-4e10-b009-b0fbf7edba04 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:53.533129 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012df14-7e9f-4e10-b009-b0fbf7edba04 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:53.533365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012df14-7e9f-4e10-b009-b0fbf7edba04 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:53.534845 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 510/1019] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:39:53.540159 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3fc95-5462-4e7d-8f27-388e46d57891 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:53.540444 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3fc95-5462-4e7d-8f27-388e46d57891 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:53.540722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3fc95-5462-4e7d-8f27-388e46d57891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:53.558021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-e3f3fc95-5462-4e7d-8f27-388e46d57891 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:53.559200 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e3f3fc95-5462-4e7d-8f27-388e46d57891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:53.582504 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b3555-5ca4-471d-b2e3-b7abbbe76aff None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:53.623140 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2019220-25b5-480a-801f-1fe576c2c780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:53.623917 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2019220-25b5-480a-801f-1fe576c2c780 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:53.624206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2019220-25b5-480a-801f-1fe576c2c780 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:53.624484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2019220-25b5-480a-801f-1fe576c2c780 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:53.625805 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2019220-25b5-480a-801f-1fe576c2c780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:53.627277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2019220-25b5-480a-801f-1fe576c2c780 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:53.629225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 510/1020] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:53.630767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 511/1021] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 19:39:53.635368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2019220-25b5-480a-801f-1fe576c2c780 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:53.654380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3fc95-5462-4e7d-8f27-388e46d57891 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:53.685457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:53.704611 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:53.744444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2019220-25b5-480a-801f-1fe576c2c780 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:53.760697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3fc95-5462-4e7d-8f27-388e46d57891 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:53.781185 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efded49-a5ca-44f2-93d6-a71cfaa53e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:53.782188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efded49-a5ca-44f2-93d6-a71cfaa53e67 None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:53.782670 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efded49-a5ca-44f2-93d6-a71cfaa53e67 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:53.783020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efded49-a5ca-44f2-93d6-a71cfaa53e67 None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:53.783805 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efded49-a5ca-44f2-93d6-a71cfaa53e67 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:53.785551 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efded49-a5ca-44f2-93d6-a71cfaa53e67 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:53.795169 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32076fb1-160e-42cb-be99-0351d747dac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:53.795959 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32076fb1-160e-42cb-be99-0351d747dac9 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:53.796247 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32076fb1-160e-42cb-be99-0351d747dac9 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:53.796525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32076fb1-160e-42cb-be99-0351d747dac9 None admin] PATH_INFO: `/v3/services/image` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:53.797200 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32076fb1-160e-42cb-be99-0351d747dac9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:53.798572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32076fb1-160e-42cb-be99-0351d747dac9 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:53.810631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-32076fb1-160e-42cb-be99-0351d747dac9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 19:39:53.810631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:53.810631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:53.810631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:53.810631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:53.810631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:53.810631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:53.810631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:53.810631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 19:39:53.810631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:53.810631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:53.810631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:53.810631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:53.810631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:53.810631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:53.810631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:53.810631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:53.817210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:53.817210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:53.817210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:53.817210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:53.817210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:53.817210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:53.817210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:53.817210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:53.817210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:53.817210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:53.817210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:53.817210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:53.817210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:53.817210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:53.817210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:53.817210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:53.818280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:53.818280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:53.818280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:53.818280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:53.818280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:53.818280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:53.818280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:53.818280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:53.818280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:53.818280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:53.818280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:53.818280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:53.818280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 19:39:53.818280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:53.818280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 512/1022] 10.222.0.13 () {56 vars in 1105 bytes} [Thu Jun 23 19:39:53 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:53.820106 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32076fb1-160e-42cb-be99-0351d747dac9 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:53.871986 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 511/1023] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 19:39:53 2022] POST /identity/v3/projects => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:39:53.935602 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:53.941815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32076fb1-160e-42cb-be99-0351d747dac9 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:53.979217 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fabb7-f2c9-4470-9270-bf9c41c5a4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:53.979890 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fabb7-f2c9-4470-9270-bf9c41c5a4d4 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:53.980176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fabb7-f2c9-4470-9270-bf9c41c5a4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:53.980452 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fabb7-f2c9-4470-9270-bf9c41c5a4d4 None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:53.981207 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fabb7-f2c9-4470-9270-bf9c41c5a4d4 None admin] RBAC: Adding query filter params (name=image) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:53.981511 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fabb7-f2c9-4470-9270-bf9c41c5a4d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:53.982908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fabb7-f2c9-4470-9270-bf9c41c5a4d4 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:53.994375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 513/1024] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:53.995400 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efded49-a5ca-44f2-93d6-a71cfaa53e67 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:54.098977 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efded49-a5ca-44f2-93d6-a71cfaa53e67 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:54.116549 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:54.134622 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b89d5d-e2dd-4c7b-9f54-d242be4188fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:54.135296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b89d5d-e2dd-4c7b-9f54-d242be4188fa None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:54.135581 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b89d5d-e2dd-4c7b-9f54-d242be4188fa None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:54.135861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b89d5d-e2dd-4c7b-9f54-d242be4188fa None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:54.136571 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b89d5d-e2dd-4c7b-9f54-d242be4188fa None admin] RBAC: Adding query filter params (type=image) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:54.136880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b89d5d-e2dd-4c7b-9f54-d242be4188fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:54.138288 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b89d5d-e2dd-4c7b-9f54-d242be4188fa None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:54.143323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 512/1025] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:54.150176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fabb7-f2c9-4470-9270-bf9c41c5a4d4 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:54.253672 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fabb7-f2c9-4470-9270-bf9c41c5a4d4 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:54.287806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb4afe-5777-4537-94a6-2c60fb1bad28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:54.288460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb4afe-5777-4537-94a6-2c60fb1bad28 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:54.288747 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb4afe-5777-4537-94a6-2c60fb1bad28 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:54.289024 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb4afe-5777-4537-94a6-2c60fb1bad28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:54.289840 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb4afe-5777-4537-94a6-2c60fb1bad28 None admin] RBAC: Adding query filter params (interface=public, service_id=19b3954b5974482791c87992d7abdbde, region_id=RegionOne) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:54.290154 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb4afe-5777-4537-94a6-2c60fb1bad28 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:54.291593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb4afe-5777-4537-94a6-2c60fb1bad28 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:54.301208 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 514/1026] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 23 19:39:54 2022] GET /identity/v3/endpoints?service_id=19b3954b5974482791c87992d7abdbde&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:54.302315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b89d5d-e2dd-4c7b-9f54-d242be4188fa None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:54.406480 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b89d5d-e2dd-4c7b-9f54-d242be4188fa None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:54.441536 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbe039-641a-46ea-8bed-78d0f2f398e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:54.442212 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbe039-641a-46ea-8bed-78d0f2f398e0 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:54.442499 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbe039-641a-46ea-8bed-78d0f2f398e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:54.442780 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbe039-641a-46ea-8bed-78d0f2f398e0 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:54.443469 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbe039-641a-46ea-8bed-78d0f2f398e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:54.445917 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbe039-641a-46ea-8bed-78d0f2f398e0 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:54.461251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 513/1027] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 23 19:39:54 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:39:54.586182 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511c626-3f3d-4ccc-8c16-e75cafafd130 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:54.586704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511c626-3f3d-4ccc-8c16-e75cafafd130 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:54.586704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511c626-3f3d-4ccc-8c16-e75cafafd130 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:54.588208 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 515/1028] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:54.593813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c6a79-2321-47b8-b7be-5d52ae388b18 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:54.594098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c6a79-2321-47b8-b7be-5d52ae388b18 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:54.594383 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c6a79-2321-47b8-b7be-5d52ae388b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:54.612550 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-c63c6a79-2321-47b8-b7be-5d52ae388b18 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:54.613785 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-c63c6a79-2321-47b8-b7be-5d52ae388b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:54.658910 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:54.689200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 514/1029] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:54.711908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511c626-3f3d-4ccc-8c16-e75cafafd130 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:54.738483 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:54.816503 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511c626-3f3d-4ccc-8c16-e75cafafd130 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:54.851601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328bbf1-3f46-46a3-a2fa-e640f6d2f402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:54.852345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328bbf1-3f46-46a3-a2fa-e640f6d2f402 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:54.852631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328bbf1-3f46-46a3-a2fa-e640f6d2f402 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:54.852910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328bbf1-3f46-46a3-a2fa-e640f6d2f402 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:54.863451 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328bbf1-3f46-46a3-a2fa-e640f6d2f402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:54.871517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-a328bbf1-3f46-46a3-a2fa-e640f6d2f402 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 19:39:54.871517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:54.871517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:54.871517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:54.871517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:54.871517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:54.871517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:54.871517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:54.871517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:54.871517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:54.871517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:54.871517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:54.871517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:54.871517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:54.871517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:54.871517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:54.872500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:54.872500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:54.872500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:54.872500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:54.872500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:54.872500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:54.872500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:54.872500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:54.872500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:54.872500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:54.872500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:54.872500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:54.872500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:54.872500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:54.872500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:54.872500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:54.873461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:54.873461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:54.873461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:54.873461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:54.873461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:54.873461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:54.873461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:54.873461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:54.873461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:54.873461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:54.873461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 19:39:54.873461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:54.878685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 516/1030] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Jun 23 19:39:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:54.879730 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c6a79-2321-47b8-b7be-5d52ae388b18 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:54.988921 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c6a79-2321-47b8-b7be-5d52ae388b18 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:55.025008 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4daec-10f1-45dc-8e21-37d32452839a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:55.025727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4daec-10f1-45dc-8e21-37d32452839a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:55.026015 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4daec-10f1-45dc-8e21-37d32452839a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:55.026293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4daec-10f1-45dc-8e21-37d32452839a None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:55.027050 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4daec-10f1-45dc-8e21-37d32452839a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:55.027361 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4daec-10f1-45dc-8e21-37d32452839a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:55.028745 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4daec-10f1-45dc-8e21-37d32452839a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:55.039196 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 515/1031] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 23 19:39:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:55.044981 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328bbf1-3f46-46a3-a2fa-e640f6d2f402 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:55.133838 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:55.150531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328bbf1-3f46-46a3-a2fa-e640f6d2f402 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:55.185782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a3e22-4be6-45e1-acb1-1cd24437e9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:55.186575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a3e22-4be6-45e1-acb1-1cd24437e9ee None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:55.186861 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a3e22-4be6-45e1-acb1-1cd24437e9ee None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:55.187141 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a3e22-4be6-45e1-acb1-1cd24437e9ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:55.197592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a3e22-4be6-45e1-acb1-1cd24437e9ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:55.199039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a3e22-4be6-45e1-acb1-1cd24437e9ee None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:55.216916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-4d8a3e22-4be6-45e1-acb1-1cd24437e9ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:55.216916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:55.216916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:55.216916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:55.216916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:55.216916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:55.216916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:55.216916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:55.216916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:55.216916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:55.216916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:55.216916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:55.216916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:55.216916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:55.216916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:55.217869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:55.217869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:55.217869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:55.217869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:55.217869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:55.217869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:55.217869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:55.217869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:55.217869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:55.217869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:55.217869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:55.217869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:55.217869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:55.217869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:55.217869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:55.217869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:55.217869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:55.223441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:55.223441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:55.223441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:55.223441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:55.223441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 517/1032] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:55.226179 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4daec-10f1-45dc-8e21-37d32452839a None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:55.262920 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:55.326861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4daec-10f1-45dc-8e21-37d32452839a None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:55.360501 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63e34b-8d02-4d1a-8dd2-7908f30b1e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:55.361239 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63e34b-8d02-4d1a-8dd2-7908f30b1e21 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:55.361477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63e34b-8d02-4d1a-8dd2-7908f30b1e21 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:55.361758 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63e34b-8d02-4d1a-8dd2-7908f30b1e21 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:55.362478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63e34b-8d02-4d1a-8dd2-7908f30b1e21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:55.362789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63e34b-8d02-4d1a-8dd2-7908f30b1e21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:55.364155 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63e34b-8d02-4d1a-8dd2-7908f30b1e21 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:55.376137 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 516/1033] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:55.382148 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a3e22-4be6-45e1-acb1-1cd24437e9ee None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:55.485214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a3e22-4be6-45e1-acb1-1cd24437e9ee None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:55.519574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e298d61-75f9-4a8e-aaa7-094ce749c9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:55.520373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e298d61-75f9-4a8e-aaa7-094ce749c9b6 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:55.520659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e298d61-75f9-4a8e-aaa7-094ce749c9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:55.520935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e298d61-75f9-4a8e-aaa7-094ce749c9b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:55.523868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:55.529542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e298d61-75f9-4a8e-aaa7-094ce749c9b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:55.530999 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e298d61-75f9-4a8e-aaa7-094ce749c9b6 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:55.545885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-2e298d61-75f9-4a8e-aaa7-094ce749c9b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 19:39:55.545885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:55.545885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:55.545885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:55.545885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:55.545885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:55.545885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:55.545885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:55.545885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:55.545885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:55.545885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:55.545885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:55.545885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:39:55.545885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:39:55.545885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:39:55.545885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:39:55.546910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:55.546910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:55.546910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:39:55.546910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:55.546910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:39:55.546910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:39:55.546910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:55.546910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:55.546910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:55.546910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:55.546910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:55.546910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:55.546910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:55.546910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:55.546910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:55.546910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:55.546910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:55.546910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:55.552593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:55.552593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:55.552593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:39:55.552593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:39:55.552593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:39:55.552593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:39:55.552593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:39:55.552593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:39:55.552593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 19:39:55.552593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:55.552593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 518/1034] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 23 19:39:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:55.555748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63e34b-8d02-4d1a-8dd2-7908f30b1e21 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:55.656784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:55.663237 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63e34b-8d02-4d1a-8dd2-7908f30b1e21 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:55.698461 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacc16c-d635-4383-b99d-0f39e2b2fbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:55.699140 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacc16c-d635-4383-b99d-0f39e2b2fbc1 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:55.699429 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacc16c-d635-4383-b99d-0f39e2b2fbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:55.699712 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacc16c-d635-4383-b99d-0f39e2b2fbc1 None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:55.700548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdacc16c-d635-4383-b99d-0f39e2b2fbc1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:55.700860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdacc16c-d635-4383-b99d-0f39e2b2fbc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:55.702325 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdacc16c-d635-4383-b99d-0f39e2b2fbc1 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:55.724329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 517/1035] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 23 19:39:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:55.725856 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e298d61-75f9-4a8e-aaa7-094ce749c9b6 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:55.829933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e298d61-75f9-4a8e-aaa7-094ce749c9b6 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:55.863489 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961666b-750e-40d0-b824-07126b1de4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:55.864143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961666b-750e-40d0-b824-07126b1de4fb None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:55.864430 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961666b-750e-40d0-b824-07126b1de4fb None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:55.864717 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961666b-750e-40d0-b824-07126b1de4fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:55.934873 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:55.941789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961666b-750e-40d0-b824-07126b1de4fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:55.943320 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961666b-750e-40d0-b824-07126b1de4fb None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:55.986123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dc25b-f3c8-418c-b288-06307fa532db None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:55.986445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dc25b-f3c8-418c-b288-06307fa532db None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:55.986681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dc25b-f3c8-418c-b288-06307fa532db None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:55.988067 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 518/1036] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:39:55.993429 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ce61b-c0ff-4951-b310-f56b4b264494 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:55.993719 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ce61b-c0ff-4951-b310-f56b4b264494 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:55.994001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ce61b-c0ff-4951-b310-f56b4b264494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:56.011060 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-0d5ce61b-c0ff-4951-b310-f56b4b264494 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:56.012246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-0d5ce61b-c0ff-4951-b310-f56b4b264494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:56.059930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 519/1037] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:39:55 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 19:39:56.061003 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961666b-750e-40d0-b824-07126b1de4fb None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:56.085947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 519/1038] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 19:39:56.110592 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ce61b-c0ff-4951-b310-f56b4b264494 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:56.161755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:56.168742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961666b-750e-40d0-b824-07126b1de4fb None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:56.192690 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:56.205746 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ba631-1893-4607-beef-9f4243feb1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:56.206742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ba631-1893-4607-beef-9f4243feb1d3 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:56.207176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ba631-1893-4607-beef-9f4243feb1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:56.207637 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ba631-1893-4607-beef-9f4243feb1d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:56.208937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ce61b-c0ff-4951-b310-f56b4b264494 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:56.218674 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ba631-1893-4607-beef-9f4243feb1d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:56.220316 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ba631-1893-4607-beef-9f4243feb1d3 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:56.238765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-cb6ba631-1893-4607-beef-9f4243feb1d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:56.238765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:56.238765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:56.238765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:56.238765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:56.238765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:56.238765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:56.238765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:56.238765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:56.238765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:56.238765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:56.238765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:56.238765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:56.238765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:56.238765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:56.239910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:56.239910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:56.239910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:56.239910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:56.239910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:56.239910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:56.239910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:56.239910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:56.239910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:56.239910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:56.239910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:56.239910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:56.239910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:56.239910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:56.239910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:56.239910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:56.239910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:56.241068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:56.241068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:56.241068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:56.241068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:56.242787 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 520/1039] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:56.248094 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ba631-1893-4607-beef-9f4243feb1d3 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:56.249141 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217c719-f59f-443a-acf3-c8b16d3fe9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:56.249966 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217c719-f59f-443a-acf3-c8b16d3fe9d1 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:56.250250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217c719-f59f-443a-acf3-c8b16d3fe9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:56.250524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217c719-f59f-443a-acf3-c8b16d3fe9d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:56.251704 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217c719-f59f-443a-acf3-c8b16d3fe9d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:56.253139 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217c719-f59f-443a-acf3-c8b16d3fe9d1 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:56.254781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 520/1040] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:56.261971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217c719-f59f-443a-acf3-c8b16d3fe9d1 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:56.355934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ba631-1893-4607-beef-9f4243feb1d3 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:56.362598 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217c719-f59f-443a-acf3-c8b16d3fe9d1 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:56.392792 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391f18c-671d-4fdc-93e1-9d48e96e36ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:56.393493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391f18c-671d-4fdc-93e1-9d48e96e36ed None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:56.393777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391f18c-671d-4fdc-93e1-9d48e96e36ed None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:56.394091 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391f18c-671d-4fdc-93e1-9d48e96e36ed None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:56.394773 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391f18c-671d-4fdc-93e1-9d48e96e36ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:56.395079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391f18c-671d-4fdc-93e1-9d48e96e36ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:56.396439 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391f18c-671d-4fdc-93e1-9d48e96e36ed None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:56.401602 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870028e-418d-4dd2-9984-a6d171748544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:56.402281 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870028e-418d-4dd2-9984-a6d171748544 None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:56.402568 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870028e-418d-4dd2-9984-a6d171748544 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:56.402849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870028e-418d-4dd2-9984-a6d171748544 None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:56.403560 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870028e-418d-4dd2-9984-a6d171748544 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:56.404980 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870028e-418d-4dd2-9984-a6d171748544 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:56.413734 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 521/1041] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:56.414580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391f18c-671d-4fdc-93e1-9d48e96e36ed None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:56.426189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:56.486735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 521/1042] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 19:39:56 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:39:56.518395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391f18c-671d-4fdc-93e1-9d48e96e36ed None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:56.556035 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17301ee9-ef14-4a76-8955-9f9df537781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:56.556860 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17301ee9-ef14-4a76-8955-9f9df537781c None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:56.557144 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17301ee9-ef14-4a76-8955-9f9df537781c None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:56.557447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17301ee9-ef14-4a76-8955-9f9df537781c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:56.565069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17301ee9-ef14-4a76-8955-9f9df537781c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:56.566750 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17301ee9-ef14-4a76-8955-9f9df537781c None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:56.571166 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7fcc5-7082-4dd9-9418-1ed29a972f26 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:56.571725 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7fcc5-7082-4dd9-9418-1ed29a972f26 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:56.571725 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7fcc5-7082-4dd9-9418-1ed29a972f26 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:56.573331 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 522/1043] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:39:56.578694 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b489e-69e7-4cba-994b-1c8e382be220 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:56.578984 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b489e-69e7-4cba-994b-1c8e382be220 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:56.579266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b489e-69e7-4cba-994b-1c8e382be220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:56.583301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-17301ee9-ef14-4a76-8955-9f9df537781c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:56.583301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:56.583301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:56.583301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:56.583301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:56.583301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:56.583301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:56.583301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:56.583301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:56.583301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:56.583301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:56.583301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:56.583301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:39:56.583301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:39:56.583301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:39:56.584225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:39:56.584225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:56.584225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:56.584225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:56.584225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:56.584225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:56.584225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:56.584225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:56.584225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:56.584225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:56.584225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:56.584225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:56.584225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:56.584225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:56.584225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:56.584225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:56.584225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:56.585415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:39:56.585415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:39:56.585415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:39:56.585415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:39:56.585415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:39:56.585415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:39:56.585415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:39:56.585415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:56.585415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 522/1044] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:56.591054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17301ee9-ef14-4a76-8955-9f9df537781c None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:56.601103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-e73b489e-69e7-4cba-994b-1c8e382be220 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:56.602447 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e73b489e-69e7-4cba-994b-1c8e382be220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:56.605590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:56.667098 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:56.682470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 523/1045] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 19:39:56.705988 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17301ee9-ef14-4a76-8955-9f9df537781c None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:56.706658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b489e-69e7-4cba-994b-1c8e382be220 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:56.746437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f549b54-5675-45ec-9e87-e1243b2c843e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:56.747108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f549b54-5675-45ec-9e87-e1243b2c843e None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:56.747397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f549b54-5675-45ec-9e87-e1243b2c843e None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:56.747677 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f549b54-5675-45ec-9e87-e1243b2c843e None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:56.748475 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f549b54-5675-45ec-9e87-e1243b2c843e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:56.748790 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f549b54-5675-45ec-9e87-e1243b2c843e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:56.751096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f549b54-5675-45ec-9e87-e1243b2c843e None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:56.764083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 523/1046] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:39:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:56.770183 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f549b54-5675-45ec-9e87-e1243b2c843e None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:56.835252 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b489e-69e7-4cba-994b-1c8e382be220 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:56.872793 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326fa3e-ff00-408d-b3fd-ba04ceeae98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:56.873623 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326fa3e-ff00-408d-b3fd-ba04ceeae98c None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:56.873907 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326fa3e-ff00-408d-b3fd-ba04ceeae98c None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:56.874187 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326fa3e-ff00-408d-b3fd-ba04ceeae98c None admin] PATH_INFO: `/v3/services/image` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:56.874944 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326fa3e-ff00-408d-b3fd-ba04ceeae98c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:56.876335 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326fa3e-ff00-408d-b3fd-ba04ceeae98c None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:56.885645 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f549b54-5675-45ec-9e87-e1243b2c843e None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:56.888750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-f326fa3e-ff00-408d-b3fd-ba04ceeae98c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 19:39:56.888750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:56.888750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:39:56.888750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:39:56.888750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:39:56.888750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:39:56.888750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:39:56.888750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:56.888750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 19:39:56.888750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:56.888750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:39:56.888750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:56.888750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:56.888750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:56.888750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:56.888750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:56.888750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:56.889955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:56.889955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:56.889955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:56.889955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:56.889955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:56.889955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:56.889955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:39:56.889955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:39:56.889955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:39:56.889955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:39:56.889955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:56.889955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:56.889955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:56.889955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:56.889955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:56.889955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:56.890812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:56.890812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:56.890812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:56.890812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:56.890812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:56.890812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:56.890812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:56.890812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:56.890812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:56.890812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:56.890812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:39:56.890812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:39:56.890812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 19:39:56.890812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:39:56.890812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 524/1047] 10.222.0.13 () {56 vars in 1105 bytes} [Thu Jun 23 19:39:56 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:56.895710 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326fa3e-ff00-408d-b3fd-ba04ceeae98c None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:56.899434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:56.918599 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:56.928877 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20854627-0266-4c39-8282-2f9140f6fc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:56.929805 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20854627-0266-4c39-8282-2f9140f6fc35 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:56.930122 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20854627-0266-4c39-8282-2f9140f6fc35 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:56.930370 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20854627-0266-4c39-8282-2f9140f6fc35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:56.931200 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20854627-0266-4c39-8282-2f9140f6fc35 None admin] RBAC: Adding query filter params (role.id=cebd4ad2da474d8b9183c4a7587119c8, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=83bff5cd7782423eaa0bc5b29b208ae7) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:56.931513 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20854627-0266-4c39-8282-2f9140f6fc35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:56.932946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20854627-0266-4c39-8282-2f9140f6fc35 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:56.938605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 524/1048] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:39:56 2022] GET /identity/v3/role_assignments?user.id=83bff5cd7782423eaa0bc5b29b208ae7&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=cebd4ad2da474d8b9183c4a7587119c8 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:57.008255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326fa3e-ff00-408d-b3fd-ba04ceeae98c None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:57.047013 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db42f5-f629-4b37-8352-1a31626af37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:57.047696 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db42f5-f629-4b37-8352-1a31626af37f None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:57.047977 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db42f5-f629-4b37-8352-1a31626af37f None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:57.048251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db42f5-f629-4b37-8352-1a31626af37f None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:57.048967 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db42f5-f629-4b37-8352-1a31626af37f None admin] RBAC: Adding query filter params (name=image) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:57.049301 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db42f5-f629-4b37-8352-1a31626af37f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:57.050689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db42f5-f629-4b37-8352-1a31626af37f None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:57.061138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 525/1049] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:57.062563 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20854627-0266-4c39-8282-2f9140f6fc35 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:57.169933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20854627-0266-4c39-8282-2f9140f6fc35 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:57.203904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9253b-b1e7-4f9a-a7a2-d2fde5a3af9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:57.204858 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9253b-b1e7-4f9a-a7a2-d2fde5a3af9b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:57.205347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9253b-b1e7-4f9a-a7a2-d2fde5a3af9b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:57.205800 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9253b-b1e7-4f9a-a7a2-d2fde5a3af9b None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:57.206705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9253b-b1e7-4f9a-a7a2-d2fde5a3af9b None admin] RBAC: Adding query filter params (type=image) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:57.207188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9253b-b1e7-4f9a-a7a2-d2fde5a3af9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:57.208726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9253b-b1e7-4f9a-a7a2-d2fde5a3af9b None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:57.214805 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 525/1050] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:57.220077 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db42f5-f629-4b37-8352-1a31626af37f None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:57.286909 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:57.322186 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db42f5-f629-4b37-8352-1a31626af37f None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:57.357601 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2f062-ddba-4d66-83e3-f65a39a32995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:57.358257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2f062-ddba-4d66-83e3-f65a39a32995 None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:57.358539 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2f062-ddba-4d66-83e3-f65a39a32995 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:57.358815 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2f062-ddba-4d66-83e3-f65a39a32995 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:57.359553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2f062-ddba-4d66-83e3-f65a39a32995 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:57.360912 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2f062-ddba-4d66-83e3-f65a39a32995 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:57.453277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 526/1051] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 23 19:39:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:39:58.627046 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a51b9-56d0-425a-87e9-de2dc97a7ce8 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:58.627603 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a51b9-56d0-425a-87e9-de2dc97a7ce8 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:58.627603 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a51b9-56d0-425a-87e9-de2dc97a7ce8 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:58.629100 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 526/1052] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:58.634814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd526c-0282-4317-84ff-1e4b0a356305 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:58.635208 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd526c-0282-4317-84ff-1e4b0a356305 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:58.635399 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd526c-0282-4317-84ff-1e4b0a356305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:58.652504 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-9edd526c-0282-4317-84ff-1e4b0a356305 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:58.653749 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-9edd526c-0282-4317-84ff-1e4b0a356305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:58.727933 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 527/1053] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:39:58.751534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a51b9-56d0-425a-87e9-de2dc97a7ce8 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:58.808543 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:58.854548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a51b9-56d0-425a-87e9-de2dc97a7ce8 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:58.892107 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e44afe-9996-4803-80b5-d3f787356870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:58.892910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e44afe-9996-4803-80b5-d3f787356870 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:58.893258 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e44afe-9996-4803-80b5-d3f787356870 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:58.893547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e44afe-9996-4803-80b5-d3f787356870 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:58.907189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e44afe-9996-4803-80b5-d3f787356870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:58.915333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-77e44afe-9996-4803-80b5-d3f787356870 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:39:58.915333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:58.915333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:58.915333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:58.915333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:58.915333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:58.915333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:58.915333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:58.915333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:58.915333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:58.915333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:58.915333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:58.915333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:58.915333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:58.915333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:58.915333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:58.916275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:58.916275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:58.916275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:58.916275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:58.916275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:58.916275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:58.916275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:58.916275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:58.916275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:58.916275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:58.916275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:58.916275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:58.916275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:58.916275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:58.916275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:58.916275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:58.921966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:58.921966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:58.921966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:58.921966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:58.921966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:58.921966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:58.921966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:58.921966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:58.921966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:58.921966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:58.921966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:39:58.921966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:58.921966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 527/1054] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:39:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:58.922747 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd526c-0282-4317-84ff-1e4b0a356305 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:58.974046 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:58.985933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34421090-008c-4502-a232-0485146c9fc8 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:58.986218 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34421090-008c-4502-a232-0485146c9fc8 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:58.986495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34421090-008c-4502-a232-0485146c9fc8 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:58.988686 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 528/1055] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:58.993876 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09febb-e2af-4874-b8a6-93936de730c4 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:58.994171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09febb-e2af-4874-b8a6-93936de730c4 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:58.994450 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09febb-e2af-4874-b8a6-93936de730c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:59.012087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-ed09febb-e2af-4874-b8a6-93936de730c4 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:59.013314 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ed09febb-e2af-4874-b8a6-93936de730c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:59.028717 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd526c-0282-4317-84ff-1e4b0a356305 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:59.068393 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625aaf5-9dbc-427f-abf3-59060b697377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:59.070157 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625aaf5-9dbc-427f-abf3-59060b697377 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:59.070353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625aaf5-9dbc-427f-abf3-59060b697377 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:59.070594 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625aaf5-9dbc-427f-abf3-59060b697377 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:59.071341 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625aaf5-9dbc-427f-abf3-59060b697377 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:59.071649 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625aaf5-9dbc-427f-abf3-59060b697377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:59.073341 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625aaf5-9dbc-427f-abf3-59060b697377 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:59.082368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 528/1056] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:39:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:59.093182 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 529/1057] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 19:39:59.093351 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625aaf5-9dbc-427f-abf3-59060b697377 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:59.107999 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09febb-e2af-4874-b8a6-93936de730c4 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:59.163825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:59.195325 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625aaf5-9dbc-427f-abf3-59060b697377 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:59.205705 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:59.221989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09febb-e2af-4874-b8a6-93936de730c4 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:59.230107 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f833f5-534f-41e2-9a50-63cfae8785a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:59.230982 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f833f5-534f-41e2-9a50-63cfae8785a9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:59.231267 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f833f5-534f-41e2-9a50-63cfae8785a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:59.231548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f833f5-534f-41e2-9a50-63cfae8785a9 None admin] PATH_INFO: `/v3/users/1630a9d0e7b74a6098965a0d3f8fa0b7` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:59.245719 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f833f5-534f-41e2-9a50-63cfae8785a9 None admin] RBAC: Authorizing `identity:get_user(user_id=1630a9d0e7b74a6098965a0d3f8fa0b7)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:59.247168 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f833f5-534f-41e2-9a50-63cfae8785a9 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:59.248870 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 529/1058] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:39:59 2022] GET /identity/v3/users/1630a9d0e7b74a6098965a0d3f8fa0b7 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:59.254503 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f833f5-534f-41e2-9a50-63cfae8785a9 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:59.265622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626de62-b01e-4c12-afe2-69a62538fda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:59.266441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626de62-b01e-4c12-afe2-69a62538fda4 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:59.266732 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626de62-b01e-4c12-afe2-69a62538fda4 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:59.267011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626de62-b01e-4c12-afe2-69a62538fda4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:59.278150 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626de62-b01e-4c12-afe2-69a62538fda4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:39:59.286244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-4626de62-b01e-4c12-afe2-69a62538fda4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 19:39:59.286244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:59.286244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:59.286244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:59.286244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:59.286244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:59.286244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:59.286244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:59.286244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:59.286244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:59.286244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:59.286244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:59.286244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:39:59.286244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:39:59.286244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:39:59.286244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:39:59.287187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:39:59.287187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:39:59.287187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:39:59.287187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:39:59.287187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:59.287187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:59.287187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:59.287187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:59.287187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:59.287187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:59.287187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:59.287187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:59.287187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:59.287187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:59.287187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:59.287187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:59.289240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:59.289240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:59.289240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:59.289240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:59.289240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:39:59.289240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:39:59.289240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:39:59.289240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:39:59.289240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:39:59.289240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:39:59.289240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 19:39:59.289240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:59.289240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 530/1059] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Jun 23 19:39:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:39:59.294461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626de62-b01e-4c12-afe2-69a62538fda4 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:59.362285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f833f5-534f-41e2-9a50-63cfae8785a9 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:59.399071 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626de62-b01e-4c12-afe2-69a62538fda4 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:59.399301 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72446f08-3cad-4938-97d5-0b3ba4333b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:59.399955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72446f08-3cad-4938-97d5-0b3ba4333b68 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:59.400239 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72446f08-3cad-4938-97d5-0b3ba4333b68 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:59.400524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72446f08-3cad-4938-97d5-0b3ba4333b68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:59.406280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:59.434642 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649134f0-3406-4bbe-b9b5-b5634672ca08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:59.435236 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649134f0-3406-4bbe-b9b5-b5634672ca08 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:59.435523 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649134f0-3406-4bbe-b9b5-b5634672ca08 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:59.435800 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649134f0-3406-4bbe-b9b5-b5634672ca08 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:59.436549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649134f0-3406-4bbe-b9b5-b5634672ca08 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:59.436851 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649134f0-3406-4bbe-b9b5-b5634672ca08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:59.437383 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:59.439285 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649134f0-3406-4bbe-b9b5-b5634672ca08 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:59.448825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 531/1060] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 23 19:39:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:39:59.454495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649134f0-3406-4bbe-b9b5-b5634672ca08 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:59.479539 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72446f08-3cad-4938-97d5-0b3ba4333b68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:59.481264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72446f08-3cad-4938-97d5-0b3ba4333b68 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:59.559029 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649134f0-3406-4bbe-b9b5-b5634672ca08 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:59.583951 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 530/1061] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:39:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 19:39:59.585963 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebecb66-2c26-4a63-81d3-2abaf04b66f2 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:59.586265 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebecb66-2c26-4a63-81d3-2abaf04b66f2 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:59.586547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebecb66-2c26-4a63-81d3-2abaf04b66f2 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:59.588078 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 531/1062] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:39:59.592884 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86b9b7-e206-47d1-9c8c-f80284b75810 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:59.593182 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86b9b7-e206-47d1-9c8c-f80284b75810 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:59.593478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86b9b7-e206-47d1-9c8c-f80284b75810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:59.594889 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbc5ed-9b4e-4cd4-876a-dd4eec5aa47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:59.595674 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbc5ed-9b4e-4cd4-876a-dd4eec5aa47c None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:59.595957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbc5ed-9b4e-4cd4-876a-dd4eec5aa47c None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:59.596231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbc5ed-9b4e-4cd4-876a-dd4eec5aa47c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:59.608010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbc5ed-9b4e-4cd4-876a-dd4eec5aa47c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:59.609478 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbc5ed-9b4e-4cd4-876a-dd4eec5aa47c None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:59.609955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-0b86b9b7-e206-47d1-9c8c-f80284b75810 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:39:59.611140 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-0b86b9b7-e206-47d1-9c8c-f80284b75810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:39:59.626294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-e4bbc5ed-9b4e-4cd4-876a-dd4eec5aa47c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:59.626294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:39:59.626294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:39:59.626294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:39:59.626294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:39:59.626294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:39:59.626294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:39:59.626294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:39:59.626294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:39:59.626294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:39:59.626294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:39:59.626294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:39:59.626294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:39:59.626294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:39:59.626294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:39:59.627901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:39:59.627901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:39:59.627901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:39:59.627901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:39:59.627901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:39:59.627901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:39:59.627901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:39:59.627901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:39:59.627901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:39:59.627901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:39:59.627901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:39:59.627901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:39:59.627901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:39:59.627901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:39:59.627901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:39:59.627901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:39:59.627901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:39:59.629119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:39:59.629119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:39:59.629119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:39:59.629119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:39:59.629119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 532/1063] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:39:59.629119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbc5ed-9b4e-4cd4-876a-dd4eec5aa47c None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:59.654958 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:59.676629 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:59.682418 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 532/1064] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:39:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 19:39:59.683227 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86b9b7-e206-47d1-9c8c-f80284b75810 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:59.734077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbc5ed-9b4e-4cd4-876a-dd4eec5aa47c None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:59.766926 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edc1c7-88ac-4449-a3f1-5870ae45feb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:59.767776 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edc1c7-88ac-4449-a3f1-5870ae45feb7 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:59.768056 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edc1c7-88ac-4449-a3f1-5870ae45feb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:59.768330 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edc1c7-88ac-4449-a3f1-5870ae45feb7 None admin] PATH_INFO: `/v3/projects/c1173657a4a2480ba144a6eb21dfe6ec` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:59.769526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edc1c7-88ac-4449-a3f1-5870ae45feb7 None admin] RBAC: Authorizing `identity:get_project(project_id=c1173657a4a2480ba144a6eb21dfe6ec)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:59.770951 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edc1c7-88ac-4449-a3f1-5870ae45feb7 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:59.773738 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 533/1065] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:39:59 2022] GET /identity/v3/projects/c1173657a4a2480ba144a6eb21dfe6ec => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:59.774497 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edc1c7-88ac-4449-a3f1-5870ae45feb7 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:59.790539 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86b9b7-e206-47d1-9c8c-f80284b75810 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:59.828625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70335ad6-feb3-4535-88b2-f4d425d1fdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:59.829325 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70335ad6-feb3-4535-88b2-f4d425d1fdc9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:59.829619 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70335ad6-feb3-4535-88b2-f4d425d1fdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:59.829905 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70335ad6-feb3-4535-88b2-f4d425d1fdc9 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:59.830636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70335ad6-feb3-4535-88b2-f4d425d1fdc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:59.830951 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70335ad6-feb3-4535-88b2-f4d425d1fdc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:59.832328 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70335ad6-feb3-4535-88b2-f4d425d1fdc9 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:59.844247 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 533/1066] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:59.845069 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70335ad6-feb3-4535-88b2-f4d425d1fdc9 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:39:59.880742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:59.893284 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edc1c7-88ac-4449-a3f1-5870ae45feb7 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:59.907328 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:39:59.927412 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3d414-3ee4-41bd-af9a-82651366ddc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:59.928238 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3d414-3ee4-41bd-af9a-82651366ddc2 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:59.928800 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3d414-3ee4-41bd-af9a-82651366ddc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:59.928800 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3d414-3ee4-41bd-af9a-82651366ddc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:59.948864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70335ad6-feb3-4535-88b2-f4d425d1fdc9 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:39:59.982868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea58e76-4ef6-48be-91c8-df58dc0f898c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:39:59.983529 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea58e76-4ef6-48be-91c8-df58dc0f898c None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:39:59.983815 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea58e76-4ef6-48be-91c8-df58dc0f898c None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:39:59.984157 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea58e76-4ef6-48be-91c8-df58dc0f898c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:39:59.984927 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea58e76-4ef6-48be-91c8-df58dc0f898c None admin] RBAC: Adding query filter params (role.id=76bd0cf7bf094e4fa3db121b96215004, scope.project.id=c1173657a4a2480ba144a6eb21dfe6ec, user.id=1630a9d0e7b74a6098965a0d3f8fa0b7) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:39:59.985274 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea58e76-4ef6-48be-91c8-df58dc0f898c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:39:59.986714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea58e76-4ef6-48be-91c8-df58dc0f898c None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:39:59.992243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 534/1067] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:39:59 2022] GET /identity/v3/role_assignments?user.id=1630a9d0e7b74a6098965a0d3f8fa0b7&scope.project.id=c1173657a4a2480ba144a6eb21dfe6ec&role.id=76bd0cf7bf094e4fa3db121b96215004 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:39:59.993037 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea58e76-4ef6-48be-91c8-df58dc0f898c None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:00.010574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3d414-3ee4-41bd-af9a-82651366ddc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:00.012095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3d414-3ee4-41bd-af9a-82651366ddc2 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:00.108550 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:00.110210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea58e76-4ef6-48be-91c8-df58dc0f898c None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:00.122949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 534/1068] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:39:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 19:40:00.129501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3d414-3ee4-41bd-af9a-82651366ddc2 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:00.137345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:00.151467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84702b6-6fe7-45c4-8f91-fbc1ddab62f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:00.152283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84702b6-6fe7-45c4-8f91-fbc1ddab62f1 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:00.152562 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84702b6-6fe7-45c4-8f91-fbc1ddab62f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:00.152841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84702b6-6fe7-45c4-8f91-fbc1ddab62f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:00.161198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84702b6-6fe7-45c4-8f91-fbc1ddab62f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:00.162839 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84702b6-6fe7-45c4-8f91-fbc1ddab62f1 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:00.177990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-a84702b6-6fe7-45c4-8f91-fbc1ddab62f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 19:40:00.177990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:40:00.177990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:40:00.177990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:40:00.177990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:40:00.177990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:40:00.177990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:40:00.177990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:40:00.177990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:40:00.177990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:40:00.177990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:40:00.177990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:40:00.177990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:40:00.177990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:40:00.177990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:40:00.177990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:40:00.179172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:40:00.179172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:40:00.179172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:40:00.179172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:40:00.179172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:40:00.179172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:40:00.179172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:40:00.179172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:40:00.179172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:40:00.179172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:40:00.179172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:40:00.179172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:40:00.179172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:40:00.179172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:40:00.179172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:40:00.179172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:40:00.179172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:40:00.179172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:40:00.180159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:40:00.180159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:40:00.180159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:40:00.180159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:40:00.180159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:40:00.180159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:40:00.180159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:40:00.180159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:40:00.180159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 19:40:00.180159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:40:00.180159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 535/1069] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 23 19:39:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:40:00.184758 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84702b6-6fe7-45c4-8f91-fbc1ddab62f1 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:00.252974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3d414-3ee4-41bd-af9a-82651366ddc2 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:00.291556 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84702b6-6fe7-45c4-8f91-fbc1ddab62f1 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:00.292046 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e063b-857f-459f-888c-156207ddd5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:00.293065 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e063b-857f-459f-888c-156207ddd5d2 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:00.293579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e063b-857f-459f-888c-156207ddd5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:00.294067 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e063b-857f-459f-888c-156207ddd5d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:00.306632 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e063b-857f-459f-888c-156207ddd5d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:00.308164 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e063b-857f-459f-888c-156207ddd5d2 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:00.326442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-c14e063b-857f-459f-888c-156207ddd5d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:40:00.326442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:40:00.326442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:40:00.326442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:40:00.326442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:40:00.326442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:40:00.326442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:40:00.326442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:40:00.326442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:40:00.326442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:40:00.326442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:40:00.326442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:40:00.326442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:40:00.326442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:40:00.326442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:40:00.327387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:40:00.327387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:40:00.327387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:40:00.327387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:40:00.327387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:40:00.327387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:40:00.327387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:40:00.327387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:40:00.327387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:40:00.327387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:40:00.327387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:40:00.327387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:40:00.327387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:40:00.327387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:40:00.327387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:40:00.327387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:40:00.327387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:40:00.328293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:40:00.328293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:40:00.328293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:40:00.328293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:40:00.328293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 535/1070] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:40:00.330838 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdd0cf-e630-4ef3-94ff-4660e50a4314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:00.331604 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdd0cf-e630-4ef3-94ff-4660e50a4314 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:00.331887 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdd0cf-e630-4ef3-94ff-4660e50a4314 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:00.332159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdd0cf-e630-4ef3-94ff-4660e50a4314 None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:00.333294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdd0cf-e630-4ef3-94ff-4660e50a4314 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:00.333553 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e063b-857f-459f-888c-156207ddd5d2 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:00.333660 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdd0cf-e630-4ef3-94ff-4660e50a4314 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:00.336275 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdd0cf-e630-4ef3-94ff-4660e50a4314 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:00.360261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 536/1071] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 23 19:40:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:40:00.361572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdd0cf-e630-4ef3-94ff-4660e50a4314 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:00.377546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:00.411450 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:00.436959 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e063b-857f-459f-888c-156207ddd5d2 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:00.472675 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdd0cf-e630-4ef3-94ff-4660e50a4314 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:00.473069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b82f25-9064-4ab6-9715-328ffaa86e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:00.473777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b82f25-9064-4ab6-9715-328ffaa86e97 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:00.474062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b82f25-9064-4ab6-9715-328ffaa86e97 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:00.474338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b82f25-9064-4ab6-9715-328ffaa86e97 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:00.475638 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b82f25-9064-4ab6-9715-328ffaa86e97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:00.475949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b82f25-9064-4ab6-9715-328ffaa86e97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:00.477347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b82f25-9064-4ab6-9715-328ffaa86e97 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:00.488805 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 536/1072] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:40:00.510675 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e17b0-0f8f-4ba0-9367-6e3c50c82466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:00.511798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e17b0-0f8f-4ba0-9367-6e3c50c82466 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:00.512284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e17b0-0f8f-4ba0-9367-6e3c50c82466 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:00.512760 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e17b0-0f8f-4ba0-9367-6e3c50c82466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:00.525515 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e17b0-0f8f-4ba0-9367-6e3c50c82466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:00.527363 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e17b0-0f8f-4ba0-9367-6e3c50c82466 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:00.547494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-d53e17b0-0f8f-4ba0-9367-6e3c50c82466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:40:00.547494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:40:00.547494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:40:00.547494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:40:00.547494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:40:00.547494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:40:00.547494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:40:00.547494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:40:00.547494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:40:00.547494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:40:00.547494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:40:00.547494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:40:00.547494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:40:00.547494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:40:00.547494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:40:00.548484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:40:00.548484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:40:00.548484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:40:00.548484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:40:00.548484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:40:00.548484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:40:00.548484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:40:00.548484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:40:00.548484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:40:00.548484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:40:00.548484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:40:00.548484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:40:00.548484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:40:00.548484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:40:00.548484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:40:00.548484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:40:00.548484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:40:00.549408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:40:00.549408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:40:00.549408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:40:00.549408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:40:00.555542 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 537/1073] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:40:00.556663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b82f25-9064-4ab6-9715-328ffaa86e97 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:00.663283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:00.666129 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b82f25-9064-4ab6-9715-328ffaa86e97 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:00.702357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666cebe-023e-4e4c-ace2-aa1bc1239e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:00.703034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666cebe-023e-4e4c-ace2-aa1bc1239e45 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:00.704546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666cebe-023e-4e4c-ace2-aa1bc1239e45 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:00.704546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666cebe-023e-4e4c-ace2-aa1bc1239e45 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:00.704546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666cebe-023e-4e4c-ace2-aa1bc1239e45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:00.704782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666cebe-023e-4e4c-ace2-aa1bc1239e45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:00.706031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666cebe-023e-4e4c-ace2-aa1bc1239e45 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:00.719064 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 537/1074] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:40:00.724611 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e17b0-0f8f-4ba0-9367-6e3c50c82466 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:00.822527 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:00.831028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e17b0-0f8f-4ba0-9367-6e3c50c82466 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:00.864131 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d5b2d-41e2-4e6a-a37e-df693ce46fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:00.864923 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5b2d-41e2-4e6a-a37e-df693ce46fa4 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:00.865238 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5b2d-41e2-4e6a-a37e-df693ce46fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:00.865524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5b2d-41e2-4e6a-a37e-df693ce46fa4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:00.872015 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d5b2d-41e2-4e6a-a37e-df693ce46fa4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:00.873491 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d5b2d-41e2-4e6a-a37e-df693ce46fa4 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:00.888119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-763d5b2d-41e2-4e6a-a37e-df693ce46fa4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:40:00.888119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:40:00.888119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:40:00.888119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:40:00.888119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:40:00.888119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:40:00.888119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:40:00.888119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:40:00.888119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:40:00.888119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:40:00.888119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:40:00.888119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:40:00.888119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:40:00.888119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:40:00.888119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:40:00.889024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:40:00.889024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:40:00.889024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:40:00.889024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:40:00.889024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:40:00.889024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:40:00.889024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:40:00.889024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:40:00.889024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:40:00.889024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:40:00.889024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:40:00.889024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:40:00.889024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:40:00.889024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:40:00.889024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:40:00.889024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:40:00.889024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:40:00.894868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:40:00.894868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:40:00.894868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:40:00.894868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:40:00.894868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:40:00.894868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:40:00.894868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:40:00.894868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:40:00.894868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 538/1075] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:40:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:40:00.895363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666cebe-023e-4e4c-ace2-aa1bc1239e45 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:00.993543 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666cebe-023e-4e4c-ace2-aa1bc1239e45 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:01.026121 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d172b4-0e94-445d-ad76-2da410a09697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:01.026791 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d172b4-0e94-445d-ad76-2da410a09697 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:01.027072 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d172b4-0e94-445d-ad76-2da410a09697 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:01.027349 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d172b4-0e94-445d-ad76-2da410a09697 None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:01.028127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d172b4-0e94-445d-ad76-2da410a09697 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:01.028435 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d172b4-0e94-445d-ad76-2da410a09697 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:01.029879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d172b4-0e94-445d-ad76-2da410a09697 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:01.041136 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 538/1076] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:40:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:40:01.047048 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d5b2d-41e2-4e6a-a37e-df693ce46fa4 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:01.147401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d5b2d-41e2-4e6a-a37e-df693ce46fa4 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:01.179758 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4045979-39a7-4ef0-8274-5307bc6c2174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:01.180638 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4045979-39a7-4ef0-8274-5307bc6c2174 None admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:01.180920 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4045979-39a7-4ef0-8274-5307bc6c2174 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:01.181219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4045979-39a7-4ef0-8274-5307bc6c2174 None admin] PATH_INFO: `/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/83bff5cd7782423eaa0bc5b29b208ae7/roles/cebd4ad2da474d8b9183c4a7587119c8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:01.183376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4045979-39a7-4ef0-8274-5307bc6c2174 None admin] RBAC: Authorizing `identity:create_grant(project_id=368f41dc1ae64e199b604ee72545c88e, user_id=83bff5cd7782423eaa0bc5b29b208ae7, role_id=cebd4ad2da474d8b9183c4a7587119c8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:01.184813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4045979-39a7-4ef0-8274-5307bc6c2174 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:01.249373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 539/1077] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:40:01 2022] PUT /identity/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/83bff5cd7782423eaa0bc5b29b208ae7/roles/cebd4ad2da474d8b9183c4a7587119c8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:40:02.033969 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49cf00-d051-488d-a532-0fc03c670b67 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:02.034511 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49cf00-d051-488d-a532-0fc03c670b67 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:02.034511 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49cf00-d051-488d-a532-0fc03c670b67 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:02.035889 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 539/1078] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:40:02.042012 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebce3ee-489c-499f-9ef4-28b4c86e90e8 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:02.042426 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebce3ee-489c-499f-9ef4-28b4c86e90e8 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:02.042576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebce3ee-489c-499f-9ef4-28b4c86e90e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:02.059548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-5ebce3ee-489c-499f-9ef4-28b4c86e90e8 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:40:02.060735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-5ebce3ee-489c-499f-9ef4-28b4c86e90e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:40:02.067754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:02.127748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 540/1079] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:40:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:40:02.153869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49cf00-d051-488d-a532-0fc03c670b67 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:02.176970 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:02.259723 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49cf00-d051-488d-a532-0fc03c670b67 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:02.292292 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b6be7-2b4d-47a0-8445-2b436c25525b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:02.293069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b6be7-2b4d-47a0-8445-2b436c25525b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:02.293380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b6be7-2b4d-47a0-8445-2b436c25525b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:02.293659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b6be7-2b4d-47a0-8445-2b436c25525b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:02.303886 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b6be7-2b4d-47a0-8445-2b436c25525b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:40:02.312132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-3d6b6be7-2b4d-47a0-8445-2b436c25525b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:40:02.312132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:40:02.312132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:40:02.312132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:40:02.312132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:40:02.312132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:40:02.312132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:40:02.312132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:40:02.312132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:40:02.312132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:40:02.312132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:40:02.312132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:40:02.312132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:40:02.312132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:40:02.312132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:40:02.312132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:40:02.313235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:40:02.313235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:40:02.313235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:40:02.313235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:40:02.313235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:40:02.313235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:40:02.313235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:40:02.313235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:40:02.313235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:40:02.313235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:40:02.313235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:40:02.313235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:40:02.313235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:40:02.313235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:40:02.313235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:40:02.313235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:40:02.314184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:40:02.314184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:40:02.314184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:40:02.314184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:40:02.314184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:40:02.314184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:40:02.314184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:40:02.314184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:40:02.314184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:40:02.314184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:40:02.314184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:40:02.314184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:40:02.314184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 540/1080] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:40:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:40:02.320246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebce3ee-489c-499f-9ef4-28b4c86e90e8 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:02.422464 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebce3ee-489c-499f-9ef4-28b4c86e90e8 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:02.455414 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d41298-ba6e-420e-9149-6174ac04a64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:02.456074 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d41298-ba6e-420e-9149-6174ac04a64d None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:02.456360 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d41298-ba6e-420e-9149-6174ac04a64d None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:02.456634 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d41298-ba6e-420e-9149-6174ac04a64d None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:02.457400 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d41298-ba6e-420e-9149-6174ac04a64d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:02.457706 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d41298-ba6e-420e-9149-6174ac04a64d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:02.459055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d41298-ba6e-420e-9149-6174ac04a64d None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:02.467555 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 541/1081] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:40:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:02.473274 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b6be7-2b4d-47a0-8445-2b436c25525b None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:02.555537 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:02.573825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b6be7-2b4d-47a0-8445-2b436c25525b None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:02.608156 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f83f3-6afa-4ec7-9400-bccb6cacade1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:02.609009 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f83f3-6afa-4ec7-9400-bccb6cacade1 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:02.609332 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f83f3-6afa-4ec7-9400-bccb6cacade1 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:02.609614 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f83f3-6afa-4ec7-9400-bccb6cacade1 None admin] PATH_INFO: `/v3/users/1630a9d0e7b74a6098965a0d3f8fa0b7` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:02.610797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f83f3-6afa-4ec7-9400-bccb6cacade1 None admin] RBAC: Authorizing `identity:get_user(user_id=1630a9d0e7b74a6098965a0d3f8fa0b7)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:02.612225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f83f3-6afa-4ec7-9400-bccb6cacade1 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:02.613883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 541/1082] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:40:02 2022] GET /identity/v3/users/1630a9d0e7b74a6098965a0d3f8fa0b7 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:02.620008 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d41298-ba6e-420e-9149-6174ac04a64d None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:02.624468 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:02.718970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d41298-ba6e-420e-9149-6174ac04a64d None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:02.751815 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e5112-1c0a-4ce7-9bfe-0e054eeee680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:02.752680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e5112-1c0a-4ce7-9bfe-0e054eeee680 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:02.752969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e5112-1c0a-4ce7-9bfe-0e054eeee680 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:02.753279 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e5112-1c0a-4ce7-9bfe-0e054eeee680 None admin] PATH_INFO: `/v3/projects/c1173657a4a2480ba144a6eb21dfe6ec` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:02.754461 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e5112-1c0a-4ce7-9bfe-0e054eeee680 None admin] RBAC: Authorizing `identity:get_project(project_id=c1173657a4a2480ba144a6eb21dfe6ec)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:02.755889 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e5112-1c0a-4ce7-9bfe-0e054eeee680 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:02.758319 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 542/1083] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:40:02 2022] GET /identity/v3/projects/c1173657a4a2480ba144a6eb21dfe6ec => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:02.764151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f83f3-6afa-4ec7-9400-bccb6cacade1 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:02.862702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f83f3-6afa-4ec7-9400-bccb6cacade1 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:02.933723 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885cbca-70a8-4c1c-b507-08d905c0c656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:02.934605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885cbca-70a8-4c1c-b507-08d905c0c656 None admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:02.934888 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885cbca-70a8-4c1c-b507-08d905c0c656 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:02.935165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885cbca-70a8-4c1c-b507-08d905c0c656 None admin] PATH_INFO: `/v3/projects/c1173657a4a2480ba144a6eb21dfe6ec/users/1630a9d0e7b74a6098965a0d3f8fa0b7/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:02.937086 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885cbca-70a8-4c1c-b507-08d905c0c656 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1173657a4a2480ba144a6eb21dfe6ec, user_id=1630a9d0e7b74a6098965a0d3f8fa0b7, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:02.938535 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885cbca-70a8-4c1c-b507-08d905c0c656 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:03.017945 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 542/1084] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:40:02 2022] PUT /identity/v3/projects/c1173657a4a2480ba144a6eb21dfe6ec/users/1630a9d0e7b74a6098965a0d3f8fa0b7/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:40:03.295262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c9008-d5f4-4ccb-bf33-ecf06aece1c2 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:03.295775 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c9008-d5f4-4ccb-bf33-ecf06aece1c2 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:03.295775 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c9008-d5f4-4ccb-bf33-ecf06aece1c2 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:03.297238 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 543/1085] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:40:03.302472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c182093-816d-4342-9968-4f10302b841d None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:03.302863 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c182093-816d-4342-9968-4f10302b841d None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:03.303549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c182093-816d-4342-9968-4f10302b841d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:03.320831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-4c182093-816d-4342-9968-4f10302b841d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:40:03.322065 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-4c182093-816d-4342-9968-4f10302b841d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:40:03.324018 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:03.387987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 543/1086] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:40:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:40:03.411348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c9008-d5f4-4ccb-bf33-ecf06aece1c2 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:03.482286 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:03.513924 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c9008-d5f4-4ccb-bf33-ecf06aece1c2 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:03.547077 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f1908-90b4-445c-b766-a06fc6b39931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:03.547813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f1908-90b4-445c-b766-a06fc6b39931 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:03.548101 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f1908-90b4-445c-b766-a06fc6b39931 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:03.548379 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f1908-90b4-445c-b766-a06fc6b39931 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:03.558834 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f1908-90b4-445c-b766-a06fc6b39931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:40:03.567105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-d02f1908-90b4-445c-b766-a06fc6b39931 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 19:40:03.567105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:40:03.567105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:40:03.567105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:40:03.567105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:40:03.567105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:40:03.567105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:40:03.567105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:40:03.567105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:40:03.567105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:40:03.567105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:40:03.567105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:40:03.567105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:40:03.567105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:40:03.567105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:40:03.567105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:40:03.568199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:40:03.568199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:40:03.568199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:40:03.568199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:40:03.568199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:40:03.568199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:40:03.568199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:40:03.568199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:40:03.568199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:40:03.568199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:40:03.568199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:40:03.568199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:40:03.568199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:40:03.568199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:40:03.568199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:40:03.568199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:40:03.569992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:40:03.569992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:40:03.569992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:40:03.569992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:40:03.569992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:40:03.569992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:40:03.569992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:40:03.569992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:40:03.569992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:40:03.569992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:40:03.569992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 19:40:03.569992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:40:03.569992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 544/1087] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Jun 23 19:40:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:40:03.575209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c182093-816d-4342-9968-4f10302b841d None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:03.673468 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c182093-816d-4342-9968-4f10302b841d None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:03.707930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb45a4-28c1-430d-b575-0b36f947669d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:03.708600 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb45a4-28c1-430d-b575-0b36f947669d None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:03.708884 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb45a4-28c1-430d-b575-0b36f947669d None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:03.709771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb45a4-28c1-430d-b575-0b36f947669d None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:03.710510 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb45a4-28c1-430d-b575-0b36f947669d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:03.710823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb45a4-28c1-430d-b575-0b36f947669d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:03.712196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb45a4-28c1-430d-b575-0b36f947669d None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:03.717286 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:03.720912 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 544/1088] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 23 19:40:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:03.726604 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f1908-90b4-445c-b766-a06fc6b39931 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:03.823975 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f1908-90b4-445c-b766-a06fc6b39931 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:03.852560 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:03.857473 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d146ef-75f5-4b9f-b859-b31d74a5cb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:03.858251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d146ef-75f5-4b9f-b859-b31d74a5cb11 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:03.858536 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d146ef-75f5-4b9f-b859-b31d74a5cb11 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:03.858818 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d146ef-75f5-4b9f-b859-b31d74a5cb11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:03.869619 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d146ef-75f5-4b9f-b859-b31d74a5cb11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:03.871048 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d146ef-75f5-4b9f-b859-b31d74a5cb11 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:03.889206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-92d146ef-75f5-4b9f-b859-b31d74a5cb11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:40:03.889206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:40:03.889206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:40:03.889206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:40:03.889206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:40:03.889206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:40:03.889206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:40:03.889206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:40:03.889206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:40:03.889206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:40:03.889206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:40:03.889206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:40:03.889206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:40:03.889206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:40:03.889206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:40:03.890348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:40:03.890348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:40:03.890348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:40:03.890348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:40:03.890348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:40:03.890348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:40:03.890348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:40:03.890348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:40:03.890348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:40:03.890348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:40:03.890348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:40:03.890348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:40:03.890348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:40:03.890348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:40:03.890348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:40:03.890348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:40:03.890348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:40:03.891315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:40:03.891315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:40:03.891315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:40:03.891315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:40:03.891315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 545/1089] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:40:03.896106 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb45a4-28c1-430d-b575-0b36f947669d None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:03.995541 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb45a4-28c1-430d-b575-0b36f947669d None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:04.027902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a885c-069f-4dff-aa95-a3df78d68e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:04.028665 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a885c-069f-4dff-aa95-a3df78d68e10 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:04.028953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a885c-069f-4dff-aa95-a3df78d68e10 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:04.029257 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a885c-069f-4dff-aa95-a3df78d68e10 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:04.029985 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a885c-069f-4dff-aa95-a3df78d68e10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:04.030294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a885c-069f-4dff-aa95-a3df78d68e10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:04.031661 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a885c-069f-4dff-aa95-a3df78d68e10 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:04.043116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 545/1090] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:04.048642 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d146ef-75f5-4b9f-b859-b31d74a5cb11 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:04.151249 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d146ef-75f5-4b9f-b859-b31d74a5cb11 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:04.183986 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2bab6-a218-4bbe-879c-72c9b3c86098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:04.184779 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2bab6-a218-4bbe-879c-72c9b3c86098 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:04.185066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2bab6-a218-4bbe-879c-72c9b3c86098 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:04.185374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2bab6-a218-4bbe-879c-72c9b3c86098 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:04.192693 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2bab6-a218-4bbe-879c-72c9b3c86098 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:04.195148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2bab6-a218-4bbe-879c-72c9b3c86098 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:04.209025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-aea2bab6-a218-4bbe-879c-72c9b3c86098 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 19:40:04.209025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:40:04.209025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:40:04.209025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:40:04.209025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:40:04.209025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:40:04.209025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:40:04.209025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:40:04.209025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:40:04.209025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:40:04.209025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:40:04.209025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:40:04.209025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:40:04.209025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:40:04.209025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:40:04.209025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:40:04.210193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:40:04.210193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:40:04.210193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:40:04.210193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:40:04.210193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:40:04.210193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:40:04.210193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:40:04.210193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:40:04.210193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:40:04.210193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:40:04.210193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:40:04.210193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:40:04.210193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:40:04.210193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:40:04.210193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:40:04.210193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:40:04.210193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:40:04.210193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:40:04.211264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:40:04.211264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:40:04.211264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:40:04.211264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:40:04.211264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:40:04.211264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:40:04.211264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:40:04.211264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:40:04.211264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 19:40:04.211264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:40:04.211264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 546/1091] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 23 19:40:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:40:04.216034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a885c-069f-4dff-aa95-a3df78d68e10 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:04.275543 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:04.314931 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a885c-069f-4dff-aa95-a3df78d68e10 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:04.355577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8b028-cd30-46ae-9a33-12d9acb2e60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:04.356240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8b028-cd30-46ae-9a33-12d9acb2e60e None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:04.356522 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8b028-cd30-46ae-9a33-12d9acb2e60e None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:04.356796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8b028-cd30-46ae-9a33-12d9acb2e60e None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:04.357654 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8b028-cd30-46ae-9a33-12d9acb2e60e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:04.357964 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8b028-cd30-46ae-9a33-12d9acb2e60e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:04.359385 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8b028-cd30-46ae-9a33-12d9acb2e60e None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:04.376260 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 546/1092] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 23 19:40:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:04.382741 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2bab6-a218-4bbe-879c-72c9b3c86098 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:04.430330 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:04.484585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2bab6-a218-4bbe-879c-72c9b3c86098 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:04.517611 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69f901-2db1-4137-9a37-92cf08c63c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:04.518259 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69f901-2db1-4137-9a37-92cf08c63c0c None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:04.518545 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69f901-2db1-4137-9a37-92cf08c63c0c None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:04.518826 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69f901-2db1-4137-9a37-92cf08c63c0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:04.585693 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69f901-2db1-4137-9a37-92cf08c63c0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:04.587143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69f901-2db1-4137-9a37-92cf08c63c0c None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:04.630353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:04.684608 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 547/1093] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:40:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 19:40:04.690094 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8b028-cd30-46ae-9a33-12d9acb2e60e None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:04.787665 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8b028-cd30-46ae-9a33-12d9acb2e60e None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:04.805205 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:04.821951 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94759d86-187f-454d-bef2-65ac9300b16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:04.822741 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94759d86-187f-454d-bef2-65ac9300b16b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:04.823027 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94759d86-187f-454d-bef2-65ac9300b16b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:04.823304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94759d86-187f-454d-bef2-65ac9300b16b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:04.832886 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94759d86-187f-454d-bef2-65ac9300b16b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:04.834429 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94759d86-187f-454d-bef2-65ac9300b16b None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:04.851567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-94759d86-187f-454d-bef2-65ac9300b16b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:40:04.851567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:40:04.851567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:40:04.851567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:40:04.851567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:40:04.851567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:40:04.851567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:40:04.851567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:40:04.851567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:40:04.851567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:40:04.851567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:40:04.851567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:40:04.851567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:40:04.851567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:40:04.851567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:40:04.852705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:40:04.852705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:40:04.852705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:40:04.852705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:40:04.852705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:40:04.852705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:40:04.852705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:40:04.852705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:40:04.852705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:40:04.852705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:40:04.852705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:40:04.852705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:40:04.852705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:40:04.852705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:40:04.852705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:40:04.852705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:40:04.852705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:40:04.853656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:40:04.853656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:40:04.853656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:40:04.853656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:40:04.853656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 547/1094] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:40:04.858440 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69f901-2db1-4137-9a37-92cf08c63c0c None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:04.962818 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69f901-2db1-4137-9a37-92cf08c63c0c None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:04.998303 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a70410-549c-40b8-bc97-0abeae7b1bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:04.998965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70410-549c-40b8-bc97-0abeae7b1bf0 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:04.999246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70410-549c-40b8-bc97-0abeae7b1bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:04.999524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70410-549c-40b8-bc97-0abeae7b1bf0 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:05.000271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a70410-549c-40b8-bc97-0abeae7b1bf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:05.000576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a70410-549c-40b8-bc97-0abeae7b1bf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:05.001968 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a70410-549c-40b8-bc97-0abeae7b1bf0 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:05.013414 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 548/1095] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:05.018946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94759d86-187f-454d-bef2-65ac9300b16b None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:05.035938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5912194-1d35-491d-a57a-f5e58817587e None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:05.036237 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5912194-1d35-491d-a57a-f5e58817587e None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:05.036520 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5912194-1d35-491d-a57a-f5e58817587e None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:05.038690 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 549/1096] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:40:05.043530 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9a714-011a-41c7-9e0d-78f7ddb8b278 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:05.043824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9a714-011a-41c7-9e0d-78f7ddb8b278 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:05.044107 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9a714-011a-41c7-9e0d-78f7ddb8b278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:05.050153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:05.060665 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-36c9a714-011a-41c7-9e0d-78f7ddb8b278 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:40:05.061882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-36c9a714-011a-41c7-9e0d-78f7ddb8b278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:40:05.121525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94759d86-187f-454d-bef2-65ac9300b16b None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:05.128950 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 550/1097] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:40:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:40:05.153223 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9a714-011a-41c7-9e0d-78f7ddb8b278 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:05.158139 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bd35d-3b7f-4945-94ee-e7434c2e0571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:05.158932 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bd35d-3b7f-4945-94ee-e7434c2e0571 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:05.159223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bd35d-3b7f-4945-94ee-e7434c2e0571 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:05.159503 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bd35d-3b7f-4945-94ee-e7434c2e0571 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:05.166183 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9bd35d-3b7f-4945-94ee-e7434c2e0571 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:05.167635 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9bd35d-3b7f-4945-94ee-e7434c2e0571 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:05.181401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-7e9bd35d-3b7f-4945-94ee-e7434c2e0571 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:40:05.181401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:40:05.181401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:40:05.181401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:40:05.181401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:40:05.181401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:40:05.181401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:40:05.181401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:40:05.181401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:40:05.181401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:40:05.181401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:40:05.181401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:40:05.181401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:40:05.181401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:40:05.181401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:40:05.182377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:40:05.182377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:40:05.182377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:40:05.182377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:40:05.182377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:40:05.182377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:40:05.182377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:40:05.182377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:40:05.182377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:40:05.182377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:40:05.182377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:40:05.182377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:40:05.182377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:40:05.182377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:40:05.182377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:40:05.182377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:40:05.182377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:40:05.183352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:40:05.183352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:40:05.183352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:40:05.183352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:40:05.183352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:40:05.183352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:40:05.183352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:40:05.183352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:40:05.187421 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 548/1098] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:40:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:40:05.188131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bd35d-3b7f-4945-94ee-e7434c2e0571 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:05.219670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:05.249878 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9a714-011a-41c7-9e0d-78f7ddb8b278 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:05.284939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b95797-8e47-47c8-9b26-4716e651b0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:05.285754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b95797-8e47-47c8-9b26-4716e651b0c5 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:05.286043 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b95797-8e47-47c8-9b26-4716e651b0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:05.286319 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b95797-8e47-47c8-9b26-4716e651b0c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:05.288740 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:05.289595 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bd35d-3b7f-4945-94ee-e7434c2e0571 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:05.297361 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b95797-8e47-47c8-9b26-4716e651b0c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:40:05.305064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-83b95797-8e47-47c8-9b26-4716e651b0c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:40:05.305064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:40:05.305064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:40:05.305064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:40:05.305064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:40:05.305064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:40:05.305064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:40:05.305064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:40:05.305064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:40:05.305064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:40:05.305064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:40:05.305064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:40:05.305064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:40:05.305064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:40:05.305064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:40:05.305064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:40:05.306019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:40:05.306019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:40:05.306019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:40:05.306019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:40:05.306019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:40:05.306019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:40:05.306019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:40:05.306019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:40:05.306019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:40:05.306019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:40:05.306019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:40:05.306019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:40:05.306019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:40:05.306019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:40:05.306019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:40:05.306019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:40:05.307089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:40:05.307089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:40:05.307089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:40:05.307089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:40:05.307089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:40:05.307089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:40:05.307089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:40:05.307089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:40:05.307089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:40:05.307089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:40:05.307089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:40:05.307089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:40:05.307089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 551/1099] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:40:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 19:40:05.312291 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b95797-8e47-47c8-9b26-4716e651b0c5 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:05.325829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a84720-74e8-4f58-b534-1c5816b2b3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:05.326492 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a84720-74e8-4f58-b534-1c5816b2b3de None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:05.326777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a84720-74e8-4f58-b534-1c5816b2b3de None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:05.327055 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a84720-74e8-4f58-b534-1c5816b2b3de None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:05.327846 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a84720-74e8-4f58-b534-1c5816b2b3de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:05.328160 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a84720-74e8-4f58-b534-1c5816b2b3de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:05.329659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a84720-74e8-4f58-b534-1c5816b2b3de None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:05.341665 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 549/1100] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:40:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:05.347577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a84720-74e8-4f58-b534-1c5816b2b3de None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:05.412842 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b95797-8e47-47c8-9b26-4716e651b0c5 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:05.435920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:05.445994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a84720-74e8-4f58-b534-1c5816b2b3de None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:05.447456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7a38b-fe95-41af-8e6f-be30bc118eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:05.448137 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7a38b-fe95-41af-8e6f-be30bc118eb9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:05.448417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7a38b-fe95-41af-8e6f-be30bc118eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:05.448700 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7a38b-fe95-41af-8e6f-be30bc118eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:05.449490 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7a38b-fe95-41af-8e6f-be30bc118eb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:05.449802 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7a38b-fe95-41af-8e6f-be30bc118eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:05.451171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7a38b-fe95-41af-8e6f-be30bc118eb9 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:05.459854 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 552/1101] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:40:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:40:05.465643 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7a38b-fe95-41af-8e6f-be30bc118eb9 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:05.480152 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17c620-1199-49cc-8f71-1b348e1310e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:05.480687 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17c620-1199-49cc-8f71-1b348e1310e4 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:05.480982 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17c620-1199-49cc-8f71-1b348e1310e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:05.481291 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17c620-1199-49cc-8f71-1b348e1310e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:05.482152 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17c620-1199-49cc-8f71-1b348e1310e4 None admin] RBAC: Adding query filter params (role.id=cebd4ad2da474d8b9183c4a7587119c8, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=83bff5cd7782423eaa0bc5b29b208ae7) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:05.482467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17c620-1199-49cc-8f71-1b348e1310e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:05.483896 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17c620-1199-49cc-8f71-1b348e1310e4 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:05.489741 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 550/1102] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:40:05 2022] GET /identity/v3/role_assignments?user.id=83bff5cd7782423eaa0bc5b29b208ae7&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=cebd4ad2da474d8b9183c4a7587119c8 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:40:05.524646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:05.572605 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7a38b-fe95-41af-8e6f-be30bc118eb9 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:05.609141 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969be5fb-6804-481b-94eb-b47dc7cd78b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:05.610059 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969be5fb-6804-481b-94eb-b47dc7cd78b3 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:05.610349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969be5fb-6804-481b-94eb-b47dc7cd78b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:05.610630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969be5fb-6804-481b-94eb-b47dc7cd78b3 None admin] PATH_INFO: `/v3/users/1630a9d0e7b74a6098965a0d3f8fa0b7` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:05.611861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969be5fb-6804-481b-94eb-b47dc7cd78b3 None admin] RBAC: Authorizing `identity:get_user(user_id=1630a9d0e7b74a6098965a0d3f8fa0b7)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:05.613363 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969be5fb-6804-481b-94eb-b47dc7cd78b3 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:05.615053 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 553/1103] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:40:05 2022] GET /identity/v3/users/1630a9d0e7b74a6098965a0d3f8fa0b7 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:40:05.621079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17c620-1199-49cc-8f71-1b348e1310e4 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:05.728377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17c620-1199-49cc-8f71-1b348e1310e4 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:05.762612 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f4351-68ec-4856-bda1-4971dcf364d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:05.763198 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f4351-68ec-4856-bda1-4971dcf364d9 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:05.763477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f4351-68ec-4856-bda1-4971dcf364d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:05.763750 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f4351-68ec-4856-bda1-4971dcf364d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:05.789381 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:05.831499 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f4351-68ec-4856-bda1-4971dcf364d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:05.832958 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f4351-68ec-4856-bda1-4971dcf364d9 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:05.934680 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 551/1104] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:40:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 19:40:05.940767 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969be5fb-6804-481b-94eb-b47dc7cd78b3 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:06.044314 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969be5fb-6804-481b-94eb-b47dc7cd78b3 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:06.067497 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:06.078005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c42180-23fc-42b1-a209-a28ee7df83ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:06.078877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c42180-23fc-42b1-a209-a28ee7df83ae None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:06.079158 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c42180-23fc-42b1-a209-a28ee7df83ae None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:06.080503 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c42180-23fc-42b1-a209-a28ee7df83ae None admin] PATH_INFO: `/v3/projects/c1173657a4a2480ba144a6eb21dfe6ec` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:06.080607 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c42180-23fc-42b1-a209-a28ee7df83ae None admin] RBAC: Authorizing `identity:get_project(project_id=c1173657a4a2480ba144a6eb21dfe6ec)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:06.082073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c42180-23fc-42b1-a209-a28ee7df83ae None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:06.083928 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 554/1105] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:40:05 2022] GET /identity/v3/projects/c1173657a4a2480ba144a6eb21dfe6ec => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:06.090178 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f4351-68ec-4856-bda1-4971dcf364d9 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:06.150642 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:06.195827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f4351-68ec-4856-bda1-4971dcf364d9 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:06.230176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d53616-c125-4a4d-b0fc-b6a0cec997ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:06.230833 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d53616-c125-4a4d-b0fc-b6a0cec997ac None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:06.231120 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d53616-c125-4a4d-b0fc-b6a0cec997ac None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:06.231399 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d53616-c125-4a4d-b0fc-b6a0cec997ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:06.232230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d53616-c125-4a4d-b0fc-b6a0cec997ac None admin] RBAC: Adding query filter params (role.id=76bd0cf7bf094e4fa3db121b96215004, scope.project.id=c1173657a4a2480ba144a6eb21dfe6ec, user.id=1630a9d0e7b74a6098965a0d3f8fa0b7) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:06.232543 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d53616-c125-4a4d-b0fc-b6a0cec997ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:06.234008 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d53616-c125-4a4d-b0fc-b6a0cec997ac None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:06.240015 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 552/1106] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:40:06 2022] GET /identity/v3/role_assignments?user.id=1630a9d0e7b74a6098965a0d3f8fa0b7&scope.project.id=c1173657a4a2480ba144a6eb21dfe6ec&role.id=76bd0cf7bf094e4fa3db121b96215004 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:08.286634 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48549af-715a-44d3-a152-bf63941df3d7 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:08.287134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48549af-715a-44d3-a152-bf63941df3d7 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:08.287134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48549af-715a-44d3-a152-bf63941df3d7 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:08.288635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 555/1107] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:40:08.293857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b2eb-1926-4fc6-a809-4574208f70fc None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:08.294229 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b2eb-1926-4fc6-a809-4574208f70fc None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:08.294425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b2eb-1926-4fc6-a809-4574208f70fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:08.310744 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-c9e5b2eb-1926-4fc6-a809-4574208f70fc None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:40:08.311935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c9e5b2eb-1926-4fc6-a809-4574208f70fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:40:08.376729 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 553/1108] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:40:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:40:08.401998 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48549af-715a-44d3-a152-bf63941df3d7 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:08.500815 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48549af-715a-44d3-a152-bf63941df3d7 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:08.534653 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608419f-6ee7-410d-a50b-eb364860c2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:08.535656 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608419f-6ee7-410d-a50b-eb364860c2b3 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:08.535941 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608419f-6ee7-410d-a50b-eb364860c2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:08.536326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608419f-6ee7-410d-a50b-eb364860c2b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:08.538056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608419f-6ee7-410d-a50b-eb364860c2b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:08.539709 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608419f-6ee7-410d-a50b-eb364860c2b3 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:08.541331 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 556/1109] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:40:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:08.547012 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5b2eb-1926-4fc6-a809-4574208f70fc None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:08.594140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:08.643001 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5b2eb-1926-4fc6-a809-4574208f70fc None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:08.674714 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b95790-68ac-4eb8-b581-eefbecc674c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:08.675365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b95790-68ac-4eb8-b581-eefbecc674c9 None admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:08.675648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b95790-68ac-4eb8-b581-eefbecc674c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:08.675923 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b95790-68ac-4eb8-b581-eefbecc674c9 None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:08.676622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b95790-68ac-4eb8-b581-eefbecc674c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:08.678679 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b95790-68ac-4eb8-b581-eefbecc674c9 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:08.751424 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 554/1110] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 19:40:08 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:40:10.844919 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3308dd-2c87-4f50-b437-55795ebdcfd6 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:10.845491 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3308dd-2c87-4f50-b437-55795ebdcfd6 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:10.845491 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3308dd-2c87-4f50-b437-55795ebdcfd6 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:10.846882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 557/1111] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:40:10.852655 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db3c82-3220-4039-93ed-2bd0e9b3978b None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:10.853038 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db3c82-3220-4039-93ed-2bd0e9b3978b None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:10.853252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db3c82-3220-4039-93ed-2bd0e9b3978b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:10.869805 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-d9db3c82-3220-4039-93ed-2bd0e9b3978b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:40:10.871022 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d9db3c82-3220-4039-93ed-2bd0e9b3978b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:40:10.939534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 555/1112] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:40:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:40:10.963847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3308dd-2c87-4f50-b437-55795ebdcfd6 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:11.022789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:11.062481 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3308dd-2c87-4f50-b437-55795ebdcfd6 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:11.094705 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21862721-f03a-48c7-98bb-482318175c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:11.095597 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21862721-f03a-48c7-98bb-482318175c4e None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:11.095832 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21862721-f03a-48c7-98bb-482318175c4e None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:11.096109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21862721-f03a-48c7-98bb-482318175c4e None admin] PATH_INFO: `/v3/roles/f0bb7fa65c8545699b60f857f930b078` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:11.097587 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21862721-f03a-48c7-98bb-482318175c4e None admin] RBAC: Authorizing `identity:get_role(role_id=f0bb7fa65c8545699b60f857f930b078)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:11.098955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21862721-f03a-48c7-98bb-482318175c4e None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:11.100868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 558/1113] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:40:10 2022] GET /identity/v3/roles/f0bb7fa65c8545699b60f857f930b078 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:11.106736 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db3c82-3220-4039-93ed-2bd0e9b3978b None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:11.139512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:11.203511 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db3c82-3220-4039-93ed-2bd0e9b3978b None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:11.235984 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a839a-da49-4844-add6-8e9b2f611fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:11.236834 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a839a-da49-4844-add6-8e9b2f611fd7 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:11.237120 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a839a-da49-4844-add6-8e9b2f611fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:11.237428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a839a-da49-4844-add6-8e9b2f611fd7 None admin] PATH_INFO: `/v3/users/8ac2e410878c4bb18ba12df1721788f0` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:11.249947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a839a-da49-4844-add6-8e9b2f611fd7 None admin] RBAC: Authorizing `identity:get_user(user_id=8ac2e410878c4bb18ba12df1721788f0)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:11.251386 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a839a-da49-4844-add6-8e9b2f611fd7 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:11.252992 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 556/1114] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:40:11 2022] GET /identity/v3/users/8ac2e410878c4bb18ba12df1721788f0 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:11.259576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21862721-f03a-48c7-98bb-482318175c4e None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:11.356692 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21862721-f03a-48c7-98bb-482318175c4e None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:11.380926 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:11.388842 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee9e36-94e7-40bd-997d-234f7f33def0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:11.391847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee9e36-94e7-40bd-997d-234f7f33def0 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:11.391847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee9e36-94e7-40bd-997d-234f7f33def0 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:11.391847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee9e36-94e7-40bd-997d-234f7f33def0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:11.455329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee9e36-94e7-40bd-997d-234f7f33def0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:11.456763 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee9e36-94e7-40bd-997d-234f7f33def0 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:11.550750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 559/1115] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:40:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 19:40:11.556711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a839a-da49-4844-add6-8e9b2f611fd7 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:11.645603 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:11.654585 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a839a-da49-4844-add6-8e9b2f611fd7 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:11.687836 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce468d5f-a805-47d1-8463-b89a1c9fa874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:11.688664 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce468d5f-a805-47d1-8463-b89a1c9fa874 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:11.688947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce468d5f-a805-47d1-8463-b89a1c9fa874 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:11.689252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce468d5f-a805-47d1-8463-b89a1c9fa874 None admin] PATH_INFO: `/v3/projects/c1173657a4a2480ba144a6eb21dfe6ec` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:11.690431 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce468d5f-a805-47d1-8463-b89a1c9fa874 None admin] RBAC: Authorizing `identity:get_project(project_id=c1173657a4a2480ba144a6eb21dfe6ec)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:11.691877 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce468d5f-a805-47d1-8463-b89a1c9fa874 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:11.693675 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 557/1116] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:40:11 2022] GET /identity/v3/projects/c1173657a4a2480ba144a6eb21dfe6ec => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:11.699833 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee9e36-94e7-40bd-997d-234f7f33def0 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:11.727311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:11.796094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee9e36-94e7-40bd-997d-234f7f33def0 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:11.828589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b082b2-fde4-4378-8b1c-6e2100e04914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:11.829253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b082b2-fde4-4378-8b1c-6e2100e04914 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:11.829542 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b082b2-fde4-4378-8b1c-6e2100e04914 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:11.829822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b082b2-fde4-4378-8b1c-6e2100e04914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:11.830636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b082b2-fde4-4378-8b1c-6e2100e04914 None admin] RBAC: Adding query filter params (role.id=f0bb7fa65c8545699b60f857f930b078, scope.project.id=c1173657a4a2480ba144a6eb21dfe6ec, user.id=8ac2e410878c4bb18ba12df1721788f0) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:11.830948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b082b2-fde4-4378-8b1c-6e2100e04914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:11.832369 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b082b2-fde4-4378-8b1c-6e2100e04914 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:11.838287 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 560/1117] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:40:11 2022] GET /identity/v3/role_assignments?user.id=8ac2e410878c4bb18ba12df1721788f0&scope.project.id=c1173657a4a2480ba144a6eb21dfe6ec&role.id=f0bb7fa65c8545699b60f857f930b078 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:13.871284 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10c0df-0a83-4dc2-8944-65ad590366d4 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:13.871825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10c0df-0a83-4dc2-8944-65ad590366d4 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:13.871825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10c0df-0a83-4dc2-8944-65ad590366d4 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:13.873211 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 558/1118] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:40:13.878559 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb1313-fd0c-4a88-abfd-4799cfae70f3 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:13.878963 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb1313-fd0c-4a88-abfd-4799cfae70f3 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:13.879211 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb1313-fd0c-4a88-abfd-4799cfae70f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:13.896465 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-febb1313-fd0c-4a88-abfd-4799cfae70f3 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:40:13.897770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-febb1313-fd0c-4a88-abfd-4799cfae70f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:40:13.963670 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 561/1119] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:40:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:40:13.986551 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10c0df-0a83-4dc2-8944-65ad590366d4 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:14.084115 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10c0df-0a83-4dc2-8944-65ad590366d4 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:14.116306 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203ea85-2faf-466f-8bcd-78158e376099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:14.117124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203ea85-2faf-466f-8bcd-78158e376099 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:14.117432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203ea85-2faf-466f-8bcd-78158e376099 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:14.117701 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203ea85-2faf-466f-8bcd-78158e376099 None admin] PATH_INFO: `/v3/roles/f0bb7fa65c8545699b60f857f930b078` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:14.119153 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203ea85-2faf-466f-8bcd-78158e376099 None admin] RBAC: Authorizing `identity:get_role(role_id=f0bb7fa65c8545699b60f857f930b078)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:14.120510 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203ea85-2faf-466f-8bcd-78158e376099 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:14.121924 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 559/1120] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:40:13 2022] GET /identity/v3/roles/f0bb7fa65c8545699b60f857f930b078 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:14.127611 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb1313-fd0c-4a88-abfd-4799cfae70f3 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:14.151549 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:14.224306 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb1313-fd0c-4a88-abfd-4799cfae70f3 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:14.257961 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27d568-a219-4381-85c0-80af60ca35e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:14.258816 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27d568-a219-4381-85c0-80af60ca35e6 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:14.259102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27d568-a219-4381-85c0-80af60ca35e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:14.259382 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27d568-a219-4381-85c0-80af60ca35e6 None admin] PATH_INFO: `/v3/users/8ac2e410878c4bb18ba12df1721788f0` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:14.260553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27d568-a219-4381-85c0-80af60ca35e6 None admin] RBAC: Authorizing `identity:get_user(user_id=8ac2e410878c4bb18ba12df1721788f0)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:14.262010 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27d568-a219-4381-85c0-80af60ca35e6 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:14.263628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 562/1121] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:40:14 2022] GET /identity/v3/users/8ac2e410878c4bb18ba12df1721788f0 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:14.269462 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203ea85-2faf-466f-8bcd-78158e376099 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:14.296713 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:14.366052 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203ea85-2faf-466f-8bcd-78158e376099 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:14.397929 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db8ff7-d360-4331-ad96-4ad696bc901e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:14.398759 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db8ff7-d360-4331-ad96-4ad696bc901e None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:14.399041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db8ff7-d360-4331-ad96-4ad696bc901e None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:14.399313 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db8ff7-d360-4331-ad96-4ad696bc901e None admin] PATH_INFO: `/v3/projects/c1173657a4a2480ba144a6eb21dfe6ec` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:14.400466 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db8ff7-d360-4331-ad96-4ad696bc901e None admin] RBAC: Authorizing `identity:get_project(project_id=c1173657a4a2480ba144a6eb21dfe6ec)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:14.401912 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db8ff7-d360-4331-ad96-4ad696bc901e None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:14.403571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 560/1122] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:40:14 2022] GET /identity/v3/projects/c1173657a4a2480ba144a6eb21dfe6ec => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:14.409405 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27d568-a219-4381-85c0-80af60ca35e6 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:14.496865 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:14.506007 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27d568-a219-4381-85c0-80af60ca35e6 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:14.539860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793ca15-0a98-4ff9-a147-d65ad8c9629b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:14.540737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793ca15-0a98-4ff9-a147-d65ad8c9629b None admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:14.541026 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793ca15-0a98-4ff9-a147-d65ad8c9629b None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:14.541342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793ca15-0a98-4ff9-a147-d65ad8c9629b None admin] PATH_INFO: `/v3/projects/c1173657a4a2480ba144a6eb21dfe6ec/users/8ac2e410878c4bb18ba12df1721788f0/roles/f0bb7fa65c8545699b60f857f930b078` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:14.543524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793ca15-0a98-4ff9-a147-d65ad8c9629b None admin] RBAC: Authorizing `identity:create_grant(project_id=c1173657a4a2480ba144a6eb21dfe6ec, user_id=8ac2e410878c4bb18ba12df1721788f0, role_id=f0bb7fa65c8545699b60f857f930b078)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:14.544952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793ca15-0a98-4ff9-a147-d65ad8c9629b None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:14.620387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 563/1123] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:40:14 2022] PUT /identity/v3/projects/c1173657a4a2480ba144a6eb21dfe6ec/users/8ac2e410878c4bb18ba12df1721788f0/roles/f0bb7fa65c8545699b60f857f930b078 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:40:16.613616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109e639-0142-44ca-88b9-02a3c1fc9597 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:16.614205 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109e639-0142-44ca-88b9-02a3c1fc9597 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:16.614205 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109e639-0142-44ca-88b9-02a3c1fc9597 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:16.616298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 561/1124] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:40:16.621603 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc7f51-c377-4bb1-b159-a5ec18b1146d None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:16.622014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc7f51-c377-4bb1-b159-a5ec18b1146d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:16.622166 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc7f51-c377-4bb1-b159-a5ec18b1146d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:16.639198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-62dc7f51-c377-4bb1-b159-a5ec18b1146d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:40:16.640378 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-62dc7f51-c377-4bb1-b159-a5ec18b1146d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:40:16.704733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 564/1125] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:40:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:40:16.728274 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109e639-0142-44ca-88b9-02a3c1fc9597 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:16.822427 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:16.828865 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109e639-0142-44ca-88b9-02a3c1fc9597 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:16.862392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b59034-788f-47a0-9ff0-f3b8de4c393b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:16.863222 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b59034-788f-47a0-9ff0-f3b8de4c393b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:16.863505 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b59034-788f-47a0-9ff0-f3b8de4c393b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:16.863830 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b59034-788f-47a0-9ff0-f3b8de4c393b None admin] PATH_INFO: `/v3/roles/f0bb7fa65c8545699b60f857f930b078` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:16.865896 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b59034-788f-47a0-9ff0-f3b8de4c393b None admin] RBAC: Authorizing `identity:get_role(role_id=f0bb7fa65c8545699b60f857f930b078)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:16.867583 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b59034-788f-47a0-9ff0-f3b8de4c393b None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:16.868916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 562/1126] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:40:16 2022] GET /identity/v3/roles/f0bb7fa65c8545699b60f857f930b078 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:16.874778 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc7f51-c377-4bb1-b159-a5ec18b1146d None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:16.952623 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:16.972575 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc7f51-c377-4bb1-b159-a5ec18b1146d None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:17.006507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03320f-7382-4fd2-addb-6b652cb16277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:17.007998 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03320f-7382-4fd2-addb-6b652cb16277 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:17.008289 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03320f-7382-4fd2-addb-6b652cb16277 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:17.008569 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03320f-7382-4fd2-addb-6b652cb16277 None admin] PATH_INFO: `/v3/users/8ac2e410878c4bb18ba12df1721788f0` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:17.009772 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03320f-7382-4fd2-addb-6b652cb16277 None admin] RBAC: Authorizing `identity:get_user(user_id=8ac2e410878c4bb18ba12df1721788f0)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:17.011317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03320f-7382-4fd2-addb-6b652cb16277 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:17.012939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 565/1127] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:40:16 2022] GET /identity/v3/users/8ac2e410878c4bb18ba12df1721788f0 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:17.018768 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b59034-788f-47a0-9ff0-f3b8de4c393b None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:17.115347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b59034-788f-47a0-9ff0-f3b8de4c393b None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:17.149438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cf4ca-4119-4e5e-8cd7-c5926b580a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:17.150083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cf4ca-4119-4e5e-8cd7-c5926b580a87 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:17.150371 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cf4ca-4119-4e5e-8cd7-c5926b580a87 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:17.150654 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cf4ca-4119-4e5e-8cd7-c5926b580a87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:17.179605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:17.215405 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cf4ca-4119-4e5e-8cd7-c5926b580a87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:17.216842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cf4ca-4119-4e5e-8cd7-c5926b580a87 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:17.311532 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 563/1128] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:40:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 19:40:17.317484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03320f-7382-4fd2-addb-6b652cb16277 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:17.414416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03320f-7382-4fd2-addb-6b652cb16277 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:17.447314 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05cb1e-c142-42aa-907b-5299443157b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:17.448158 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05cb1e-c142-42aa-907b-5299443157b1 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:17.448445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05cb1e-c142-42aa-907b-5299443157b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:17.448722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05cb1e-c142-42aa-907b-5299443157b1 None admin] PATH_INFO: `/v3/projects/c1173657a4a2480ba144a6eb21dfe6ec` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:17.449921 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05cb1e-c142-42aa-907b-5299443157b1 None admin] RBAC: Authorizing `identity:get_project(project_id=c1173657a4a2480ba144a6eb21dfe6ec)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:17.451349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05cb1e-c142-42aa-907b-5299443157b1 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:17.453025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 566/1129] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:40:17 2022] GET /identity/v3/projects/c1173657a4a2480ba144a6eb21dfe6ec => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:17.458969 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cf4ca-4119-4e5e-8cd7-c5926b580a87 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:17.518658 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:17.555563 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cf4ca-4119-4e5e-8cd7-c5926b580a87 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:17.589140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bb2ec-8aac-4b69-8a0a-a82922a0b8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:17.589812 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bb2ec-8aac-4b69-8a0a-a82922a0b8d2 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:17.590101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bb2ec-8aac-4b69-8a0a-a82922a0b8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:17.590384 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bb2ec-8aac-4b69-8a0a-a82922a0b8d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:17.591209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bb2ec-8aac-4b69-8a0a-a82922a0b8d2 None admin] RBAC: Adding query filter params (role.id=f0bb7fa65c8545699b60f857f930b078, scope.project.id=c1173657a4a2480ba144a6eb21dfe6ec, user.id=8ac2e410878c4bb18ba12df1721788f0) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:17.591526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bb2ec-8aac-4b69-8a0a-a82922a0b8d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:17.592946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bb2ec-8aac-4b69-8a0a-a82922a0b8d2 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:17.598742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 564/1130] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:40:17 2022] GET /identity/v3/role_assignments?user.id=8ac2e410878c4bb18ba12df1721788f0&scope.project.id=c1173657a4a2480ba144a6eb21dfe6ec&role.id=f0bb7fa65c8545699b60f857f930b078 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:40:19.625134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7e09c-a0c5-47f5-b24c-73cde8fb4fed None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:19.625688 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7e09c-a0c5-47f5-b24c-73cde8fb4fed None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:19.625800 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7e09c-a0c5-47f5-b24c-73cde8fb4fed None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:19.627088 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 567/1131] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:40:19.632755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce9db5-930d-4033-9990-14f788510deb None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:19.633200 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce9db5-930d-4033-9990-14f788510deb None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:19.633367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce9db5-930d-4033-9990-14f788510deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:19.650196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-24ce9db5-930d-4033-9990-14f788510deb None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:40:19.651393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-24ce9db5-930d-4033-9990-14f788510deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:40:19.715950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 565/1132] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:40:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:40:19.739275 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7e09c-a0c5-47f5-b24c-73cde8fb4fed None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:19.758118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:19.838304 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7e09c-a0c5-47f5-b24c-73cde8fb4fed None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:19.870883 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df585bd-43f3-4e5a-8f7d-48bed3952be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:19.871659 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df585bd-43f3-4e5a-8f7d-48bed3952be6 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:19.871977 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df585bd-43f3-4e5a-8f7d-48bed3952be6 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:19.872257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df585bd-43f3-4e5a-8f7d-48bed3952be6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:19.873457 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df585bd-43f3-4e5a-8f7d-48bed3952be6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:19.874888 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df585bd-43f3-4e5a-8f7d-48bed3952be6 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:19.876564 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 568/1133] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:40:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:19.882997 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce9db5-930d-4033-9990-14f788510deb None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:19.940605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:19.981453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce9db5-930d-4033-9990-14f788510deb None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:20.014797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ba3b9-0b17-4733-bfb5-7c63d17d06cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:20.015448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ba3b9-0b17-4733-bfb5-7c63d17d06cc None admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:20.015735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ba3b9-0b17-4733-bfb5-7c63d17d06cc None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:20.016015 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ba3b9-0b17-4733-bfb5-7c63d17d06cc None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:20.016716 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ba3b9-0b17-4733-bfb5-7c63d17d06cc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:20.018220 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ba3b9-0b17-4733-bfb5-7c63d17d06cc None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:20.104519 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 566/1134] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 19:40:19 2022] POST /identity/v3/projects => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:40:22.147101 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5e324-c4c3-45af-9c05-e5f91ee4986c None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:22.147647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5e324-c4c3-45af-9c05-e5f91ee4986c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:22.147647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5e324-c4c3-45af-9c05-e5f91ee4986c None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:22.149020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 569/1135] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:40:22.154324 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2286223-5db6-47aa-ad5d-6961ce63ae85 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:22.154708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2286223-5db6-47aa-ad5d-6961ce63ae85 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:22.154836 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2286223-5db6-47aa-ad5d-6961ce63ae85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:22.171235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-c2286223-5db6-47aa-ad5d-6961ce63ae85 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:40:22.172419 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c2286223-5db6-47aa-ad5d-6961ce63ae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:40:22.238087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 567/1136] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:40:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:40:22.264114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5e324-c4c3-45af-9c05-e5f91ee4986c None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:22.348031 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:22.364761 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5e324-c4c3-45af-9c05-e5f91ee4986c None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:22.398456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80251186-ac5a-4464-96bf-02ab6d0c4e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:22.399225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80251186-ac5a-4464-96bf-02ab6d0c4e96 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:22.399505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80251186-ac5a-4464-96bf-02ab6d0c4e96 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:22.399778 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80251186-ac5a-4464-96bf-02ab6d0c4e96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:22.400935 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80251186-ac5a-4464-96bf-02ab6d0c4e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:22.402392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80251186-ac5a-4464-96bf-02ab6d0c4e96 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:22.403985 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 570/1137] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:40:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:22.409892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2286223-5db6-47aa-ad5d-6961ce63ae85 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:22.450531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:22.506288 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2286223-5db6-47aa-ad5d-6961ce63ae85 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:22.539546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401470de-5ffb-4ddf-95b6-d8ed2ef552aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:22.540201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401470de-5ffb-4ddf-95b6-d8ed2ef552aa None admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:22.540486 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401470de-5ffb-4ddf-95b6-d8ed2ef552aa None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:22.540763 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401470de-5ffb-4ddf-95b6-d8ed2ef552aa None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:22.541513 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401470de-5ffb-4ddf-95b6-d8ed2ef552aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:22.542943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401470de-5ffb-4ddf-95b6-d8ed2ef552aa None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:22.617688 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 568/1138] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 19:40:22 2022] POST /identity/v3/users => generated 286 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:40:24.665559 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a29b37-398a-4d4e-9123-dcb8a3287ae3 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:24.666093 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a29b37-398a-4d4e-9123-dcb8a3287ae3 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:24.666093 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a29b37-398a-4d4e-9123-dcb8a3287ae3 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:24.667486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 571/1139] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:40:24.672529 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829da899-d3e5-48aa-ac20-14530fef14b9 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:24.672899 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829da899-d3e5-48aa-ac20-14530fef14b9 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:24.673091 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829da899-d3e5-48aa-ac20-14530fef14b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:24.690002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-829da899-d3e5-48aa-ac20-14530fef14b9 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:40:24.691185 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-829da899-d3e5-48aa-ac20-14530fef14b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:40:24.755788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 569/1140] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:40:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:40:24.779886 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a29b37-398a-4d4e-9123-dcb8a3287ae3 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:24.879397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a29b37-398a-4d4e-9123-dcb8a3287ae3 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:24.913381 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5fcb8-1d29-4fa4-8230-e6bb120a31c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:24.914167 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5fcb8-1d29-4fa4-8230-e6bb120a31c1 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:24.914453 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5fcb8-1d29-4fa4-8230-e6bb120a31c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:24.914730 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5fcb8-1d29-4fa4-8230-e6bb120a31c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:24.924551 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5fcb8-1d29-4fa4-8230-e6bb120a31c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:40:24.932020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-1fd5fcb8-1d29-4fa4-8230-e6bb120a31c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:40:24.932020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:40:24.932020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:40:24.932020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:40:24.932020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:40:24.932020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:40:24.932020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:40:24.932020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:40:24.932020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:40:24.932020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:40:24.932020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:40:24.932020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:40:24.932020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:40:24.932020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:40:24.932020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:40:24.932020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:40:24.933200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:40:24.933200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:40:24.933200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:40:24.933200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:40:24.933200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:40:24.933200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:40:24.933200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:40:24.933200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:40:24.933200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:40:24.933200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:40:24.933200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:40:24.933200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:40:24.933200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:40:24.933200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:40:24.933200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:40:24.933200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:40:24.934127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:40:24.934127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:40:24.934127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:40:24.934127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:40:24.934127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:40:24.934127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:40:24.934127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:40:24.934127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:40:24.934127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:40:24.934127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:40:24.934127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:40:24.934127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:40:24.934127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 572/1141] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:40:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:40:24.939111 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829da899-d3e5-48aa-ac20-14530fef14b9 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:24.966187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:25.037492 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829da899-d3e5-48aa-ac20-14530fef14b9 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:25.071585 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe3ad9-862b-47e7-b088-d0d16b79ced8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:25.072232 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe3ad9-862b-47e7-b088-d0d16b79ced8 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:25.072514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe3ad9-862b-47e7-b088-d0d16b79ced8 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:25.072788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe3ad9-862b-47e7-b088-d0d16b79ced8 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:25.073560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe3ad9-862b-47e7-b088-d0d16b79ced8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:25.073875 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe3ad9-862b-47e7-b088-d0d16b79ced8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:25.075218 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe3ad9-862b-47e7-b088-d0d16b79ced8 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:25.082937 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 570/1142] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:40:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:25.088875 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5fcb8-1d29-4fa4-8230-e6bb120a31c1 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:25.104970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:25.189947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5fcb8-1d29-4fa4-8230-e6bb120a31c1 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:25.222060 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40440a-f4d1-43d5-8c8b-51a0cd5f255a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:25.222917 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40440a-f4d1-43d5-8c8b-51a0cd5f255a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:25.223198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40440a-f4d1-43d5-8c8b-51a0cd5f255a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:25.223474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40440a-f4d1-43d5-8c8b-51a0cd5f255a None admin] PATH_INFO: `/v3/users/9c61e27a04dc41bf8ea8b18aaaed8324` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:25.235919 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40440a-f4d1-43d5-8c8b-51a0cd5f255a None admin] RBAC: Authorizing `identity:get_user(user_id=9c61e27a04dc41bf8ea8b18aaaed8324)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:25.237370 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40440a-f4d1-43d5-8c8b-51a0cd5f255a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:25.238999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 573/1143] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:40:25 2022] GET /identity/v3/users/9c61e27a04dc41bf8ea8b18aaaed8324 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:25.245679 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe3ad9-862b-47e7-b088-d0d16b79ced8 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:25.331032 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:25.342738 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe3ad9-862b-47e7-b088-d0d16b79ced8 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:25.375414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1196af-647c-4d89-ac14-78598636f6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:25.376048 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1196af-647c-4d89-ac14-78598636f6ae None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:25.376341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1196af-647c-4d89-ac14-78598636f6ae None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:25.376629 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1196af-647c-4d89-ac14-78598636f6ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:25.442674 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1196af-647c-4d89-ac14-78598636f6ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:25.444092 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1196af-647c-4d89-ac14-78598636f6ae None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:25.528867 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:25.541417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 571/1144] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:40:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 19:40:25.547335 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40440a-f4d1-43d5-8c8b-51a0cd5f255a None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:25.614307 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:25.643450 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40440a-f4d1-43d5-8c8b-51a0cd5f255a None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:25.677005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd8648-b08b-42ac-a599-a09c1fd4fc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:25.678652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd8648-b08b-42ac-a599-a09c1fd4fc80 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:25.678937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd8648-b08b-42ac-a599-a09c1fd4fc80 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:25.679215 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd8648-b08b-42ac-a599-a09c1fd4fc80 None admin] PATH_INFO: `/v3/projects/72ee6f4822bd43f6a138928bce54a665` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:25.680392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd8648-b08b-42ac-a599-a09c1fd4fc80 None admin] RBAC: Authorizing `identity:get_project(project_id=72ee6f4822bd43f6a138928bce54a665)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:25.681848 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd8648-b08b-42ac-a599-a09c1fd4fc80 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:25.683525 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 574/1145] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:40:25 2022] GET /identity/v3/projects/72ee6f4822bd43f6a138928bce54a665 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:25.689498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1196af-647c-4d89-ac14-78598636f6ae None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:25.788003 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1196af-647c-4d89-ac14-78598636f6ae None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:25.825955 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6259eba-bf51-4abb-966b-a9f6d3eaff12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:25.826607 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6259eba-bf51-4abb-966b-a9f6d3eaff12 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:25.826890 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6259eba-bf51-4abb-966b-a9f6d3eaff12 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:25.827167 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6259eba-bf51-4abb-966b-a9f6d3eaff12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:25.827996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6259eba-bf51-4abb-966b-a9f6d3eaff12 None admin] RBAC: Adding query filter params (role.id=76bd0cf7bf094e4fa3db121b96215004, scope.project.id=72ee6f4822bd43f6a138928bce54a665, user.id=9c61e27a04dc41bf8ea8b18aaaed8324) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:25.828310 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6259eba-bf51-4abb-966b-a9f6d3eaff12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:25.829786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6259eba-bf51-4abb-966b-a9f6d3eaff12 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:25.835330 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 572/1146] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:40:25 2022] GET /identity/v3/role_assignments?user.id=9c61e27a04dc41bf8ea8b18aaaed8324&scope.project.id=72ee6f4822bd43f6a138928bce54a665&role.id=76bd0cf7bf094e4fa3db121b96215004 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:27.844635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bca8f-1e08-4e94-a657-4eadb78deae1 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:27.845218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bca8f-1e08-4e94-a657-4eadb78deae1 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:27.845218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bca8f-1e08-4e94-a657-4eadb78deae1 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:27.846600 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 575/1147] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:40:27.852425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8205980-941a-4595-9b2e-2b932fd4dfbe None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:27.852850 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8205980-941a-4595-9b2e-2b932fd4dfbe None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:27.852992 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8205980-941a-4595-9b2e-2b932fd4dfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:27.869826 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-d8205980-941a-4595-9b2e-2b932fd4dfbe None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:40:27.871018 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d8205980-941a-4595-9b2e-2b932fd4dfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:40:27.917579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:27.937499 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 573/1148] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:40:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:40:27.960746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bca8f-1e08-4e94-a657-4eadb78deae1 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:28.059671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bca8f-1e08-4e94-a657-4eadb78deae1 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:28.092811 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8366f45-1129-47bc-9174-b960fd8d27de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:28.093617 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366f45-1129-47bc-9174-b960fd8d27de None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:28.093904 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366f45-1129-47bc-9174-b960fd8d27de None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:28.094183 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366f45-1129-47bc-9174-b960fd8d27de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:28.101396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:28.105040 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8366f45-1129-47bc-9174-b960fd8d27de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:40:28.112548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-f8366f45-1129-47bc-9174-b960fd8d27de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:40:28.112548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:40:28.112548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:40:28.112548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:40:28.112548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:40:28.112548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:40:28.112548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:40:28.112548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:40:28.112548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:40:28.112548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:40:28.112548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:40:28.112548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:40:28.112548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:40:28.112548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:40:28.112548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:40:28.112548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:40:28.114262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:40:28.114262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:40:28.114262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:40:28.114262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:40:28.114262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:40:28.114262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:40:28.114262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:40:28.114262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:40:28.114262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:40:28.114262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:40:28.114262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:40:28.114262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:40:28.114262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:40:28.114262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:40:28.114262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:40:28.114262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:40:28.115095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:40:28.115095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:40:28.115095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:40:28.115095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:40:28.115095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:40:28.115095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:40:28.115095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:40:28.115095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:40:28.115095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:40:28.115095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:40:28.115095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:40:28.115095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:40:28.115095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 576/1149] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:40:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:40:28.120268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8205980-941a-4595-9b2e-2b932fd4dfbe None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:28.220403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8205980-941a-4595-9b2e-2b932fd4dfbe None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:28.253514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b6266-549e-43b7-b1ac-818cbd05c859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:28.254166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b6266-549e-43b7-b1ac-818cbd05c859 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:28.254449 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b6266-549e-43b7-b1ac-818cbd05c859 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:28.254724 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b6266-549e-43b7-b1ac-818cbd05c859 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:28.255462 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b6266-549e-43b7-b1ac-818cbd05c859 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:28.255785 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b6266-549e-43b7-b1ac-818cbd05c859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:28.257643 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b6266-549e-43b7-b1ac-818cbd05c859 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:28.265318 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 574/1150] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:40:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:28.271034 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8366f45-1129-47bc-9174-b960fd8d27de None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:28.369046 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8366f45-1129-47bc-9174-b960fd8d27de None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:28.402004 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8c32e-ae0e-4d0e-babd-1769cf834588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:28.402857 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8c32e-ae0e-4d0e-babd-1769cf834588 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:28.403142 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8c32e-ae0e-4d0e-babd-1769cf834588 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:28.403419 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8c32e-ae0e-4d0e-babd-1769cf834588 None admin] PATH_INFO: `/v3/users/9c61e27a04dc41bf8ea8b18aaaed8324` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:28.404591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8c32e-ae0e-4d0e-babd-1769cf834588 None admin] RBAC: Authorizing `identity:get_user(user_id=9c61e27a04dc41bf8ea8b18aaaed8324)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:28.406035 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8c32e-ae0e-4d0e-babd-1769cf834588 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:28.407629 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 577/1151] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:40:28 2022] GET /identity/v3/users/9c61e27a04dc41bf8ea8b18aaaed8324 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:28.413236 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b6266-549e-43b7-b1ac-818cbd05c859 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:28.464018 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:28.515949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b6266-549e-43b7-b1ac-818cbd05c859 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:28.548369 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac11e9a-6519-41cc-9e7f-f70a6c3565e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:28.549249 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac11e9a-6519-41cc-9e7f-f70a6c3565e7 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:28.549534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac11e9a-6519-41cc-9e7f-f70a6c3565e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:28.549819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac11e9a-6519-41cc-9e7f-f70a6c3565e7 None admin] PATH_INFO: `/v3/projects/72ee6f4822bd43f6a138928bce54a665` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:28.550981 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac11e9a-6519-41cc-9e7f-f70a6c3565e7 None admin] RBAC: Authorizing `identity:get_project(project_id=72ee6f4822bd43f6a138928bce54a665)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:28.552417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac11e9a-6519-41cc-9e7f-f70a6c3565e7 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:28.554147 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 575/1152] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:40:28 2022] GET /identity/v3/projects/72ee6f4822bd43f6a138928bce54a665 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:40:28.560007 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8c32e-ae0e-4d0e-babd-1769cf834588 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:28.623390 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:28.656761 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8c32e-ae0e-4d0e-babd-1769cf834588 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:28.688854 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88b690-e538-456d-ac17-3a691606bd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:28.689767 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88b690-e538-456d-ac17-3a691606bd63 None admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:28.690054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88b690-e538-456d-ac17-3a691606bd63 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:28.690333 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88b690-e538-456d-ac17-3a691606bd63 None admin] PATH_INFO: `/v3/projects/72ee6f4822bd43f6a138928bce54a665/users/9c61e27a04dc41bf8ea8b18aaaed8324/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:28.692273 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88b690-e538-456d-ac17-3a691606bd63 None admin] RBAC: Authorizing `identity:create_grant(project_id=72ee6f4822bd43f6a138928bce54a665, user_id=9c61e27a04dc41bf8ea8b18aaaed8324, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:28.694415 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88b690-e538-456d-ac17-3a691606bd63 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:28.774100 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 578/1153] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:40:28 2022] PUT /identity/v3/projects/72ee6f4822bd43f6a138928bce54a665/users/9c61e27a04dc41bf8ea8b18aaaed8324/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:40:30.774032 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109f114-0aed-4b2d-9909-f9f1d62b2a6e None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:30.774573 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109f114-0aed-4b2d-9909-f9f1d62b2a6e None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:30.774573 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109f114-0aed-4b2d-9909-f9f1d62b2a6e None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:30.775965 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 576/1154] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:40:30.781030 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b3ea0-a98a-484d-8c5d-3244c66b36ce None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:30.781427 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b3ea0-a98a-484d-8c5d-3244c66b36ce None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:30.781631 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b3ea0-a98a-484d-8c5d-3244c66b36ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:30.798221 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-4e7b3ea0-a98a-484d-8c5d-3244c66b36ce None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:40:30.799392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-4e7b3ea0-a98a-484d-8c5d-3244c66b36ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:40:30.865545 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 579/1155] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:40:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:40:30.889345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109f114-0aed-4b2d-9909-f9f1d62b2a6e None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:30.988715 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109f114-0aed-4b2d-9909-f9f1d62b2a6e None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:31.003143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:31.032651 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41b884-4302-46fd-9ad1-b817a5148bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:31.033387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41b884-4302-46fd-9ad1-b817a5148bfd None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:31.033669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41b884-4302-46fd-9ad1-b817a5148bfd None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:31.033945 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41b884-4302-46fd-9ad1-b817a5148bfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:31.044681 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41b884-4302-46fd-9ad1-b817a5148bfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:40:31.052118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-cf41b884-4302-46fd-9ad1-b817a5148bfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:40:31.052118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:40:31.052118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:40:31.052118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:40:31.052118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:40:31.052118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:40:31.052118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:40:31.052118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:40:31.052118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:40:31.052118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:40:31.052118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:40:31.052118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:40:31.052118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:40:31.052118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:40:31.052118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:40:31.052118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:40:31.053774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:40:31.053774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:40:31.053774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:40:31.053774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:40:31.053774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:40:31.053774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:40:31.053774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:40:31.053774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:40:31.053774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:40:31.053774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:40:31.053774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:40:31.053774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:40:31.053774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:40:31.053774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:40:31.053774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:40:31.053774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:40:31.054742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:40:31.054742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:40:31.054742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:40:31.054742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:40:31.054742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:40:31.054742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:40:31.054742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:40:31.054742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:40:31.054742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:40:31.054742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:40:31.054742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:40:31.054742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:40:31.054742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 577/1156] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:40:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:40:31.060446 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b3ea0-a98a-484d-8c5d-3244c66b36ce None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:31.115709 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:31.157780 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b3ea0-a98a-484d-8c5d-3244c66b36ce None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:31.191751 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e6e05-6078-4892-98de-13c9e7281858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:31.192418 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6e05-6078-4892-98de-13c9e7281858 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:31.192703 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6e05-6078-4892-98de-13c9e7281858 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:31.192978 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6e05-6078-4892-98de-13c9e7281858 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:31.194541 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e6e05-6078-4892-98de-13c9e7281858 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:31.194846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e6e05-6078-4892-98de-13c9e7281858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:31.196473 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e6e05-6078-4892-98de-13c9e7281858 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:31.204702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 580/1157] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:40:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:31.210963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41b884-4302-46fd-9ad1-b817a5148bfd None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:31.309851 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41b884-4302-46fd-9ad1-b817a5148bfd None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:31.345963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6389a2-0936-4e28-9430-d2abfbd018c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:31.346820 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6389a2-0936-4e28-9430-d2abfbd018c8 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:31.347100 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6389a2-0936-4e28-9430-d2abfbd018c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:31.347432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6389a2-0936-4e28-9430-d2abfbd018c8 None admin] PATH_INFO: `/v3/users/9c61e27a04dc41bf8ea8b18aaaed8324` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:31.348625 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6389a2-0936-4e28-9430-d2abfbd018c8 None admin] RBAC: Authorizing `identity:get_user(user_id=9c61e27a04dc41bf8ea8b18aaaed8324)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:31.350881 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6389a2-0936-4e28-9430-d2abfbd018c8 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:31.352488 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 578/1158] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:40:31 2022] GET /identity/v3/users/9c61e27a04dc41bf8ea8b18aaaed8324 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:31.358269 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e6e05-6078-4892-98de-13c9e7281858 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:31.464713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e6e05-6078-4892-98de-13c9e7281858 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:31.483741 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:31.500775 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83d7e2-f7a8-4ca2-b0e3-2f1380cd0e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:31.501449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83d7e2-f7a8-4ca2-b0e3-2f1380cd0e14 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:31.501733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83d7e2-f7a8-4ca2-b0e3-2f1380cd0e14 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:31.502050 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83d7e2-f7a8-4ca2-b0e3-2f1380cd0e14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:31.571676 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83d7e2-f7a8-4ca2-b0e3-2f1380cd0e14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:31.573045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83d7e2-f7a8-4ca2-b0e3-2f1380cd0e14 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:31.672637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 581/1159] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:40:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 19:40:31.679875 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6389a2-0936-4e28-9430-d2abfbd018c8 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:31.724035 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:31.780992 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6389a2-0936-4e28-9430-d2abfbd018c8 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:31.815506 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b488c7-44ea-4524-8b67-dbfdb3157d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:31.816361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b488c7-44ea-4524-8b67-dbfdb3157d6b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:31.816642 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b488c7-44ea-4524-8b67-dbfdb3157d6b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:31.816917 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b488c7-44ea-4524-8b67-dbfdb3157d6b None admin] PATH_INFO: `/v3/projects/72ee6f4822bd43f6a138928bce54a665` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:31.818112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b488c7-44ea-4524-8b67-dbfdb3157d6b None admin] RBAC: Authorizing `identity:get_project(project_id=72ee6f4822bd43f6a138928bce54a665)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:31.820330 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b488c7-44ea-4524-8b67-dbfdb3157d6b None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:31.822390 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 579/1160] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:40:31 2022] GET /identity/v3/projects/72ee6f4822bd43f6a138928bce54a665 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:31.828406 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83d7e2-f7a8-4ca2-b0e3-2f1380cd0e14 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:31.849036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:31.931417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83d7e2-f7a8-4ca2-b0e3-2f1380cd0e14 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:31.964260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b99d3c-8db5-46f4-9ced-24fe02bdbbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:31.964910 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b99d3c-8db5-46f4-9ced-24fe02bdbbd5 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:31.965218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b99d3c-8db5-46f4-9ced-24fe02bdbbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:31.965500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b99d3c-8db5-46f4-9ced-24fe02bdbbd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:31.966313 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b99d3c-8db5-46f4-9ced-24fe02bdbbd5 None admin] RBAC: Adding query filter params (role.id=76bd0cf7bf094e4fa3db121b96215004, scope.project.id=72ee6f4822bd43f6a138928bce54a665, user.id=9c61e27a04dc41bf8ea8b18aaaed8324) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:31.966624 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b99d3c-8db5-46f4-9ced-24fe02bdbbd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:31.968041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b99d3c-8db5-46f4-9ced-24fe02bdbbd5 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:31.973723 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 582/1161] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:40:31 2022] GET /identity/v3/role_assignments?user.id=9c61e27a04dc41bf8ea8b18aaaed8324&scope.project.id=72ee6f4822bd43f6a138928bce54a665&role.id=76bd0cf7bf094e4fa3db121b96215004 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:34.015439 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79511a-bc10-4039-bc96-86ac67df94d9 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:34.015978 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79511a-bc10-4039-bc96-86ac67df94d9 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:34.015978 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79511a-bc10-4039-bc96-86ac67df94d9 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:34.017382 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 580/1162] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:40:34.022406 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057eae9f-b1ff-4ef4-9af8-4ee6f45f0b24 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:34.022783 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057eae9f-b1ff-4ef4-9af8-4ee6f45f0b24 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:34.022950 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057eae9f-b1ff-4ef4-9af8-4ee6f45f0b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:34.039315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-057eae9f-b1ff-4ef4-9af8-4ee6f45f0b24 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:40:34.040478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-057eae9f-b1ff-4ef4-9af8-4ee6f45f0b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:40:34.103689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 583/1163] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:40:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:40:34.126432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79511a-bc10-4039-bc96-86ac67df94d9 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:34.226044 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79511a-bc10-4039-bc96-86ac67df94d9 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:34.234854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:34.259747 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2c7f8-868c-408d-9b53-c5db1c4dc420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:34.260388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2c7f8-868c-408d-9b53-c5db1c4dc420 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:34.260679 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2c7f8-868c-408d-9b53-c5db1c4dc420 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:34.260962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2c7f8-868c-408d-9b53-c5db1c4dc420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:34.327221 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2c7f8-868c-408d-9b53-c5db1c4dc420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:34.328666 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2c7f8-868c-408d-9b53-c5db1c4dc420 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:34.422817 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 581/1164] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:40:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 19:40:34.429351 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057eae9f-b1ff-4ef4-9af8-4ee6f45f0b24 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:34.442956 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:34.525787 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057eae9f-b1ff-4ef4-9af8-4ee6f45f0b24 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:34.557890 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06c66f-8667-4ff3-8944-9b255845cb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:34.558678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06c66f-8667-4ff3-8944-9b255845cb4f None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:34.558964 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06c66f-8667-4ff3-8944-9b255845cb4f None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:34.559242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06c66f-8667-4ff3-8944-9b255845cb4f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:34.565702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06c66f-8667-4ff3-8944-9b255845cb4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:34.567152 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06c66f-8667-4ff3-8944-9b255845cb4f None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:34.581824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-da06c66f-8667-4ff3-8944-9b255845cb4f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 19:40:34.581824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:40:34.581824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 23 19:40:34.581824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 23 19:40:34.581824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:40:34.581824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:40:34.581824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:40:34.581824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:40:34.581824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 23 19:40:34.581824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:40:34.581824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:40:34.581824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:40:34.581824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:40:34.581824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:40:34.581824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:40:34.581824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:40:34.581824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:40:34.583045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:40:34.583045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:40:34.583045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:40:34.583045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:40:34.583045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:40:34.583045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:40:34.583045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:40:34.583045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:40:34.583045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:40:34.583045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:40:34.583045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:40:34.583045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:40:34.583045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:40:34.583045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:40:34.583045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:40:34.583045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:40:34.584679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:40:34.584679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:40:34.584679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:40:34.584679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:40:34.584679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:40:34.584679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:40:34.584679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:40:34.584679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:40:34.584679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:40:34.584679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:40:34.584679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 23 19:40:34.584679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:40:34.584679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 19:40:34.584679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:40:34.584679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 584/1165] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 23 19:40:34 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:40:34.589471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2c7f8-868c-408d-9b53-c5db1c4dc420 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:34.599310 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:34.684971 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2c7f8-868c-408d-9b53-c5db1c4dc420 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:34.718596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934fc02-7004-4d2a-ad9d-5f79c42500d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:34.719246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934fc02-7004-4d2a-ad9d-5f79c42500d2 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:34.719535 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934fc02-7004-4d2a-ad9d-5f79c42500d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:34.719820 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934fc02-7004-4d2a-ad9d-5f79c42500d2 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:34.720542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934fc02-7004-4d2a-ad9d-5f79c42500d2 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:34.720855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934fc02-7004-4d2a-ad9d-5f79c42500d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:34.722255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934fc02-7004-4d2a-ad9d-5f79c42500d2 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:34.729188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 582/1166] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 23 19:40:34 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:36.752742 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab1abe-efb2-4e7f-af64-c2948404e979 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:36.753320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab1abe-efb2-4e7f-af64-c2948404e979 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:36.753320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab1abe-efb2-4e7f-af64-c2948404e979 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:36.754704 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 585/1167] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:40:36.760480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56317922-ba20-4ed3-b0d2-ba8a7466435c None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:36.760925 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56317922-ba20-4ed3-b0d2-ba8a7466435c None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:36.761050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56317922-ba20-4ed3-b0d2-ba8a7466435c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:36.778007 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-56317922-ba20-4ed3-b0d2-ba8a7466435c None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:40:36.779194 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-56317922-ba20-4ed3-b0d2-ba8a7466435c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:40:36.842974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 583/1168] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:40:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:40:36.866743 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab1abe-efb2-4e7f-af64-c2948404e979 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:36.937179 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:36.967706 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab1abe-efb2-4e7f-af64-c2948404e979 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:37.000210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fd733-2519-4e12-813c-d4a432112a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:37.000868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fd733-2519-4e12-813c-d4a432112a50 None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:37.001178 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fd733-2519-4e12-813c-d4a432112a50 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:37.001463 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fd733-2519-4e12-813c-d4a432112a50 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:37.002200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fd733-2519-4e12-813c-d4a432112a50 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:37.003607 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fd733-2519-4e12-813c-d4a432112a50 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:37.073816 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 586/1169] 10.222.0.13 () {60 vars in 1138 bytes} [Thu Jun 23 19:40:36 2022] POST /identity/v3/domains => generated 267 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:40:39.103850 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa2e16-388d-4dc2-92a3-daa3d0708fdb None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:39.104369 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa2e16-388d-4dc2-92a3-daa3d0708fdb None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:39.104460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa2e16-388d-4dc2-92a3-daa3d0708fdb None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:39.105798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 584/1170] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:40:39.110990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771f5c9-1730-4aa9-87b3-68fcada39af2 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:39.111373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771f5c9-1730-4aa9-87b3-68fcada39af2 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:39.111555 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771f5c9-1730-4aa9-87b3-68fcada39af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:39.128423 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-e771f5c9-1730-4aa9-87b3-68fcada39af2 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:40:39.129632 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e771f5c9-1730-4aa9-87b3-68fcada39af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:40:39.200771 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 587/1171] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:40:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:40:39.224330 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa2e16-388d-4dc2-92a3-daa3d0708fdb None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:39.227221 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:39.325968 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa2e16-388d-4dc2-92a3-daa3d0708fdb None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:39.358139 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c343a-8650-4a36-9a7a-175f4c9f9237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:39.358984 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c343a-8650-4a36-9a7a-175f4c9f9237 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:39.359271 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c343a-8650-4a36-9a7a-175f4c9f9237 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:39.359552 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c343a-8650-4a36-9a7a-175f4c9f9237 None admin] PATH_INFO: `/v3/domains/4c65d52dc23a40eaade0705d8a09d8e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:39.370340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c343a-8650-4a36-9a7a-175f4c9f9237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4c65d52dc23a40eaade0705d8a09d8e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:39.371786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c343a-8650-4a36-9a7a-175f4c9f9237 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:39.373418 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 585/1172] 10.222.0.13 () {56 vars in 1183 bytes} [Thu Jun 23 19:40:39 2022] GET /identity/v3/domains/4c65d52dc23a40eaade0705d8a09d8e8 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:39.379169 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771f5c9-1730-4aa9-87b3-68fcada39af2 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:39.438108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:39.475785 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771f5c9-1730-4aa9-87b3-68fcada39af2 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:39.509677 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334ec72-ec0a-46c1-8109-2eddb7848ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:39.510330 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334ec72-ec0a-46c1-8109-2eddb7848ddd None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:39.510615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334ec72-ec0a-46c1-8109-2eddb7848ddd None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:39.510896 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334ec72-ec0a-46c1-8109-2eddb7848ddd None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:39.511609 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334ec72-ec0a-46c1-8109-2eddb7848ddd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:39.513015 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334ec72-ec0a-46c1-8109-2eddb7848ddd None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:39.600258 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 588/1173] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 19:40:39 2022] POST /identity/v3/projects => generated 361 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:40:41.657817 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc33df-743b-4cb2-a570-e78ae8c7fce8 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:41.658346 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc33df-743b-4cb2-a570-e78ae8c7fce8 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:41.658458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc33df-743b-4cb2-a570-e78ae8c7fce8 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:41.659739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 586/1174] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:40:41.664902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16758e1-8185-4c91-b73f-1ff65ab13cd1 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:41.665359 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16758e1-8185-4c91-b73f-1ff65ab13cd1 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:41.665507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16758e1-8185-4c91-b73f-1ff65ab13cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:41.682413 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-d16758e1-8185-4c91-b73f-1ff65ab13cd1 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:40:41.683594 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d16758e1-8185-4c91-b73f-1ff65ab13cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:40:41.748962 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 589/1175] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:40:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:40:41.774682 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc33df-743b-4cb2-a570-e78ae8c7fce8 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:41.836706 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:41.875653 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc33df-743b-4cb2-a570-e78ae8c7fce8 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:41.909788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8340a2-e335-4ddb-bb7d-5062932223c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:41.910591 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8340a2-e335-4ddb-bb7d-5062932223c4 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:41.910874 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8340a2-e335-4ddb-bb7d-5062932223c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:41.911150 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8340a2-e335-4ddb-bb7d-5062932223c4 None admin] PATH_INFO: `/v3/domains/4c65d52dc23a40eaade0705d8a09d8e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:41.912823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8340a2-e335-4ddb-bb7d-5062932223c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4c65d52dc23a40eaade0705d8a09d8e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:41.914291 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8340a2-e335-4ddb-bb7d-5062932223c4 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:41.915991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 587/1176] 10.222.0.13 () {56 vars in 1183 bytes} [Thu Jun 23 19:40:41 2022] GET /identity/v3/domains/4c65d52dc23a40eaade0705d8a09d8e8 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:41.921733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16758e1-8185-4c91-b73f-1ff65ab13cd1 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:41.966373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:42.017343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16758e1-8185-4c91-b73f-1ff65ab13cd1 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:42.050620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb016452-d702-4cbc-a5be-1ecaa83a8aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:42.051278 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb016452-d702-4cbc-a5be-1ecaa83a8aee None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:42.051568 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb016452-d702-4cbc-a5be-1ecaa83a8aee None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:42.051852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb016452-d702-4cbc-a5be-1ecaa83a8aee None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:42.052615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb016452-d702-4cbc-a5be-1ecaa83a8aee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:42.054244 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb016452-d702-4cbc-a5be-1ecaa83a8aee None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:42.131969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 590/1177] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 19:40:41 2022] POST /identity/v3/users => generated 311 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:40:44.191976 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5ecd3-dc7f-48e7-acc0-97f4b28e8eee None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:44.192490 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5ecd3-dc7f-48e7-acc0-97f4b28e8eee None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:44.192490 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5ecd3-dc7f-48e7-acc0-97f4b28e8eee None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:44.194415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 588/1178] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:40:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:40:44.199893 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39cdf6-1b33-43d3-bcf6-6753dce8fbfa None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:44.200323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39cdf6-1b33-43d3-bcf6-6753dce8fbfa None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:44.200459 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39cdf6-1b33-43d3-bcf6-6753dce8fbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:44.218075 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-4b39cdf6-1b33-43d3-bcf6-6753dce8fbfa None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:40:44.219254 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-4b39cdf6-1b33-43d3-bcf6-6753dce8fbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:40:44.282711 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 591/1179] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:40:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:40:44.306569 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5ecd3-dc7f-48e7-acc0-97f4b28e8eee None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:44.405875 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5ecd3-dc7f-48e7-acc0-97f4b28e8eee None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:44.432508 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:44.437987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fced9cd-54a8-4247-b8c3-bf63a8a89ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:44.438760 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fced9cd-54a8-4247-b8c3-bf63a8a89ad6 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:44.448621 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fced9cd-54a8-4247-b8c3-bf63a8a89ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:44.448621 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fced9cd-54a8-4247-b8c3-bf63a8a89ad6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:44.450431 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fced9cd-54a8-4247-b8c3-bf63a8a89ad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:40:44.457975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-4fced9cd-54a8-4247-b8c3-bf63a8a89ad6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:40:44.457975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:40:44.457975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:40:44.457975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:40:44.457975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:40:44.457975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:40:44.457975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:40:44.457975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:40:44.457975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:40:44.457975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:40:44.457975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:40:44.457975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:40:44.457975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:40:44.457975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:40:44.457975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:40:44.457975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:40:44.459590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:40:44.459590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:40:44.459590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:40:44.459590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:40:44.459590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:40:44.459590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:40:44.459590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:40:44.459590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:40:44.459590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:40:44.459590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:40:44.459590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:40:44.459590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:40:44.459590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:40:44.459590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:40:44.459590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:40:44.459590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:40:44.460498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:40:44.460498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:40:44.460498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:40:44.460498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:40:44.460498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:40:44.460498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:40:44.460498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:40:44.460498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:40:44.460498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:40:44.460498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:40:44.460498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:40:44.460498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:40:44.460498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 589/1180] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:40:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:40:44.465868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39cdf6-1b33-43d3-bcf6-6753dce8fbfa None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:44.495128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:44.561410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39cdf6-1b33-43d3-bcf6-6753dce8fbfa None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:44.594958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21263e4-52f8-40f0-b0a0-d06e9c647ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:44.595616 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21263e4-52f8-40f0-b0a0-d06e9c647ac9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:44.595903 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21263e4-52f8-40f0-b0a0-d06e9c647ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:44.596184 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21263e4-52f8-40f0-b0a0-d06e9c647ac9 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:44.596926 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21263e4-52f8-40f0-b0a0-d06e9c647ac9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:44.597261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21263e4-52f8-40f0-b0a0-d06e9c647ac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:44.598626 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21263e4-52f8-40f0-b0a0-d06e9c647ac9 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:44.606482 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 592/1181] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:40:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:44.612204 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fced9cd-54a8-4247-b8c3-bf63a8a89ad6 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:44.710052 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fced9cd-54a8-4247-b8c3-bf63a8a89ad6 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:44.743315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd6b9a-6702-489d-8a3c-c71772450ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:44.744166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd6b9a-6702-489d-8a3c-c71772450ec7 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:44.744454 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd6b9a-6702-489d-8a3c-c71772450ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:44.744735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd6b9a-6702-489d-8a3c-c71772450ec7 None admin] PATH_INFO: `/v3/users/71a74cf66e5e40d39a94b85796d12f7f` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:44.757571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd6b9a-6702-489d-8a3c-c71772450ec7 None admin] RBAC: Authorizing `identity:get_user(user_id=71a74cf66e5e40d39a94b85796d12f7f)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:44.759017 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd6b9a-6702-489d-8a3c-c71772450ec7 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:44.760637 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 590/1182] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:40:44 2022] GET /identity/v3/users/71a74cf66e5e40d39a94b85796d12f7f => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:44.766266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21263e4-52f8-40f0-b0a0-d06e9c647ac9 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:44.855656 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:44.863913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21263e4-52f8-40f0-b0a0-d06e9c647ac9 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:44.897203 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a168e0-d70b-45d7-8a59-688700d25cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:44.897845 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a168e0-d70b-45d7-8a59-688700d25cf7 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:44.898131 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a168e0-d70b-45d7-8a59-688700d25cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:44.898414 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a168e0-d70b-45d7-8a59-688700d25cf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:44.964208 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a168e0-d70b-45d7-8a59-688700d25cf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:44.965613 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a168e0-d70b-45d7-8a59-688700d25cf7 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:45.050033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:45.060026 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 593/1183] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:40:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 19:40:45.066094 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd6b9a-6702-489d-8a3c-c71772450ec7 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:45.114738 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:45.164757 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd6b9a-6702-489d-8a3c-c71772450ec7 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:45.200378 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3557851-bcc1-45f9-bdb8-2c63f0491c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:45.201258 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3557851-bcc1-45f9-bdb8-2c63f0491c0a None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:45.201544 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3557851-bcc1-45f9-bdb8-2c63f0491c0a None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:45.201822 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3557851-bcc1-45f9-bdb8-2c63f0491c0a None admin] PATH_INFO: `/v3/projects/b7ad9d19497a487ebdc741c9b08cc928` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:45.202981 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3557851-bcc1-45f9-bdb8-2c63f0491c0a None admin] RBAC: Authorizing `identity:get_project(project_id=b7ad9d19497a487ebdc741c9b08cc928)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:45.204417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3557851-bcc1-45f9-bdb8-2c63f0491c0a None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:45.206102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 591/1184] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:40:45 2022] GET /identity/v3/projects/b7ad9d19497a487ebdc741c9b08cc928 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:45.212620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a168e0-d70b-45d7-8a59-688700d25cf7 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:45.308437 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a168e0-d70b-45d7-8a59-688700d25cf7 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:45.341403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5ede8-d114-49e1-a530-cbc13ff6918a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:45.342041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ede8-d114-49e1-a530-cbc13ff6918a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:45.342328 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ede8-d114-49e1-a530-cbc13ff6918a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:45.342609 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ede8-d114-49e1-a530-cbc13ff6918a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:45.343422 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5ede8-d114-49e1-a530-cbc13ff6918a None admin] RBAC: Adding query filter params (role.id=76bd0cf7bf094e4fa3db121b96215004, scope.project.id=b7ad9d19497a487ebdc741c9b08cc928, user.id=71a74cf66e5e40d39a94b85796d12f7f) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:45.343734 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5ede8-d114-49e1-a530-cbc13ff6918a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:45.345179 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5ede8-d114-49e1-a530-cbc13ff6918a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:45.350659 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 594/1185] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:40:45 2022] GET /identity/v3/role_assignments?user.id=71a74cf66e5e40d39a94b85796d12f7f&scope.project.id=b7ad9d19497a487ebdc741c9b08cc928&role.id=76bd0cf7bf094e4fa3db121b96215004 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:47.347339 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef29c1a-367f-4a48-a458-c4f1b9a7c665 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:47.347883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef29c1a-367f-4a48-a458-c4f1b9a7c665 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:47.347883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef29c1a-367f-4a48-a458-c4f1b9a7c665 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:47.349198 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 592/1186] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:40:47.354945 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748111f-d32e-4a1b-ba44-3bab162108a5 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:47.355399 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748111f-d32e-4a1b-ba44-3bab162108a5 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:47.355501 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748111f-d32e-4a1b-ba44-3bab162108a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:47.372314 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-a748111f-d32e-4a1b-ba44-3bab162108a5 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:40:47.373527 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-a748111f-d32e-4a1b-ba44-3bab162108a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:40:47.422930 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:47.438633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 595/1187] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:40:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:40:47.463260 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef29c1a-367f-4a48-a458-c4f1b9a7c665 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:47.562948 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef29c1a-367f-4a48-a458-c4f1b9a7c665 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:47.579404 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:47.596328 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72c2b3-c593-4898-abb4-377c4cf264e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:47.597096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72c2b3-c593-4898-abb4-377c4cf264e5 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:47.597454 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72c2b3-c593-4898-abb4-377c4cf264e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:47.597687 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72c2b3-c593-4898-abb4-377c4cf264e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:47.607677 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72c2b3-c593-4898-abb4-377c4cf264e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:40:47.616252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-3a72c2b3-c593-4898-abb4-377c4cf264e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:40:47.616252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:40:47.616252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:40:47.616252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:40:47.616252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:40:47.616252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:40:47.616252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:40:47.616252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:40:47.616252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:40:47.616252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:40:47.616252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:40:47.616252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:40:47.616252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:40:47.616252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:40:47.616252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:40:47.616252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:40:47.617461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:40:47.617461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:40:47.617461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:40:47.617461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:40:47.617461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:40:47.617461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:40:47.617461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:40:47.617461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:40:47.617461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:40:47.617461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:40:47.617461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:40:47.617461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:40:47.617461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:40:47.617461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:40:47.617461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:40:47.617461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:40:47.618392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:40:47.618392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:40:47.618392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:40:47.618392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:40:47.618392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:40:47.618392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:40:47.618392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:40:47.618392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:40:47.618392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:40:47.618392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:40:47.618392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:40:47.618392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:40:47.618392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 593/1188] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:40:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:40:47.623516 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748111f-d32e-4a1b-ba44-3bab162108a5 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:47.720341 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748111f-d32e-4a1b-ba44-3bab162108a5 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:47.753196 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee0d32-bec1-4cfa-882d-9737f3f7fc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:47.753854 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee0d32-bec1-4cfa-882d-9737f3f7fc58 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:47.754142 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee0d32-bec1-4cfa-882d-9737f3f7fc58 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:47.754424 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee0d32-bec1-4cfa-882d-9737f3f7fc58 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:47.755168 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee0d32-bec1-4cfa-882d-9737f3f7fc58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:47.755477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee0d32-bec1-4cfa-882d-9737f3f7fc58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:47.757597 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee0d32-bec1-4cfa-882d-9737f3f7fc58 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:47.765486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 596/1189] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:40:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:47.771169 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72c2b3-c593-4898-abb4-377c4cf264e5 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:47.868182 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72c2b3-c593-4898-abb4-377c4cf264e5 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:47.900675 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da101f-a636-41d7-8fb3-2999e15bbd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:47.901643 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da101f-a636-41d7-8fb3-2999e15bbd8d None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:47.901929 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da101f-a636-41d7-8fb3-2999e15bbd8d None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:47.902205 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da101f-a636-41d7-8fb3-2999e15bbd8d None admin] PATH_INFO: `/v3/users/71a74cf66e5e40d39a94b85796d12f7f` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:47.903372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da101f-a636-41d7-8fb3-2999e15bbd8d None admin] RBAC: Authorizing `identity:get_user(user_id=71a74cf66e5e40d39a94b85796d12f7f)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:47.904793 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da101f-a636-41d7-8fb3-2999e15bbd8d None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:47.906427 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 594/1190] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:40:47 2022] GET /identity/v3/users/71a74cf66e5e40d39a94b85796d12f7f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:47.912579 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee0d32-bec1-4cfa-882d-9737f3f7fc58 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:47.960712 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:48.009855 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee0d32-bec1-4cfa-882d-9737f3f7fc58 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:48.041836 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a9587-be41-4112-b39c-f6afb537bad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:48.042681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a9587-be41-4112-b39c-f6afb537bad9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:48.042963 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a9587-be41-4112-b39c-f6afb537bad9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:48.043239 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a9587-be41-4112-b39c-f6afb537bad9 None admin] PATH_INFO: `/v3/projects/b7ad9d19497a487ebdc741c9b08cc928` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:48.044404 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a9587-be41-4112-b39c-f6afb537bad9 None admin] RBAC: Authorizing `identity:get_project(project_id=b7ad9d19497a487ebdc741c9b08cc928)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:48.045865 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a9587-be41-4112-b39c-f6afb537bad9 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:48.047527 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 597/1191] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:40:47 2022] GET /identity/v3/projects/b7ad9d19497a487ebdc741c9b08cc928 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:48.054125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da101f-a636-41d7-8fb3-2999e15bbd8d None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:48.097964 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:48.150157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da101f-a636-41d7-8fb3-2999e15bbd8d None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:48.182357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e88ec3-d65c-43ec-aaf8-d9c10450c9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:48.183230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e88ec3-d65c-43ec-aaf8-d9c10450c9d0 None admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:48.183518 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e88ec3-d65c-43ec-aaf8-d9c10450c9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:48.183798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e88ec3-d65c-43ec-aaf8-d9c10450c9d0 None admin] PATH_INFO: `/v3/projects/b7ad9d19497a487ebdc741c9b08cc928/users/71a74cf66e5e40d39a94b85796d12f7f/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:48.185766 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e88ec3-d65c-43ec-aaf8-d9c10450c9d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7ad9d19497a487ebdc741c9b08cc928, user_id=71a74cf66e5e40d39a94b85796d12f7f, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:48.187191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e88ec3-d65c-43ec-aaf8-d9c10450c9d0 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:48.271493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 595/1192] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:40:48 2022] PUT /identity/v3/projects/b7ad9d19497a487ebdc741c9b08cc928/users/71a74cf66e5e40d39a94b85796d12f7f/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:40:50.294922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed995b63-2654-4ea9-9d7c-d5bcfbb03eca None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:50.295440 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed995b63-2654-4ea9-9d7c-d5bcfbb03eca None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:50.295440 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed995b63-2654-4ea9-9d7c-d5bcfbb03eca None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:50.296765 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 598/1193] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:40:50.301800 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521e00c-38d6-4b31-a53c-def3251ea4f1 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:50.302174 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521e00c-38d6-4b31-a53c-def3251ea4f1 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:50.302358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521e00c-38d6-4b31-a53c-def3251ea4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:50.319906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-0521e00c-38d6-4b31-a53c-def3251ea4f1 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:40:50.321379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0521e00c-38d6-4b31-a53c-def3251ea4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:40:50.386533 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 596/1194] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:40:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:40:50.409921 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed995b63-2654-4ea9-9d7c-d5bcfbb03eca None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:50.508570 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed995b63-2654-4ea9-9d7c-d5bcfbb03eca None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:50.524242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:50.541788 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46836e22-a636-41f9-a2bc-80b1c712c691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:50.542572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46836e22-a636-41f9-a2bc-80b1c712c691 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:50.542859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46836e22-a636-41f9-a2bc-80b1c712c691 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:50.543138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46836e22-a636-41f9-a2bc-80b1c712c691 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:50.553455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46836e22-a636-41f9-a2bc-80b1c712c691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:40:50.561198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-46836e22-a636-41f9-a2bc-80b1c712c691 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:40:50.561198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:40:50.561198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:40:50.561198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:40:50.561198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:40:50.561198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:40:50.561198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:40:50.561198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:40:50.561198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:40:50.561198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:40:50.561198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:40:50.561198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:40:50.561198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:40:50.561198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:40:50.561198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:40:50.561198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:40:50.562295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:40:50.562295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:40:50.562295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:40:50.562295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:40:50.562295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:40:50.562295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:40:50.562295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:40:50.562295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:40:50.562295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:40:50.562295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:40:50.562295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:40:50.562295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:40:50.562295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:40:50.562295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:40:50.562295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:40:50.562295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:40:50.563241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:40:50.563241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:40:50.563241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:40:50.563241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:40:50.563241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:40:50.563241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:40:50.563241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:40:50.563241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:40:50.563241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:40:50.563241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:40:50.563241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:40:50.563241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:40:50.563241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 599/1195] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:40:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:40:50.568438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521e00c-38d6-4b31-a53c-def3251ea4f1 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:50.601937 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:50.667168 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521e00c-38d6-4b31-a53c-def3251ea4f1 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:50.700285 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57651770-c852-4bac-9456-36dcd5ed9bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:50.700935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57651770-c852-4bac-9456-36dcd5ed9bc2 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:50.701243 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57651770-c852-4bac-9456-36dcd5ed9bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:50.701520 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57651770-c852-4bac-9456-36dcd5ed9bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:50.702263 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57651770-c852-4bac-9456-36dcd5ed9bc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:50.702568 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57651770-c852-4bac-9456-36dcd5ed9bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:50.703927 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57651770-c852-4bac-9456-36dcd5ed9bc2 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:50.712283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 597/1196] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:40:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:50.717936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46836e22-a636-41f9-a2bc-80b1c712c691 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:50.814415 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46836e22-a636-41f9-a2bc-80b1c712c691 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:50.848132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a79672-0e78-46c3-9616-d94a671d4c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:50.848984 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a79672-0e78-46c3-9616-d94a671d4c31 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:50.849315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a79672-0e78-46c3-9616-d94a671d4c31 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:50.850147 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a79672-0e78-46c3-9616-d94a671d4c31 None admin] PATH_INFO: `/v3/users/71a74cf66e5e40d39a94b85796d12f7f` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:50.851501 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a79672-0e78-46c3-9616-d94a671d4c31 None admin] RBAC: Authorizing `identity:get_user(user_id=71a74cf66e5e40d39a94b85796d12f7f)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:50.853062 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a79672-0e78-46c3-9616-d94a671d4c31 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:50.854723 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 600/1197] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 19:40:50 2022] GET /identity/v3/users/71a74cf66e5e40d39a94b85796d12f7f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:50.860309 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57651770-c852-4bac-9456-36dcd5ed9bc2 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:50.954212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:50.960209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57651770-c852-4bac-9456-36dcd5ed9bc2 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:50.992945 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90d343-efbb-4a07-ada7-8c28aa50af21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:50.993610 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90d343-efbb-4a07-ada7-8c28aa50af21 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:50.993894 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90d343-efbb-4a07-ada7-8c28aa50af21 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:50.994169 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90d343-efbb-4a07-ada7-8c28aa50af21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:51.060158 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90d343-efbb-4a07-ada7-8c28aa50af21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:51.061616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90d343-efbb-4a07-ada7-8c28aa50af21 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:51.151987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:51.158161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 598/1198] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:40:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 19:40:51.164633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a79672-0e78-46c3-9616-d94a671d4c31 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:51.210220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:40:51.263080 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a79672-0e78-46c3-9616-d94a671d4c31 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:51.295137 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be122a9-0793-4018-a3a2-8d323feddd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:51.295990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be122a9-0793-4018-a3a2-8d323feddd83 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:51.296273 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be122a9-0793-4018-a3a2-8d323feddd83 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:51.296550 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be122a9-0793-4018-a3a2-8d323feddd83 None admin] PATH_INFO: `/v3/projects/b7ad9d19497a487ebdc741c9b08cc928` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:51.297769 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be122a9-0793-4018-a3a2-8d323feddd83 None admin] RBAC: Authorizing `identity:get_project(project_id=b7ad9d19497a487ebdc741c9b08cc928)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:51.299196 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be122a9-0793-4018-a3a2-8d323feddd83 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:51.300866 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 601/1199] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 19:40:51 2022] GET /identity/v3/projects/b7ad9d19497a487ebdc741c9b08cc928 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:40:51.307445 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90d343-efbb-4a07-ada7-8c28aa50af21 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:40:51.403866 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90d343-efbb-4a07-ada7-8c28aa50af21 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:40:51.436555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d355bcc-885e-4df8-94e6-2a7448f3c732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:40:51.437221 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d355bcc-885e-4df8-94e6-2a7448f3c732 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:40:51.437508 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d355bcc-885e-4df8-94e6-2a7448f3c732 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:40:51.437784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d355bcc-885e-4df8-94e6-2a7448f3c732 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:40:51.438609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d355bcc-885e-4df8-94e6-2a7448f3c732 None admin] RBAC: Adding query filter params (role.id=76bd0cf7bf094e4fa3db121b96215004, scope.project.id=b7ad9d19497a487ebdc741c9b08cc928, user.id=71a74cf66e5e40d39a94b85796d12f7f) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:40:51.438921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d355bcc-885e-4df8-94e6-2a7448f3c732 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:40:51.440346 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d355bcc-885e-4df8-94e6-2a7448f3c732 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:40:51.447051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 599/1200] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:40:51 2022] GET /identity/v3/role_assignments?user.id=71a74cf66e5e40d39a94b85796d12f7f&scope.project.id=b7ad9d19497a487ebdc741c9b08cc928&role.id=76bd0cf7bf094e4fa3db121b96215004 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:41:01.291144 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=44 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:41:01.444369 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=70 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:04.547100 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8e0c6-6daf-4260-bbe0-667b16d37305 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:04.547711 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8e0c6-6daf-4260-bbe0-667b16d37305 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:04.547711 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8e0c6-6daf-4260-bbe0-667b16d37305 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:04.549042 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 602/1201] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:42:04.554378 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6e1e6-d105-4de7-969c-0ae196812b64 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:04.554880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6e1e6-d105-4de7-969c-0ae196812b64 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:04.555003 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6e1e6-d105-4de7-969c-0ae196812b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:04.572466 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-9ce6e1e6-d105-4de7-969c-0ae196812b64 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:42:04.573925 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-9ce6e1e6-d105-4de7-969c-0ae196812b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:42:04.639669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 600/1202] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:42:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:42:04.664592 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8e0c6-6daf-4260-bbe0-667b16d37305 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:04.767102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8e0c6-6daf-4260-bbe0-667b16d37305 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:04.800383 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48334c0-7737-431e-9e21-96de7622f35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:04.801104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48334c0-7737-431e-9e21-96de7622f35f None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:04.801417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48334c0-7737-431e-9e21-96de7622f35f None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:04.802344 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48334c0-7737-431e-9e21-96de7622f35f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:04.812376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48334c0-7737-431e-9e21-96de7622f35f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:04.816052 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48334c0-7737-431e-9e21-96de7622f35f None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:04.831683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-e48334c0-7737-431e-9e21-96de7622f35f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:04.831683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:04.831683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:04.831683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:04.831683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:04.831683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:04.831683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:04.831683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:04.831683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:04.831683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:04.831683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:04.831683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:04.831683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:42:04.831683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:42:04.831683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:42:04.832814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:42:04.832814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:04.832814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:04.832814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:04.832814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:04.832814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:04.832814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:04.832814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:04.832814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:04.832814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:04.832814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:04.832814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:04.832814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:04.832814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:04.832814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:04.832814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:04.832814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:04.834049 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:42:04.834049 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:42:04.834049 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:04.834049 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:42:04.834049 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 603/1203] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:04.838827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6e1e6-d105-4de7-969c-0ae196812b64 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:04.935876 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6e1e6-d105-4de7-969c-0ae196812b64 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:04.964590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:04.970362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8159a-5f57-4f9d-bb00-04d058ffe9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:04.971035 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8159a-5f57-4f9d-bb00-04d058ffe9ed None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:04.971321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8159a-5f57-4f9d-bb00-04d058ffe9ed None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:04.971605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8159a-5f57-4f9d-bb00-04d058ffe9ed None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:04.972338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8159a-5f57-4f9d-bb00-04d058ffe9ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:04.972652 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8159a-5f57-4f9d-bb00-04d058ffe9ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:04.974096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8159a-5f57-4f9d-bb00-04d058ffe9ed None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:04.985094 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 601/1204] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:04.991627 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48334c0-7737-431e-9e21-96de7622f35f None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:05.044519 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:05.091411 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48334c0-7737-431e-9e21-96de7622f35f None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:05.125894 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dcba6-5303-4f48-bfeb-c1765ef2ef58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:05.126555 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dcba6-5303-4f48-bfeb-c1765ef2ef58 None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:05.126840 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dcba6-5303-4f48-bfeb-c1765ef2ef58 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:05.127120 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dcba6-5303-4f48-bfeb-c1765ef2ef58 None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:05.127827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dcba6-5303-4f48-bfeb-c1765ef2ef58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:05.129278 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dcba6-5303-4f48-bfeb-c1765ef2ef58 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:05.277077 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 604/1205] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 19:42:04 2022] POST /identity/v3/users => generated 251 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:42:07.339205 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7c021-098e-4a67-8acb-fb2c168fdf63 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:07.339731 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7c021-098e-4a67-8acb-fb2c168fdf63 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:07.339731 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7c021-098e-4a67-8acb-fb2c168fdf63 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:07.341220 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 602/1206] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:42:07.346367 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a9477-98bb-4a78-999f-6f94b264a5f7 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:07.346750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a9477-98bb-4a78-999f-6f94b264a5f7 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:07.346933 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a9477-98bb-4a78-999f-6f94b264a5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:07.363960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-436a9477-98bb-4a78-999f-6f94b264a5f7 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:42:07.365435 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-436a9477-98bb-4a78-999f-6f94b264a5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:42:07.432499 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 605/1207] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:42:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:42:07.457110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7c021-098e-4a67-8acb-fb2c168fdf63 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:07.556591 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7c021-098e-4a67-8acb-fb2c168fdf63 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:07.589799 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3513d-2201-4db7-8027-af2c9c04657d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:07.590506 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3513d-2201-4db7-8027-af2c9c04657d None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:07.590788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3513d-2201-4db7-8027-af2c9c04657d None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:07.591063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3513d-2201-4db7-8027-af2c9c04657d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:07.601356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3513d-2201-4db7-8027-af2c9c04657d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:42:07.608857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-24a3513d-2201-4db7-8027-af2c9c04657d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:42:07.608857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:07.608857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:07.608857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:07.608857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:07.608857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:07.608857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:07.608857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:07.608857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:07.608857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:07.608857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:07.608857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:07.608857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:42:07.608857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:42:07.608857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:42:07.608857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:42:07.609902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:42:07.609902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:42:07.609902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:42:07.609902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:42:07.609902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:07.609902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:07.609902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:07.609902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:07.609902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:07.609902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:07.609902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:07.609902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:07.609902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:07.609902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:07.609902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:07.609902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:07.610772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:07.610772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:07.610772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:07.610772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:07.610772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:42:07.610772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:42:07.610772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:42:07.610772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:42:07.610772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:42:07.610772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:42:07.610772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:42:07.610772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:07.610772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 603/1208] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:42:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:07.616101 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a9477-98bb-4a78-999f-6f94b264a5f7 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:07.655677 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:07.714525 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a9477-98bb-4a78-999f-6f94b264a5f7 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:07.747175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb619f-948e-42a9-a975-98f29bd7d5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:07.747837 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb619f-948e-42a9-a975-98f29bd7d5b9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:07.748122 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb619f-948e-42a9-a975-98f29bd7d5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:07.748399 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb619f-948e-42a9-a975-98f29bd7d5b9 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:07.749184 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb619f-948e-42a9-a975-98f29bd7d5b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:07.749491 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb619f-948e-42a9-a975-98f29bd7d5b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:07.750851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb619f-948e-42a9-a975-98f29bd7d5b9 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:07.759354 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 606/1209] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:42:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:42:07.765119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3513d-2201-4db7-8027-af2c9c04657d None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:07.816281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:07.865131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3513d-2201-4db7-8027-af2c9c04657d None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:07.900479 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30020d94-756b-45fd-be59-312ebb218511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:07.901296 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020d94-756b-45fd-be59-312ebb218511 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:07.901583 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020d94-756b-45fd-be59-312ebb218511 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:07.901862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020d94-756b-45fd-be59-312ebb218511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:07.911711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30020d94-756b-45fd-be59-312ebb218511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:07.913169 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30020d94-756b-45fd-be59-312ebb218511 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:07.930668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-30020d94-756b-45fd-be59-312ebb218511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:07.930668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:07.930668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:07.930668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:07.930668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:07.930668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:07.930668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:07.930668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:07.930668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:07.930668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:07.930668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:07.930668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:07.930668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:42:07.930668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:42:07.930668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:42:07.931576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:42:07.931576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:07.931576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:07.931576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:07.931576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:07.931576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:07.931576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:07.931576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:07.931576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:07.931576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:07.931576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:07.931576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:07.931576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:07.931576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:07.931576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:07.931576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:07.931576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:07.932694 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:42:07.932694 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:42:07.932694 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:07.932694 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:07.932694 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 604/1210] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:07.937703 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb619f-948e-42a9-a975-98f29bd7d5b9 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:08.033761 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:08.036633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb619f-948e-42a9-a975-98f29bd7d5b9 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:08.069849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33049f0c-1fde-4ffd-9858-72f9957d3b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:08.070513 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33049f0c-1fde-4ffd-9858-72f9957d3b78 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:08.070798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33049f0c-1fde-4ffd-9858-72f9957d3b78 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:08.071080 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33049f0c-1fde-4ffd-9858-72f9957d3b78 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:08.071986 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33049f0c-1fde-4ffd-9858-72f9957d3b78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:08.072105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33049f0c-1fde-4ffd-9858-72f9957d3b78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:08.073750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33049f0c-1fde-4ffd-9858-72f9957d3b78 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:08.085674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 607/1211] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:08.091395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30020d94-756b-45fd-be59-312ebb218511 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:08.189762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30020d94-756b-45fd-be59-312ebb218511 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:08.191277 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:08.223918 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9721132-8108-4d8d-9d72-841939325b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:08.224756 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9721132-8108-4d8d-9d72-841939325b67 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:08.225045 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9721132-8108-4d8d-9d72-841939325b67 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:08.225359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9721132-8108-4d8d-9d72-841939325b67 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:08.232099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9721132-8108-4d8d-9d72-841939325b67 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:08.233578 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9721132-8108-4d8d-9d72-841939325b67 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:08.247953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-f9721132-8108-4d8d-9d72-841939325b67 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 19:42:08.247953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:08.247953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:08.247953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:08.247953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:08.247953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:08.247953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:08.247953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:08.247953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:08.247953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:08.247953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:08.247953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:08.247953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:42:08.247953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:42:08.247953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:42:08.247953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:42:08.256030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:08.256030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:08.256030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:42:08.256030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:42:08.256030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:42:08.256030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:42:08.256030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:08.256030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:08.256030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:08.256030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:08.256030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:08.256030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:08.256030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:08.256030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:08.256030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:08.256030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:08.256030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:08.256030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:08.257002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:08.257002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:08.257002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:42:08.257002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:42:08.257002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:42:08.257002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:42:08.257002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:42:08.257002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:42:08.257002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 19:42:08.257002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:08.257002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 605/1212] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:42:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:08.257695 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33049f0c-1fde-4ffd-9858-72f9957d3b78 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:08.353734 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33049f0c-1fde-4ffd-9858-72f9957d3b78 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:08.387014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35f0e6-da53-41ca-8cd8-8896670cbb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:08.387677 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35f0e6-da53-41ca-8cd8-8896670cbb4c None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:08.387970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35f0e6-da53-41ca-8cd8-8896670cbb4c None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:08.388251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35f0e6-da53-41ca-8cd8-8896670cbb4c None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:08.389075 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35f0e6-da53-41ca-8cd8-8896670cbb4c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:08.389414 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35f0e6-da53-41ca-8cd8-8896670cbb4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:08.390841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35f0e6-da53-41ca-8cd8-8896670cbb4c None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:08.408111 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 608/1213] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Jun 23 19:42:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:08.414017 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9721132-8108-4d8d-9d72-841939325b67 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:08.514293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9721132-8108-4d8d-9d72-841939325b67 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:08.547409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff5f17-df23-4eab-a6e5-56fa1fc449f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:08.548053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff5f17-df23-4eab-a6e5-56fa1fc449f1 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:08.548338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff5f17-df23-4eab-a6e5-56fa1fc449f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:08.548617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff5f17-df23-4eab-a6e5-56fa1fc449f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:08.579082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:08.616053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff5f17-df23-4eab-a6e5-56fa1fc449f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:08.617525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff5f17-df23-4eab-a6e5-56fa1fc449f1 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:08.715919 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 606/1214] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:42:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 19:42:08.721912 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35f0e6-da53-41ca-8cd8-8896670cbb4c None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:08.742262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:08.820927 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35f0e6-da53-41ca-8cd8-8896670cbb4c None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:08.855028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ca258-343f-417d-8e53-a7ddd740fe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:08.855814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ca258-343f-417d-8e53-a7ddd740fe23 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:08.856107 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ca258-343f-417d-8e53-a7ddd740fe23 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:08.856449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ca258-343f-417d-8e53-a7ddd740fe23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:08.867571 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ca258-343f-417d-8e53-a7ddd740fe23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:08.869043 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ca258-343f-417d-8e53-a7ddd740fe23 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:08.886846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-e65ca258-343f-417d-8e53-a7ddd740fe23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:08.886846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:08.886846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:08.886846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:08.886846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:08.886846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:08.886846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:08.886846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:08.886846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:08.886846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:08.886846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:08.886846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:08.886846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:42:08.886846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:42:08.886846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:42:08.888016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:42:08.888016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:08.888016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:08.888016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:08.888016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:08.888016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:08.888016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:08.888016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:08.888016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:08.888016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:08.888016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:08.888016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:08.888016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:08.888016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:08.888016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:08.888016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:08.888016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:08.888948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:42:08.888948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:42:08.888948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:08.888948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:42:08.888948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 609/1215] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:08.893903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff5f17-df23-4eab-a6e5-56fa1fc449f1 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:08.955491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:08.992453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff5f17-df23-4eab-a6e5-56fa1fc449f1 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:09.027475 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d3efc-0b83-44e7-aaf2-7f5ed262d758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:09.028327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d3efc-0b83-44e7-aaf2-7f5ed262d758 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:09.028801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d3efc-0b83-44e7-aaf2-7f5ed262d758 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:09.029572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d3efc-0b83-44e7-aaf2-7f5ed262d758 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:09.030291 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d3efc-0b83-44e7-aaf2-7f5ed262d758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:09.030597 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d3efc-0b83-44e7-aaf2-7f5ed262d758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:09.032000 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d3efc-0b83-44e7-aaf2-7f5ed262d758 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:09.043288 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 607/1216] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:09.049239 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ca258-343f-417d-8e53-a7ddd740fe23 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:09.118439 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:09.148215 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ca258-343f-417d-8e53-a7ddd740fe23 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:09.181539 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584f27b-290f-4680-bdee-f9b045fe5d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:09.182330 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584f27b-290f-4680-bdee-f9b045fe5d1d None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:09.182615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584f27b-290f-4680-bdee-f9b045fe5d1d None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:09.182892 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584f27b-290f-4680-bdee-f9b045fe5d1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:09.189604 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584f27b-290f-4680-bdee-f9b045fe5d1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:09.191040 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584f27b-290f-4680-bdee-f9b045fe5d1d None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:09.205403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-7584f27b-290f-4680-bdee-f9b045fe5d1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:42:09.205403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:09.205403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:09.205403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:09.205403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:09.205403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:09.205403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:09.205403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:09.205403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:09.205403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:09.205403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:09.205403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:09.205403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:42:09.205403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:42:09.205403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:42:09.206502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:42:09.206502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:09.206502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:09.206502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:09.206502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:09.206502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:09.206502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:09.206502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:09.206502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:09.206502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:09.206502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:09.206502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:09.206502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:09.206502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:09.206502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:09.206502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:09.206502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:09.207633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:42:09.207633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:42:09.207633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:42:09.207633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:42:09.207633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:42:09.207633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:42:09.207633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:42:09.207633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:42:09.207633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 610/1217] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:42:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:09.212955 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d3efc-0b83-44e7-aaf2-7f5ed262d758 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:09.310568 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d3efc-0b83-44e7-aaf2-7f5ed262d758 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:09.339441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:09.344158 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf694f-febd-4c1b-9d98-cc6e98c548e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:09.344809 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf694f-febd-4c1b-9d98-cc6e98c548e1 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:09.345092 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf694f-febd-4c1b-9d98-cc6e98c548e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:09.345396 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf694f-febd-4c1b-9d98-cc6e98c548e1 None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:09.346178 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf694f-febd-4c1b-9d98-cc6e98c548e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:09.346486 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf694f-febd-4c1b-9d98-cc6e98c548e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:09.347908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf694f-febd-4c1b-9d98-cc6e98c548e1 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:09.359965 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 608/1218] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:42:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:09.367045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584f27b-290f-4680-bdee-f9b045fe5d1d None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:09.466630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584f27b-290f-4680-bdee-f9b045fe5d1d None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:09.494352 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:09.500031 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816a7a7-f29d-44f4-a930-414fecc24171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:09.500683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816a7a7-f29d-44f4-a930-414fecc24171 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:09.500965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816a7a7-f29d-44f4-a930-414fecc24171 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:09.501296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816a7a7-f29d-44f4-a930-414fecc24171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:09.502144 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816a7a7-f29d-44f4-a930-414fecc24171 None admin] RBAC: Adding query filter params (role.id=e466769ed9af47889225dd8d77e896a5, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=7e9ba6d33e8640ec8dcda9971f59c5dc) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:09.502444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816a7a7-f29d-44f4-a930-414fecc24171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:09.503861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816a7a7-f29d-44f4-a930-414fecc24171 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:09.510205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 611/1219] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:42:09 2022] GET /identity/v3/role_assignments?user.id=7e9ba6d33e8640ec8dcda9971f59c5dc&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=e466769ed9af47889225dd8d77e896a5 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:11.504537 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484a615-0134-45c1-b731-6bd92f493028 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:11.505139 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484a615-0134-45c1-b731-6bd92f493028 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:11.505139 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484a615-0134-45c1-b731-6bd92f493028 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:11.506490 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 609/1220] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:42:11.512232 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbd155-2611-415a-976b-18dc092310b6 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:11.512657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbd155-2611-415a-976b-18dc092310b6 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:11.512794 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbd155-2611-415a-976b-18dc092310b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:11.529207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-e4fbd155-2611-415a-976b-18dc092310b6 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:42:11.530391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e4fbd155-2611-415a-976b-18dc092310b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:42:11.598018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 612/1221] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:42:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:42:11.621333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484a615-0134-45c1-b731-6bd92f493028 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:11.720347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484a615-0134-45c1-b731-6bd92f493028 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:11.754272 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcc701-1e39-4c09-af90-a09b9907b964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:11.755701 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcc701-1e39-4c09-af90-a09b9907b964 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:11.755919 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcc701-1e39-4c09-af90-a09b9907b964 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:11.756198 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcc701-1e39-4c09-af90-a09b9907b964 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:11.766215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcc701-1e39-4c09-af90-a09b9907b964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:42:11.773990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-6bfcc701-1e39-4c09-af90-a09b9907b964 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:42:11.773990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:11.773990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:11.773990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:11.773990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:11.773990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:11.773990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:11.773990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:11.773990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:11.773990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:11.773990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:11.773990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:11.773990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:42:11.773990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:42:11.773990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:42:11.773990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:42:11.775142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:42:11.775142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:42:11.775142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:42:11.775142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:42:11.775142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:11.775142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:11.775142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:11.775142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:11.775142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:11.775142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:11.775142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:11.775142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:11.775142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:11.775142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:11.775142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:11.775142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:11.776458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:11.776458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:11.776458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:11.776458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:11.776458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:42:11.776458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:42:11.776458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:42:11.776458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:42:11.776458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:42:11.776458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:42:11.776458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:42:11.776458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:11.776458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 610/1222] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:42:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:11.786717 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbd155-2611-415a-976b-18dc092310b6 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:11.881014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbd155-2611-415a-976b-18dc092310b6 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:11.904881 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:11.915842 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd511ab-4b23-4a50-8439-71cd9da5df11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:11.918591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd511ab-4b23-4a50-8439-71cd9da5df11 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:11.918591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd511ab-4b23-4a50-8439-71cd9da5df11 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:11.918591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd511ab-4b23-4a50-8439-71cd9da5df11 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:11.918591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd511ab-4b23-4a50-8439-71cd9da5df11 None admin] RBAC: Adding query filter params (name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:11.918591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd511ab-4b23-4a50-8439-71cd9da5df11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:11.919487 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd511ab-4b23-4a50-8439-71cd9da5df11 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:11.927350 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 613/1223] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:42:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:11.933055 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcc701-1e39-4c09-af90-a09b9907b964 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:11.978250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:12.045835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcc701-1e39-4c09-af90-a09b9907b964 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:12.081973 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736731a-b471-40cf-bc71-370b767374ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:12.082750 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736731a-b471-40cf-bc71-370b767374ab None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:12.083627 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736731a-b471-40cf-bc71-370b767374ab None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:12.083910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736731a-b471-40cf-bc71-370b767374ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:12.094171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736731a-b471-40cf-bc71-370b767374ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:12.096791 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736731a-b471-40cf-bc71-370b767374ab None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:12.112297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-2736731a-b471-40cf-bc71-370b767374ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:12.112297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:12.112297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:12.112297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:12.112297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:12.112297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:12.112297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:12.112297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:12.112297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:12.112297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:12.112297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:12.112297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:12.112297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:42:12.112297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:42:12.112297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:42:12.113414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:42:12.113414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:12.113414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:12.113414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:12.113414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:12.113414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:12.113414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:12.113414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:12.113414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:12.113414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:12.113414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:12.113414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:12.113414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:12.113414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:12.113414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:12.113414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:12.113414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:12.114678 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:42:12.114678 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:42:12.114678 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:12.114678 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:12.114678 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 611/1224] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:12.119862 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd511ab-4b23-4a50-8439-71cd9da5df11 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:12.218542 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd511ab-4b23-4a50-8439-71cd9da5df11 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:12.251455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe5ff0-8381-4b25-9370-e6c539e23293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:12.252109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe5ff0-8381-4b25-9370-e6c539e23293 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:12.252392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe5ff0-8381-4b25-9370-e6c539e23293 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:12.252664 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe5ff0-8381-4b25-9370-e6c539e23293 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:12.253396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe5ff0-8381-4b25-9370-e6c539e23293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:12.253700 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe5ff0-8381-4b25-9370-e6c539e23293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:12.256104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe5ff0-8381-4b25-9370-e6c539e23293 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:12.267656 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 614/1225] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:12.273585 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736731a-b471-40cf-bc71-370b767374ab None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:12.370085 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:12.378816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736731a-b471-40cf-bc71-370b767374ab None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:12.415063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad8bc4-924f-4a2c-9149-cbc5af109316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:12.415861 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad8bc4-924f-4a2c-9149-cbc5af109316 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:12.416148 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad8bc4-924f-4a2c-9149-cbc5af109316 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:12.416427 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad8bc4-924f-4a2c-9149-cbc5af109316 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:12.423623 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad8bc4-924f-4a2c-9149-cbc5af109316 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:12.425063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad8bc4-924f-4a2c-9149-cbc5af109316 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:12.439036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-b9ad8bc4-924f-4a2c-9149-cbc5af109316 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 19:42:12.439036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:12.439036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:12.439036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:12.439036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:12.439036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:12.439036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:12.439036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:12.439036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:12.439036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:12.439036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:12.439036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:12.439036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:42:12.439036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:42:12.439036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:42:12.439036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:42:12.440125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:12.440125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:12.440125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:42:12.440125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:42:12.440125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:42:12.440125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:42:12.440125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:12.440125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:12.440125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:12.440125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:12.440125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:12.440125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:12.440125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:12.440125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:12.440125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:12.440125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:12.440125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:12.440125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:12.441245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:12.441245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:12.441245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:42:12.441245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:42:12.441245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:42:12.441245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:42:12.441245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:42:12.441245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:42:12.441245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 19:42:12.441245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:12.441245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 612/1226] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:42:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:12.446146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe5ff0-8381-4b25-9370-e6c539e23293 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:12.494126 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:12.546950 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe5ff0-8381-4b25-9370-e6c539e23293 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:12.580420 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e048bf-38fd-4c90-8cda-dd0a8eb868d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:12.581089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e048bf-38fd-4c90-8cda-dd0a8eb868d4 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:12.581421 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e048bf-38fd-4c90-8cda-dd0a8eb868d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:12.581703 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e048bf-38fd-4c90-8cda-dd0a8eb868d4 None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:12.582526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e048bf-38fd-4c90-8cda-dd0a8eb868d4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:12.582838 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e048bf-38fd-4c90-8cda-dd0a8eb868d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:12.584832 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e048bf-38fd-4c90-8cda-dd0a8eb868d4 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:12.602146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 615/1227] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Jun 23 19:42:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:12.607789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad8bc4-924f-4a2c-9149-cbc5af109316 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:12.716584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad8bc4-924f-4a2c-9149-cbc5af109316 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:12.749056 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db5228-ea81-4a18-a875-a68c2886e935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:12.749915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db5228-ea81-4a18-a875-a68c2886e935 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:12.750204 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db5228-ea81-4a18-a875-a68c2886e935 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:12.750490 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db5228-ea81-4a18-a875-a68c2886e935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:12.761743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db5228-ea81-4a18-a875-a68c2886e935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:12.763189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db5228-ea81-4a18-a875-a68c2886e935 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:12.780740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-23db5228-ea81-4a18-a875-a68c2886e935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:12.780740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:12.780740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:12.780740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:12.780740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:12.780740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:12.780740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:12.780740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:12.780740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:12.780740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:12.780740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:12.780740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:12.780740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:42:12.780740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:42:12.780740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:42:12.781842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:42:12.781842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:12.781842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:12.781842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:12.781842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:12.781842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:12.781842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:12.781842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:12.781842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:12.781842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:12.781842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:12.781842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:12.781842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:12.781842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:12.781842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:12.781842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:12.781842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:12.782798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:42:12.782798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:42:12.782798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:12.782798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:12.782798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 613/1228] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:12.787913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e048bf-38fd-4c90-8cda-dd0a8eb868d4 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:12.886136 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e048bf-38fd-4c90-8cda-dd0a8eb868d4 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:12.888426 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:12.920866 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a4932-d726-4505-8b04-f93958cb7028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:12.921633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a4932-d726-4505-8b04-f93958cb7028 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:12.921921 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a4932-d726-4505-8b04-f93958cb7028 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:12.922202 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a4932-d726-4505-8b04-f93958cb7028 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:12.922925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a4932-d726-4505-8b04-f93958cb7028 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:12.923235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a4932-d726-4505-8b04-f93958cb7028 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:12.924601 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a4932-d726-4505-8b04-f93958cb7028 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:12.936411 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 616/1229] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:42:12.942040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db5228-ea81-4a18-a875-a68c2886e935 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:12.952527 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:13.050333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db5228-ea81-4a18-a875-a68c2886e935 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:13.083956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa725f9-ccc8-4775-9c23-c7a6bd2d8ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:13.084762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa725f9-ccc8-4775-9c23-c7a6bd2d8ad2 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:13.085110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa725f9-ccc8-4775-9c23-c7a6bd2d8ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:13.085412 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa725f9-ccc8-4775-9c23-c7a6bd2d8ad2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:13.092005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa725f9-ccc8-4775-9c23-c7a6bd2d8ad2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:13.093477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa725f9-ccc8-4775-9c23-c7a6bd2d8ad2 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:13.107549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-2aa725f9-ccc8-4775-9c23-c7a6bd2d8ad2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:42:13.107549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:13.107549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:13.107549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:13.107549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:13.107549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:13.107549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:13.107549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:13.107549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:13.107549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:13.107549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:13.107549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:13.107549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:42:13.107549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:42:13.107549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:42:13.108616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:42:13.108616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:13.108616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:13.108616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:13.108616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:13.108616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:13.108616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:13.108616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:13.108616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:13.108616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:13.108616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:13.108616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:13.108616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:13.108616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:13.108616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:13.108616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:13.108616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:13.109685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:42:13.109685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:42:13.109685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:42:13.109685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:42:13.109685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:42:13.109685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:42:13.109685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:42:13.109685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:13.109685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 614/1230] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:42:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:13.115179 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a4932-d726-4505-8b04-f93958cb7028 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:13.213480 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a4932-d726-4505-8b04-f93958cb7028 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:13.246722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04596ea3-90bd-4423-a148-8886a6dacab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:13.247372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04596ea3-90bd-4423-a148-8886a6dacab0 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:13.247660 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04596ea3-90bd-4423-a148-8886a6dacab0 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:13.247940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04596ea3-90bd-4423-a148-8886a6dacab0 None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:13.248747 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04596ea3-90bd-4423-a148-8886a6dacab0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:13.249059 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04596ea3-90bd-4423-a148-8886a6dacab0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:13.250544 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04596ea3-90bd-4423-a148-8886a6dacab0 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:13.263785 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 617/1231] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:42:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:13.269699 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa725f9-ccc8-4775-9c23-c7a6bd2d8ad2 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:13.335094 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:13.368812 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa725f9-ccc8-4775-9c23-c7a6bd2d8ad2 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:13.402175 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7837f9-f431-48a6-9132-132299503636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:13.403049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7837f9-f431-48a6-9132-132299503636 None admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:13.403332 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7837f9-f431-48a6-9132-132299503636 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:13.403608 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7837f9-f431-48a6-9132-132299503636 None admin] PATH_INFO: `/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/7e9ba6d33e8640ec8dcda9971f59c5dc/roles/e466769ed9af47889225dd8d77e896a5` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:13.417922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7837f9-f431-48a6-9132-132299503636 None admin] RBAC: Authorizing `identity:create_grant(project_id=368f41dc1ae64e199b604ee72545c88e, user_id=7e9ba6d33e8640ec8dcda9971f59c5dc, role_id=e466769ed9af47889225dd8d77e896a5)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:13.419355 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7837f9-f431-48a6-9132-132299503636 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:13.491551 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 615/1232] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:42:13 2022] PUT /identity/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/7e9ba6d33e8640ec8dcda9971f59c5dc/roles/e466769ed9af47889225dd8d77e896a5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:42:15.522366 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eec473-23dd-41a7-9203-4a4d9732c805 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:15.522908 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eec473-23dd-41a7-9203-4a4d9732c805 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:15.522997 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eec473-23dd-41a7-9203-4a4d9732c805 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:15.524303 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 618/1233] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:42:15.529711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a87e4-1676-4b81-9c24-f20b92debab6 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:15.530136 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a87e4-1676-4b81-9c24-f20b92debab6 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:15.530311 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a87e4-1676-4b81-9c24-f20b92debab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:15.546773 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-501a87e4-1676-4b81-9c24-f20b92debab6 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:42:15.570201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-501a87e4-1676-4b81-9c24-f20b92debab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:42:15.614805 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 616/1234] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:42:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:42:15.639152 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eec473-23dd-41a7-9203-4a4d9732c805 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:15.665346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:15.739769 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eec473-23dd-41a7-9203-4a4d9732c805 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:15.773026 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d993ba-8c5a-4e4b-84e0-bf50c81eeaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:15.773814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d993ba-8c5a-4e4b-84e0-bf50c81eeaa4 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:15.774104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d993ba-8c5a-4e4b-84e0-bf50c81eeaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:15.774380 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d993ba-8c5a-4e4b-84e0-bf50c81eeaa4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:15.784140 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d993ba-8c5a-4e4b-84e0-bf50c81eeaa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:42:15.791821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-c8d993ba-8c5a-4e4b-84e0-bf50c81eeaa4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:42:15.791821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:15.791821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:15.791821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:15.791821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:15.791821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:15.791821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:15.791821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:15.791821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:15.791821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:15.791821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:15.791821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:15.791821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:42:15.791821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:42:15.791821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:42:15.791821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:42:15.793188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:42:15.793188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:42:15.793188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:42:15.793188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:42:15.793188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:15.793188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:15.793188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:15.793188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:15.793188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:15.793188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:15.793188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:15.793188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:15.793188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:15.793188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:15.793188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:15.793188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:15.794373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:15.794373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:15.794373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:15.794373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:15.794373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:42:15.794373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:42:15.794373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:42:15.794373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:42:15.794373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:42:15.794373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:42:15.794373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 19:42:15.794373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:42:15.794373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 619/1235] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 19:42:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:15.798966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a87e4-1676-4b81-9c24-f20b92debab6 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:15.844138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:15.896222 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a87e4-1676-4b81-9c24-f20b92debab6 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:15.928716 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7254b5d-ba8b-4751-b55a-b6827f836db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:15.929400 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7254b5d-ba8b-4751-b55a-b6827f836db6 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:15.942934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7254b5d-ba8b-4751-b55a-b6827f836db6 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:15.942934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7254b5d-ba8b-4751-b55a-b6827f836db6 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:15.942934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7254b5d-ba8b-4751-b55a-b6827f836db6 None admin] RBAC: Adding query filter params (name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:15.942934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7254b5d-ba8b-4751-b55a-b6827f836db6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:15.942934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7254b5d-ba8b-4751-b55a-b6827f836db6 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:15.942934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 617/1236] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 19:42:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:15.949825 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d993ba-8c5a-4e4b-84e0-bf50c81eeaa4 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:16.035754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:16.050947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d993ba-8c5a-4e4b-84e0-bf50c81eeaa4 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:16.085003 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f7048-ef89-4d57-b0f7-915131e861c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:16.085813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f7048-ef89-4d57-b0f7-915131e861c7 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:16.086095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f7048-ef89-4d57-b0f7-915131e861c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:16.086371 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f7048-ef89-4d57-b0f7-915131e861c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:16.097266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f7048-ef89-4d57-b0f7-915131e861c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:16.098818 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f7048-ef89-4d57-b0f7-915131e861c7 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:16.116235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-237f7048-ef89-4d57-b0f7-915131e861c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:16.116235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:16.116235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:16.116235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:16.116235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:16.116235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:16.116235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:16.116235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:16.116235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:16.116235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:16.116235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:16.116235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:16.116235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:42:16.116235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:42:16.116235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:42:16.117305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:42:16.117305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:16.117305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:16.117305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:16.117305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:16.117305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:16.117305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:16.117305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:16.117305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:16.117305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:16.117305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:16.117305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:16.117305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:16.117305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:16.117305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:16.117305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:16.117305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:16.118416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:42:16.118416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:42:16.118416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:16.118416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:42:16.118416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 620/1237] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:16.123313 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7254b5d-ba8b-4751-b55a-b6827f836db6 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:16.221946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7254b5d-ba8b-4751-b55a-b6827f836db6 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:16.231530 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:16.256806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd052803-00c1-47c5-b70e-d878154e9dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:16.257507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd052803-00c1-47c5-b70e-d878154e9dae None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:16.257799 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd052803-00c1-47c5-b70e-d878154e9dae None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:16.258080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd052803-00c1-47c5-b70e-d878154e9dae None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:16.258830 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd052803-00c1-47c5-b70e-d878154e9dae None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:16.259141 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd052803-00c1-47c5-b70e-d878154e9dae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:16.260519 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd052803-00c1-47c5-b70e-d878154e9dae None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:16.271642 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 618/1238] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:16.277408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f7048-ef89-4d57-b0f7-915131e861c7 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:16.377199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f7048-ef89-4d57-b0f7-915131e861c7 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:16.410127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f30c7-0875-4304-a3bc-9eb2f66aa324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:16.410935 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f30c7-0875-4304-a3bc-9eb2f66aa324 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:16.411736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f30c7-0875-4304-a3bc-9eb2f66aa324 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:16.412016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f30c7-0875-4304-a3bc-9eb2f66aa324 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:16.414754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:16.419607 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f30c7-0875-4304-a3bc-9eb2f66aa324 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:16.421048 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f30c7-0875-4304-a3bc-9eb2f66aa324 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:16.436195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-9f8f30c7-0875-4304-a3bc-9eb2f66aa324 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 19:42:16.436195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:16.436195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:16.436195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:16.436195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:16.436195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:16.436195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:16.436195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:16.436195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:16.436195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:16.436195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:16.436195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:16.436195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:42:16.436195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:42:16.436195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:42:16.436195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:42:16.438864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:16.438864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:16.438864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:42:16.438864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:42:16.438864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:42:16.438864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:42:16.438864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:16.438864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:16.438864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:16.438864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:16.438864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:16.438864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:16.438864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:16.438864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:16.438864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:16.438864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:16.438864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:16.438864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:16.440055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:16.440055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:16.440055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:42:16.440055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:42:16.440055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:42:16.440055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:42:16.440055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:42:16.440055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:42:16.440055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 19:42:16.440055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:42:16.440055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 621/1239] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:42:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:16.443656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd052803-00c1-47c5-b70e-d878154e9dae None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:16.543921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd052803-00c1-47c5-b70e-d878154e9dae None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:16.577164 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188d933-7e6b-4b93-815f-bf061b5e0c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:16.577846 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188d933-7e6b-4b93-815f-bf061b5e0c70 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:16.578129 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188d933-7e6b-4b93-815f-bf061b5e0c70 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:16.578406 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188d933-7e6b-4b93-815f-bf061b5e0c70 None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:16.579234 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188d933-7e6b-4b93-815f-bf061b5e0c70 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:16.579540 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188d933-7e6b-4b93-815f-bf061b5e0c70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:16.580949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188d933-7e6b-4b93-815f-bf061b5e0c70 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:16.598404 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 619/1240] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Jun 23 19:42:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:16.604869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f30c7-0875-4304-a3bc-9eb2f66aa324 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:16.705381 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f30c7-0875-4304-a3bc-9eb2f66aa324 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:16.738395 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f215f5-0982-4e5c-8692-08f966058ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:16.739032 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f215f5-0982-4e5c-8692-08f966058ad0 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:16.739886 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f215f5-0982-4e5c-8692-08f966058ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:16.740159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f215f5-0982-4e5c-8692-08f966058ad0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:16.800084 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:16.806693 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f215f5-0982-4e5c-8692-08f966058ad0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:16.808128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f215f5-0982-4e5c-8692-08f966058ad0 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:16.907206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 622/1241] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:42:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 19:42:16.913876 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188d933-7e6b-4b93-815f-bf061b5e0c70 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:16.941368 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:17.012992 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188d933-7e6b-4b93-815f-bf061b5e0c70 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:17.046117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61a527-898f-4fbe-b70c-d331561190db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:17.046948 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61a527-898f-4fbe-b70c-d331561190db None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:17.047241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61a527-898f-4fbe-b70c-d331561190db None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:17.047519 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61a527-898f-4fbe-b70c-d331561190db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:17.057741 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61a527-898f-4fbe-b70c-d331561190db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:17.059245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61a527-898f-4fbe-b70c-d331561190db None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:17.077110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-1d61a527-898f-4fbe-b70c-d331561190db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:17.077110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:17.077110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:17.077110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:17.077110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:17.077110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:17.077110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:17.077110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:17.077110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:17.077110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:17.077110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:17.077110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:17.077110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:42:17.077110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:42:17.077110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:42:17.078203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:42:17.078203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:17.078203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:17.078203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:17.078203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:17.078203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:17.078203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:17.078203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:17.078203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:17.078203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:17.078203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:17.078203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:17.078203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:17.078203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:17.078203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:17.078203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:17.078203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:17.079533 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:42:17.079533 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:42:17.079533 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:17.079533 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:17.079533 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 620/1242] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:17.084195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f215f5-0982-4e5c-8692-08f966058ad0 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:17.178683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:17.184323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f215f5-0982-4e5c-8692-08f966058ad0 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:17.218192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98751d58-785f-4f3f-9b00-4e78d043e6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:17.221246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98751d58-785f-4f3f-9b00-4e78d043e6de None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:17.221246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98751d58-785f-4f3f-9b00-4e78d043e6de None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:17.221246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98751d58-785f-4f3f-9b00-4e78d043e6de None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:17.221246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98751d58-785f-4f3f-9b00-4e78d043e6de None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:17.221246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98751d58-785f-4f3f-9b00-4e78d043e6de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:17.221840 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98751d58-785f-4f3f-9b00-4e78d043e6de None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:17.232772 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 623/1243] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:17.238386 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61a527-898f-4fbe-b70c-d331561190db None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:17.315333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:17.337536 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61a527-898f-4fbe-b70c-d331561190db None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:17.370271 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d1518-e50d-40ac-8f90-667f8be3c7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:17.371194 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d1518-e50d-40ac-8f90-667f8be3c7c6 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:17.371482 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d1518-e50d-40ac-8f90-667f8be3c7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:17.371763 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d1518-e50d-40ac-8f90-667f8be3c7c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:17.378262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d1518-e50d-40ac-8f90-667f8be3c7c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:17.380186 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d1518-e50d-40ac-8f90-667f8be3c7c6 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:17.393576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-3f4d1518-e50d-40ac-8f90-667f8be3c7c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:42:17.393576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:17.393576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:17.393576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:17.393576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:17.393576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:17.393576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:17.393576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:17.393576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:17.393576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:17.393576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:17.393576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:17.393576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:42:17.393576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:42:17.393576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:42:17.400341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:42:17.400341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:17.400341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:17.400341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:17.400341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:17.400341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:17.400341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:17.400341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:17.400341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:17.400341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:17.400341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:17.400341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:17.400341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:17.400341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:17.400341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:17.400341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:17.400341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:17.401493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:42:17.401493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:42:17.401493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:42:17.401493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:42:17.401493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:42:17.401493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:42:17.401493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:42:17.401493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:17.401493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 621/1244] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:42:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:17.402101 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98751d58-785f-4f3f-9b00-4e78d043e6de None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:17.500474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98751d58-785f-4f3f-9b00-4e78d043e6de None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:17.532913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10018a-f251-496f-862c-5fc8a49c309a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:17.533680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10018a-f251-496f-862c-5fc8a49c309a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:17.533967 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10018a-f251-496f-862c-5fc8a49c309a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:17.534245 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10018a-f251-496f-862c-5fc8a49c309a None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:17.535038 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10018a-f251-496f-862c-5fc8a49c309a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:17.535345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10018a-f251-496f-862c-5fc8a49c309a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:17.537082 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10018a-f251-496f-862c-5fc8a49c309a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:17.549485 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 624/1245] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:42:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:17.556312 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d1518-e50d-40ac-8f90-667f8be3c7c6 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:17.657521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d1518-e50d-40ac-8f90-667f8be3c7c6 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:17.690498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4e14b-f885-4c73-9f1e-72619eddbc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:17.691144 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4e14b-f885-4c73-9f1e-72619eddbc0a None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:17.691423 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4e14b-f885-4c73-9f1e-72619eddbc0a None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:17.691699 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4e14b-f885-4c73-9f1e-72619eddbc0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:17.693134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4e14b-f885-4c73-9f1e-72619eddbc0a None admin] RBAC: Adding query filter params (role.id=e466769ed9af47889225dd8d77e896a5, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=7e9ba6d33e8640ec8dcda9971f59c5dc) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:17.693478 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4e14b-f885-4c73-9f1e-72619eddbc0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:17.694886 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4e14b-f885-4c73-9f1e-72619eddbc0a None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:17.700863 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 622/1246] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:42:17 2022] GET /identity/v3/role_assignments?user.id=7e9ba6d33e8640ec8dcda9971f59c5dc&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=e466769ed9af47889225dd8d77e896a5 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:19.810178 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f74fc-cb92-4180-bc05-6fa44791822f None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:19.810768 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f74fc-cb92-4180-bc05-6fa44791822f None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:19.810768 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f74fc-cb92-4180-bc05-6fa44791822f None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:19.812129 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 625/1247] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:42:19.817929 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d677b6-337d-43d4-a0c5-2fc11107a0a0 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:19.818615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d677b6-337d-43d4-a0c5-2fc11107a0a0 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:19.818892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d677b6-337d-43d4-a0c5-2fc11107a0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:19.824263 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:19.836580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-b1d677b6-337d-43d4-a0c5-2fc11107a0a0 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:42:19.837783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-b1d677b6-337d-43d4-a0c5-2fc11107a0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:42:19.904626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 623/1248] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:42:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:42:19.928511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f74fc-cb92-4180-bc05-6fa44791822f None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:19.949675 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:20.037924 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f74fc-cb92-4180-bc05-6fa44791822f None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:20.072205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd13a6-4351-4cab-ad2f-5d51867febaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:20.072929 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd13a6-4351-4cab-ad2f-5d51867febaa None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:20.073559 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd13a6-4351-4cab-ad2f-5d51867febaa None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:20.073834 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd13a6-4351-4cab-ad2f-5d51867febaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:20.083860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd13a6-4351-4cab-ad2f-5d51867febaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:42:20.091547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-d3bd13a6-4351-4cab-ad2f-5d51867febaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:42:20.091547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:20.091547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:20.091547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:20.091547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:20.091547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:20.091547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:20.091547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:20.091547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:20.091547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:20.091547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:20.091547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:20.091547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:42:20.091547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:42:20.091547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:42:20.091547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:42:20.097691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:42:20.097691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:42:20.097691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:42:20.097691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:42:20.097691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:20.097691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:20.097691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:20.097691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:20.097691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:20.097691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:20.097691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:20.097691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:20.097691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:20.097691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:20.097691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:20.097691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:20.099205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:20.099205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:20.099205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:20.099205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:20.099205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:42:20.099205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:42:20.099205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:42:20.099205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:42:20.099205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:42:20.099205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:42:20.099205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:42:20.099205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:42:20.099205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 626/1249] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:42:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:20.099952 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d677b6-337d-43d4-a0c5-2fc11107a0a0 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:20.199479 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d677b6-337d-43d4-a0c5-2fc11107a0a0 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:20.228562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:20.233377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc6b7e-1b1b-47da-a7a7-0c7c0ff8f622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:20.234039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc6b7e-1b1b-47da-a7a7-0c7c0ff8f622 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:20.234328 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc6b7e-1b1b-47da-a7a7-0c7c0ff8f622 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:20.234611 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc6b7e-1b1b-47da-a7a7-0c7c0ff8f622 None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:20.235410 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc6b7e-1b1b-47da-a7a7-0c7c0ff8f622 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:20.235718 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc6b7e-1b1b-47da-a7a7-0c7c0ff8f622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:20.237089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc6b7e-1b1b-47da-a7a7-0c7c0ff8f622 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:20.245303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 624/1250] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:42:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:20.250984 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd13a6-4351-4cab-ad2f-5d51867febaa None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:20.327822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:20.350283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd13a6-4351-4cab-ad2f-5d51867febaa None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:20.383120 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce70ca-d6c8-435d-8e07-ec4248252af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:20.383913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce70ca-d6c8-435d-8e07-ec4248252af6 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:20.384197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce70ca-d6c8-435d-8e07-ec4248252af6 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:20.384473 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce70ca-d6c8-435d-8e07-ec4248252af6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:20.396239 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce70ca-d6c8-435d-8e07-ec4248252af6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:20.397900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce70ca-d6c8-435d-8e07-ec4248252af6 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:20.415056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-b3ce70ca-d6c8-435d-8e07-ec4248252af6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:20.415056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:20.415056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:20.415056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:20.415056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:20.415056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:20.415056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:20.415056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:20.415056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:20.415056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:20.415056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:20.415056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:20.415056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:42:20.415056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:42:20.415056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:42:20.416200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:42:20.416200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:20.416200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:20.416200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:20.416200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:20.416200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:20.416200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:20.416200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:20.416200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:20.416200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:20.416200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:20.416200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:20.416200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:20.416200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:20.416200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:20.416200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:20.416200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:20.417512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:42:20.417512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:42:20.417512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:20.417512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:42:20.417512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 627/1251] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:20.423542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc6b7e-1b1b-47da-a7a7-0c7c0ff8f622 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:20.524399 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc6b7e-1b1b-47da-a7a7-0c7c0ff8f622 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:20.557632 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fabee-901a-44f1-a06b-0ecd46a43029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:20.558284 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fabee-901a-44f1-a06b-0ecd46a43029 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:20.558606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fabee-901a-44f1-a06b-0ecd46a43029 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:20.558885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fabee-901a-44f1-a06b-0ecd46a43029 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:20.559603 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fabee-901a-44f1-a06b-0ecd46a43029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:20.559909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fabee-901a-44f1-a06b-0ecd46a43029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:20.561286 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fabee-901a-44f1-a06b-0ecd46a43029 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:20.574017 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 625/1252] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:42:20.581428 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce70ca-d6c8-435d-8e07-ec4248252af6 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:20.678346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce70ca-d6c8-435d-8e07-ec4248252af6 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:20.705009 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:20.712635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc250d5d-d8ed-4603-8256-dfdc79d4f572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:20.713488 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc250d5d-d8ed-4603-8256-dfdc79d4f572 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:20.713774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc250d5d-d8ed-4603-8256-dfdc79d4f572 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:20.714052 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc250d5d-d8ed-4603-8256-dfdc79d4f572 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:20.721205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc250d5d-d8ed-4603-8256-dfdc79d4f572 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:20.722635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc250d5d-d8ed-4603-8256-dfdc79d4f572 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:20.736965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-cc250d5d-d8ed-4603-8256-dfdc79d4f572 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 19:42:20.736965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:20.736965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:20.736965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:20.736965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:20.736965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:20.736965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:20.736965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:20.736965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:20.736965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:20.736965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:20.736965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:20.736965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:42:20.736965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:42:20.736965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:42:20.736965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:42:20.738207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:20.738207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:20.738207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:42:20.738207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:42:20.738207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:42:20.738207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:42:20.738207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:20.738207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:20.738207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:20.738207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:20.738207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:20.738207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:20.738207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:20.738207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:20.738207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:20.738207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:20.738207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:20.738207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:20.739722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:20.739722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:20.739722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:42:20.739722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:42:20.739722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:42:20.739722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:42:20.739722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:42:20.739722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:42:20.739722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 19:42:20.739722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:42:20.739722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 628/1253] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:42:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:20.744433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fabee-901a-44f1-a06b-0ecd46a43029 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:20.797962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:20.842013 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fabee-901a-44f1-a06b-0ecd46a43029 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:20.875172 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13643710-482a-4d1f-b7b3-b26f34b0e13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:20.875841 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13643710-482a-4d1f-b7b3-b26f34b0e13b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:20.876129 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13643710-482a-4d1f-b7b3-b26f34b0e13b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:20.876405 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13643710-482a-4d1f-b7b3-b26f34b0e13b None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:20.877356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13643710-482a-4d1f-b7b3-b26f34b0e13b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:20.877671 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13643710-482a-4d1f-b7b3-b26f34b0e13b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:20.879101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13643710-482a-4d1f-b7b3-b26f34b0e13b None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:20.896704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 626/1254] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Jun 23 19:42:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:20.902561 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc250d5d-d8ed-4603-8256-dfdc79d4f572 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:21.002260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc250d5d-d8ed-4603-8256-dfdc79d4f572 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:21.034681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5998d0-fc50-42c7-85d4-402737f8fc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:21.035323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5998d0-fc50-42c7-85d4-402737f8fc26 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:21.035610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5998d0-fc50-42c7-85d4-402737f8fc26 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:21.035892 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5998d0-fc50-42c7-85d4-402737f8fc26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:21.091238 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:21.104131 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5998d0-fc50-42c7-85d4-402737f8fc26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:21.105552 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5998d0-fc50-42c7-85d4-402737f8fc26 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:21.202553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 629/1255] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:42:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 19:42:21.209206 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13643710-482a-4d1f-b7b3-b26f34b0e13b None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:21.307293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13643710-482a-4d1f-b7b3-b26f34b0e13b None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:21.321493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:21.341531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06958100-6f0f-4afb-b09e-72d2d7f7ffa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:21.342311 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06958100-6f0f-4afb-b09e-72d2d7f7ffa5 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:21.342594 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06958100-6f0f-4afb-b09e-72d2d7f7ffa5 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:21.342872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06958100-6f0f-4afb-b09e-72d2d7f7ffa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:21.352517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06958100-6f0f-4afb-b09e-72d2d7f7ffa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:21.353980 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06958100-6f0f-4afb-b09e-72d2d7f7ffa5 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:21.371095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-06958100-6f0f-4afb-b09e-72d2d7f7ffa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:21.371095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:21.371095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:21.371095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:21.371095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:21.371095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:21.371095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:21.371095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:21.371095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:21.371095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:21.371095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:21.371095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:21.371095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:42:21.371095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:42:21.371095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:42:21.372223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:42:21.372223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:21.372223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:21.372223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:21.372223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:21.372223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:21.372223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:21.372223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:21.372223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:21.372223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:21.372223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:21.372223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:21.372223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:21.372223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:21.372223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:21.372223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:21.372223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:21.373283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:42:21.373283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:42:21.373283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:21.373283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:21.373283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 627/1256] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:21.378101 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5998d0-fc50-42c7-85d4-402737f8fc26 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:21.465128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:21.476828 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5998d0-fc50-42c7-85d4-402737f8fc26 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:21.510256 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d069cde-367e-4b5b-a7ae-44f546f12d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:21.510910 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d069cde-367e-4b5b-a7ae-44f546f12d63 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:21.511198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d069cde-367e-4b5b-a7ae-44f546f12d63 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:21.511478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d069cde-367e-4b5b-a7ae-44f546f12d63 None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:21.512193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d069cde-367e-4b5b-a7ae-44f546f12d63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:21.512499 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d069cde-367e-4b5b-a7ae-44f546f12d63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:21.513901 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d069cde-367e-4b5b-a7ae-44f546f12d63 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:21.525437 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 630/1257] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:21.531125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06958100-6f0f-4afb-b09e-72d2d7f7ffa5 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:21.631269 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06958100-6f0f-4afb-b09e-72d2d7f7ffa5 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:21.664930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de7087-2375-4e8c-85b8-0956faf17fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:21.667143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de7087-2375-4e8c-85b8-0956faf17fbb None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:21.667143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de7087-2375-4e8c-85b8-0956faf17fbb None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:21.667143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de7087-2375-4e8c-85b8-0956faf17fbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:21.672858 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de7087-2375-4e8c-85b8-0956faf17fbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:21.674349 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de7087-2375-4e8c-85b8-0956faf17fbb None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:21.688331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-55de7087-2375-4e8c-85b8-0956faf17fbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:42:21.688331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:21.688331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:21.688331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:21.688331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:21.688331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:21.688331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:21.688331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:21.688331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:21.688331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:21.688331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:21.688331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:21.688331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:42:21.688331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:42:21.688331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:42:21.689465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:42:21.689465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:21.689465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:21.689465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:21.689465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:21.689465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:21.689465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:21.689465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:21.689465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:21.689465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:21.689465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:21.689465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:21.689465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:21.689465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:21.689465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:21.689465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:21.689465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:21.690617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:42:21.690617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:42:21.690617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:42:21.690617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:42:21.690617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:42:21.690617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:42:21.690617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:42:21.690617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:21.690617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 628/1258] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:42:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:21.696195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d069cde-367e-4b5b-a7ae-44f546f12d63 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:21.796074 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d069cde-367e-4b5b-a7ae-44f546f12d63 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:21.829810 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9ed6b-06e6-4602-a7b4-43a0b129fba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:21.830505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9ed6b-06e6-4602-a7b4-43a0b129fba9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:21.830780 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9ed6b-06e6-4602-a7b4-43a0b129fba9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:21.831060 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9ed6b-06e6-4602-a7b4-43a0b129fba9 None admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:21.831939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9ed6b-06e6-4602-a7b4-43a0b129fba9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:21.832255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9ed6b-06e6-4602-a7b4-43a0b129fba9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:21.834285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9ed6b-06e6-4602-a7b4-43a0b129fba9 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:21.846811 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 631/1259] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:42:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:42:21.853304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de7087-2375-4e8c-85b8-0956faf17fbb None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:21.878948 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:21.955172 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de7087-2375-4e8c-85b8-0956faf17fbb None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:21.987790 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfa879-dbfc-483d-b354-3cd0fd7af214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:21.988431 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa879-dbfc-483d-b354-3cd0fd7af214 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:21.988712 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa879-dbfc-483d-b354-3cd0fd7af214 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:21.988986 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa879-dbfc-483d-b354-3cd0fd7af214 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:21.990726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfa879-dbfc-483d-b354-3cd0fd7af214 None admin] RBAC: Adding query filter params (role.id=76bd0cf7bf094e4fa3db121b96215004, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=7e9ba6d33e8640ec8dcda9971f59c5dc) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:21.991040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfa879-dbfc-483d-b354-3cd0fd7af214 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:21.992462 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfa879-dbfc-483d-b354-3cd0fd7af214 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:21.997926 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 629/1260] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:42:21 2022] GET /identity/v3/role_assignments?user.id=7e9ba6d33e8640ec8dcda9971f59c5dc&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=76bd0cf7bf094e4fa3db121b96215004 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:23.988787 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f3e4a-04ae-4e1e-bc8b-450757b81a0a None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:23.990316 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f3e4a-04ae-4e1e-bc8b-450757b81a0a None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:23.990316 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f3e4a-04ae-4e1e-bc8b-450757b81a0a None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:23.991282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 632/1261] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:42:23.996549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c33cab-9387-4202-bb1b-8eb8e366704d None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:23.996950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c33cab-9387-4202-bb1b-8eb8e366704d None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:23.997118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c33cab-9387-4202-bb1b-8eb8e366704d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:24.013847 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-86c33cab-9387-4202-bb1b-8eb8e366704d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:42:24.015033 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-86c33cab-9387-4202-bb1b-8eb8e366704d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:42:24.081569 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 630/1262] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:42:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:42:24.105020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f3e4a-04ae-4e1e-bc8b-450757b81a0a None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:24.116629 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:24.204713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f3e4a-04ae-4e1e-bc8b-450757b81a0a None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:24.237504 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b71e6-de1f-4db6-88a1-7322d98cbfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:24.238293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b71e6-de1f-4db6-88a1-7322d98cbfaf None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:24.238580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b71e6-de1f-4db6-88a1-7322d98cbfaf None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:24.238861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b71e6-de1f-4db6-88a1-7322d98cbfaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:24.249526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b71e6-de1f-4db6-88a1-7322d98cbfaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:42:24.257799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-e97b71e6-de1f-4db6-88a1-7322d98cbfaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:42:24.257799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:24.257799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:24.257799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:24.257799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:24.257799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:24.257799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:24.257799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:24.257799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:24.257799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:24.257799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:24.257799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:24.257799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:42:24.257799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:42:24.257799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:42:24.257799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:42:24.258822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:42:24.258822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:42:24.258822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:42:24.258822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:42:24.258822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:24.258822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:24.258822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:24.258822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:24.258822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:24.258822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:24.258822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:24.258822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:24.258822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:24.258822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:24.258822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:24.258822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:24.260132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:24.260132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:24.260132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:24.260132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:24.260132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:42:24.260132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:42:24.260132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:42:24.260132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:42:24.260132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:42:24.260132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:42:24.260132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:42:24.260132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:42:24.260132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 633/1263] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:42:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:24.265232 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c33cab-9387-4202-bb1b-8eb8e366704d None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:24.283191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:24.362554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c33cab-9387-4202-bb1b-8eb8e366704d None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:24.396472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05856b6-10b9-4360-b52f-59cea491f41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:24.397175 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05856b6-10b9-4360-b52f-59cea491f41c None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:24.397465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05856b6-10b9-4360-b52f-59cea491f41c None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:24.397741 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05856b6-10b9-4360-b52f-59cea491f41c None admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:24.398481 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05856b6-10b9-4360-b52f-59cea491f41c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:24.398786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05856b6-10b9-4360-b52f-59cea491f41c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:24.400149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05856b6-10b9-4360-b52f-59cea491f41c None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:24.407988 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 631/1264] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:42:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:24.414480 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b71e6-de1f-4db6-88a1-7322d98cbfaf None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:24.481190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:24.514829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b71e6-de1f-4db6-88a1-7322d98cbfaf None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:24.547124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0351e58-8dfd-4658-a2ef-4fd667a6640a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:24.547943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351e58-8dfd-4658-a2ef-4fd667a6640a None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:24.548221 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351e58-8dfd-4658-a2ef-4fd667a6640a None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:24.548491 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351e58-8dfd-4658-a2ef-4fd667a6640a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:24.559148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0351e58-8dfd-4658-a2ef-4fd667a6640a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:24.560616 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0351e58-8dfd-4658-a2ef-4fd667a6640a None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:24.578195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-d0351e58-8dfd-4658-a2ef-4fd667a6640a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:24.578195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:24.578195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:24.578195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:24.578195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:24.578195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:24.578195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:24.578195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:24.578195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:24.578195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:24.578195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:24.578195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:24.578195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:42:24.578195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:42:24.578195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:42:24.579332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:42:24.579332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:24.579332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:24.579332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:24.579332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:24.579332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:24.579332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:24.579332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:24.579332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:24.579332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:24.579332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:24.579332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:24.579332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:24.579332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:24.579332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:24.579332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:24.579332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:24.580477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:42:24.580477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:42:24.580477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:24.580477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:42:24.580477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 634/1265] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:24.585240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05856b6-10b9-4360-b52f-59cea491f41c None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:24.664744 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:24.683453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05856b6-10b9-4360-b52f-59cea491f41c None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:24.716664 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e959ec5-d495-432e-b394-59f9f810115f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:24.717344 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e959ec5-d495-432e-b394-59f9f810115f None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:24.717634 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e959ec5-d495-432e-b394-59f9f810115f None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:24.717913 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e959ec5-d495-432e-b394-59f9f810115f None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:24.718633 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e959ec5-d495-432e-b394-59f9f810115f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:24.718940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e959ec5-d495-432e-b394-59f9f810115f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:24.720303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e959ec5-d495-432e-b394-59f9f810115f None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:24.733188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 632/1266] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:24.738807 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0351e58-8dfd-4658-a2ef-4fd667a6640a None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:24.837819 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0351e58-8dfd-4658-a2ef-4fd667a6640a None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:24.857003 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:24.870476 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e5eee-0a12-4191-91d5-beb86d14689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:24.871271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e5eee-0a12-4191-91d5-beb86d14689e None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:24.871556 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e5eee-0a12-4191-91d5-beb86d14689e None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:24.871833 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e5eee-0a12-4191-91d5-beb86d14689e None admin] PATH_INFO: `/v3/users/placement` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:24.879316 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e5eee-0a12-4191-91d5-beb86d14689e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:24.881549 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e5eee-0a12-4191-91d5-beb86d14689e None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:24.896358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-2e4e5eee-0a12-4191-91d5-beb86d14689e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 19:42:24.896358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:24.896358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:24.896358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:24.896358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:24.896358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:24.896358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:24.896358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:24.896358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:24.896358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:24.896358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:24.896358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:24.896358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:42:24.896358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:42:24.896358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:42:24.896358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:42:24.903071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:24.903071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:24.903071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:42:24.903071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:42:24.903071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:42:24.903071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:42:24.903071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:24.903071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:24.903071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:24.903071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:24.903071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:24.903071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:24.903071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:24.903071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:24.903071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:24.903071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:24.903071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:24.903071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:24.904773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:24.904773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:24.904773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:42:24.904773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:42:24.904773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:42:24.904773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:42:24.904773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:42:24.904773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:42:24.904773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 19:42:24.904773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:42:24.904773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 635/1267] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:42:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:24.905545 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e959ec5-d495-432e-b394-59f9f810115f None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:25.003946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e959ec5-d495-432e-b394-59f9f810115f None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:25.037369 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d807b-bc49-460b-aab6-a37c7a776dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:25.038023 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d807b-bc49-460b-aab6-a37c7a776dc8 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:25.038303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d807b-bc49-460b-aab6-a37c7a776dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:25.038577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d807b-bc49-460b-aab6-a37c7a776dc8 None admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:25.039403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d807b-bc49-460b-aab6-a37c7a776dc8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:25.039712 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d807b-bc49-460b-aab6-a37c7a776dc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:25.041201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d807b-bc49-460b-aab6-a37c7a776dc8 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:25.049585 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:25.058427 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 633/1268] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Jun 23 19:42:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:42:25.064149 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e5eee-0a12-4191-91d5-beb86d14689e None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:25.163667 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e5eee-0a12-4191-91d5-beb86d14689e None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:25.197004 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f804502-a501-49b5-a5cc-da57c12e2f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:25.197821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f804502-a501-49b5-a5cc-da57c12e2f1d None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:25.198349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f804502-a501-49b5-a5cc-da57c12e2f1d None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:25.198631 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f804502-a501-49b5-a5cc-da57c12e2f1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:25.209069 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f804502-a501-49b5-a5cc-da57c12e2f1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:25.210547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f804502-a501-49b5-a5cc-da57c12e2f1d None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:25.227117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-7f804502-a501-49b5-a5cc-da57c12e2f1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:25.227117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:25.227117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:25.227117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:25.227117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:25.227117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:25.227117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:25.227117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:25.227117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:25.227117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:25.227117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:25.227117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:25.227117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:42:25.227117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:42:25.227117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:42:25.228192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:42:25.228192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:25.228192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:25.228192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:25.228192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:25.228192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:25.228192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:25.228192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:25.228192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:25.228192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:25.228192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:25.228192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:25.228192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:25.228192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:25.228192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:25.228192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:25.228192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:25.229353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:42:25.229353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:42:25.229353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:25.229353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:42:25.229353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 636/1269] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:25.233960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d807b-bc49-460b-aab6-a37c7a776dc8 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:25.330839 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d807b-bc49-460b-aab6-a37c7a776dc8 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:25.365783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e997b6d-9f4b-4b65-862f-bc9475445be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:25.366517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e997b6d-9f4b-4b65-862f-bc9475445be7 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:25.366845 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e997b6d-9f4b-4b65-862f-bc9475445be7 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:25.367122 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e997b6d-9f4b-4b65-862f-bc9475445be7 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:25.367842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e997b6d-9f4b-4b65-862f-bc9475445be7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:25.368148 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e997b6d-9f4b-4b65-862f-bc9475445be7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:25.369521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e997b6d-9f4b-4b65-862f-bc9475445be7 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:25.381030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 634/1270] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:25.386664 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f804502-a501-49b5-a5cc-da57c12e2f1d None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:25.418896 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:25.485365 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f804502-a501-49b5-a5cc-da57c12e2f1d None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:25.518555 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4094cef-d010-4ea7-ab97-11f5fb3a5aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:25.519343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4094cef-d010-4ea7-ab97-11f5fb3a5aea None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:25.519632 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4094cef-d010-4ea7-ab97-11f5fb3a5aea None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:25.519906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4094cef-d010-4ea7-ab97-11f5fb3a5aea None admin] PATH_INFO: `/v3/projects/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:25.526456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4094cef-d010-4ea7-ab97-11f5fb3a5aea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:25.527888 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4094cef-d010-4ea7-ab97-11f5fb3a5aea None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:25.542614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-a4094cef-d010-4ea7-ab97-11f5fb3a5aea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:42:25.542614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:25.542614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:25.542614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:25.542614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:25.542614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:25.542614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:25.542614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:25.542614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:25.542614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:25.542614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:25.542614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:25.542614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:42:25.542614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:42:25.542614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:42:25.543671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:42:25.543671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:25.543671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:25.543671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:25.543671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:25.543671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:25.543671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:25.543671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:25.543671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:25.543671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:25.543671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:25.543671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:25.543671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:25.543671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:25.543671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:25.543671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:25.543671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:25.544882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:42:25.544882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:42:25.544882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:42:25.544882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:42:25.544882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:42:25.544882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:42:25.544882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:42:25.544882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:42:25.544882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 637/1271] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:42:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:25.549715 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e997b6d-9f4b-4b65-862f-bc9475445be7 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:25.608330 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:25.649327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e997b6d-9f4b-4b65-862f-bc9475445be7 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:25.683274 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc4fc4-efad-4eec-b07e-26eceed9916c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:25.683923 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc4fc4-efad-4eec-b07e-26eceed9916c None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:25.684205 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc4fc4-efad-4eec-b07e-26eceed9916c None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:25.684479 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc4fc4-efad-4eec-b07e-26eceed9916c None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:25.685289 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc4fc4-efad-4eec-b07e-26eceed9916c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:25.685597 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc4fc4-efad-4eec-b07e-26eceed9916c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:25.687023 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc4fc4-efad-4eec-b07e-26eceed9916c None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:25.699906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 635/1272] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:42:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:25.705947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4094cef-d010-4ea7-ab97-11f5fb3a5aea None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:25.797342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:25.806628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4094cef-d010-4ea7-ab97-11f5fb3a5aea None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:25.839975 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5be827-5c7f-45eb-9902-94e737dc23fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:25.840869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5be827-5c7f-45eb-9902-94e737dc23fb None admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:25.841168 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5be827-5c7f-45eb-9902-94e737dc23fb None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:25.841461 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5be827-5c7f-45eb-9902-94e737dc23fb None admin] PATH_INFO: `/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/7e9ba6d33e8640ec8dcda9971f59c5dc/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:25.843442 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5be827-5c7f-45eb-9902-94e737dc23fb None admin] RBAC: Authorizing `identity:create_grant(project_id=368f41dc1ae64e199b604ee72545c88e, user_id=7e9ba6d33e8640ec8dcda9971f59c5dc, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:25.844896 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5be827-5c7f-45eb-9902-94e737dc23fb None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:25.980023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 638/1273] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 19:42:25 2022] PUT /identity/v3/projects/368f41dc1ae64e199b604ee72545c88e/users/7e9ba6d33e8640ec8dcda9971f59c5dc/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:42:28.017946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bc1c9-6e41-46e6-aadb-0337a95b6393 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:28.018474 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bc1c9-6e41-46e6-aadb-0337a95b6393 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:28.018588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bc1c9-6e41-46e6-aadb-0337a95b6393 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:28.019863 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 636/1274] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:42:28.026487 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a61116-0319-436a-b6be-de58b2a7ee62 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:28.026921 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a61116-0319-436a-b6be-de58b2a7ee62 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:28.027048 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a61116-0319-436a-b6be-de58b2a7ee62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:28.046537 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-58a61116-0319-436a-b6be-de58b2a7ee62 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:42:28.047944 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-58a61116-0319-436a-b6be-de58b2a7ee62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:42:28.115408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 639/1275] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:42:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 19:42:28.139369 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bc1c9-6e41-46e6-aadb-0337a95b6393 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:28.244575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bc1c9-6e41-46e6-aadb-0337a95b6393 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:28.261536 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:28.277956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c711fb-258d-44b2-a97d-77d9526554e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:28.278812 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c711fb-258d-44b2-a97d-77d9526554e9 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:28.279098 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c711fb-258d-44b2-a97d-77d9526554e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:28.279377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c711fb-258d-44b2-a97d-77d9526554e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:28.289664 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c711fb-258d-44b2-a97d-77d9526554e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 19:42:28.297606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-d5c711fb-258d-44b2-a97d-77d9526554e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:42:28.297606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:28.297606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:28.297606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:28.297606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:28.297606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:28.297606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:28.297606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:28.297606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:28.297606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:28.297606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:28.297606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:28.297606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 19:42:28.297606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 19:42:28.297606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 19:42:28.297606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 19:42:28.298782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 19:42:28.298782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 19:42:28.298782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 19:42:28.298782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 19:42:28.298782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:28.298782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:28.298782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:28.298782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:28.298782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:28.298782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:28.298782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:28.298782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:28.298782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:28.298782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:28.298782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:28.298782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:28.299815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:28.299815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:28.299815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:28.299815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:28.299815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 19:42:28.299815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 19:42:28.299815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 19:42:28.299815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 19:42:28.299815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 19:42:28.299815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 19:42:28.299815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 19:42:28.299815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:28.299815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 637/1276] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 19:42:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:28.305301 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a61116-0319-436a-b6be-de58b2a7ee62 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:28.387243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:28.408011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a61116-0319-436a-b6be-de58b2a7ee62 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:28.440951 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540b3f8-c6de-49fb-9a81-768eda606bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:28.441647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540b3f8-c6de-49fb-9a81-768eda606bc9 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:28.441935 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540b3f8-c6de-49fb-9a81-768eda606bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:28.442751 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540b3f8-c6de-49fb-9a81-768eda606bc9 None admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:28.443579 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540b3f8-c6de-49fb-9a81-768eda606bc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:28.443909 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540b3f8-c6de-49fb-9a81-768eda606bc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:28.445524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540b3f8-c6de-49fb-9a81-768eda606bc9 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:28.453803 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 640/1277] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 19:42:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:42:28.460448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c711fb-258d-44b2-a97d-77d9526554e9 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:28.559032 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c711fb-258d-44b2-a97d-77d9526554e9 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:28.592786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521a284-1e3f-4513-993a-f0a8da9b8b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:28.593584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521a284-1e3f-4513-993a-f0a8da9b8b36 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:28.593863 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521a284-1e3f-4513-993a-f0a8da9b8b36 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:28.594137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521a284-1e3f-4513-993a-f0a8da9b8b36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:28.604643 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521a284-1e3f-4513-993a-f0a8da9b8b36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:28.606142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521a284-1e3f-4513-993a-f0a8da9b8b36 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:28.623040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-3521a284-1e3f-4513-993a-f0a8da9b8b36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:28.623040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:28.623040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:28.623040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:28.623040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:28.623040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:28.623040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:28.623040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:28.623040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:28.623040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:28.623040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:28.623040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:28.623040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:42:28.623040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:42:28.623040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:42:28.624189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:42:28.624189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:28.624189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:28.624189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:28.624189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:28.624189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:28.624189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:28.624189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:28.624189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:28.624189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:28.624189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:28.624189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:28.624189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:28.624189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:28.624189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:28.624189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:28.624189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:28.625319 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:42:28.625319 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:42:28.625319 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:28.625319 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:28.625319 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 638/1278] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:28.633726 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540b3f8-c6de-49fb-9a81-768eda606bc9 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:28.737465 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540b3f8-c6de-49fb-9a81-768eda606bc9 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:28.772199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e802795-f238-45e7-9108-91d59f23ef6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:28.772867 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e802795-f238-45e7-9108-91d59f23ef6c None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:28.773185 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e802795-f238-45e7-9108-91d59f23ef6c None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:28.773469 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e802795-f238-45e7-9108-91d59f23ef6c None admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:28.774197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e802795-f238-45e7-9108-91d59f23ef6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:28.774506 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e802795-f238-45e7-9108-91d59f23ef6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:28.775874 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e802795-f238-45e7-9108-91d59f23ef6c None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:28.787697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 641/1279] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:28.793447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521a284-1e3f-4513-993a-f0a8da9b8b36 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:28.824783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:28.895028 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521a284-1e3f-4513-993a-f0a8da9b8b36 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:28.928810 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d898a-1abc-4d42-a05b-dcdb6b02a08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:28.929654 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d898a-1abc-4d42-a05b-dcdb6b02a08b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:28.929940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d898a-1abc-4d42-a05b-dcdb6b02a08b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:28.930895 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d898a-1abc-4d42-a05b-dcdb6b02a08b None admin] PATH_INFO: `/v3/users/placement` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:28.937566 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d898a-1abc-4d42-a05b-dcdb6b02a08b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:28.939046 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d898a-1abc-4d42-a05b-dcdb6b02a08b None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:28.953974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-2b6d898a-1abc-4d42-a05b-dcdb6b02a08b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 19:42:28.953974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:28.953974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:28.953974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:28.953974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:28.953974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:28.953974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:28.953974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:28.953974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:28.953974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:28.953974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:28.953974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:28.953974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 19:42:28.953974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 19:42:28.953974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 19:42:28.953974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 19:42:28.955099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:28.955099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:28.955099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 19:42:28.955099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:42:28.955099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 19:42:28.955099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 19:42:28.955099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:28.955099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:28.955099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:28.955099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:28.955099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:28.955099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:28.955099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:28.955099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:28.955099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:28.955099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:28.955099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:28.955099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:28.956105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:28.956105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:28.956105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 19:42:28.956105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 19:42:28.956105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 19:42:28.956105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 19:42:28.956105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 19:42:28.956105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 19:42:28.956105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 19:42:28.956105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:28.956105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 639/1280] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:42:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:28.961051 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e802795-f238-45e7-9108-91d59f23ef6c None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:28.964893 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:29.060415 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e802795-f238-45e7-9108-91d59f23ef6c None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:29.094463 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b09aa2-60d2-4aef-89ae-25310ffb9243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:29.095067 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b09aa2-60d2-4aef-89ae-25310ffb9243 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:29.095351 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b09aa2-60d2-4aef-89ae-25310ffb9243 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:29.095630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b09aa2-60d2-4aef-89ae-25310ffb9243 None admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:29.096453 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b09aa2-60d2-4aef-89ae-25310ffb9243 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:29.096764 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b09aa2-60d2-4aef-89ae-25310ffb9243 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:29.098314 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b09aa2-60d2-4aef-89ae-25310ffb9243 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:29.116485 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 642/1281] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Jun 23 19:42:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:29.122490 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d898a-1abc-4d42-a05b-dcdb6b02a08b None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:29.213304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:29.222387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d898a-1abc-4d42-a05b-dcdb6b02a08b None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:29.254348 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7b7f5-745c-4062-a1c8-04db66d1fdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:29.255514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7b7f5-745c-4062-a1c8-04db66d1fdeb None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:29.255798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7b7f5-745c-4062-a1c8-04db66d1fdeb None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:29.256076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7b7f5-745c-4062-a1c8-04db66d1fdeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:29.323019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7b7f5-745c-4062-a1c8-04db66d1fdeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:29.324717 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7b7f5-745c-4062-a1c8-04db66d1fdeb None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:29.429745 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:29.439714 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 640/1282] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 19:42:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 19:42:29.446365 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b09aa2-60d2-4aef-89ae-25310ffb9243 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:29.509812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:29.546744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b09aa2-60d2-4aef-89ae-25310ffb9243 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:29.581017 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6300e-d405-48b9-a0b7-d12d2a9e0ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:29.581818 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6300e-d405-48b9-a0b7-d12d2a9e0ea0 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:29.582101 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6300e-d405-48b9-a0b7-d12d2a9e0ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:29.582374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6300e-d405-48b9-a0b7-d12d2a9e0ea0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:29.592163 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6300e-d405-48b9-a0b7-d12d2a9e0ea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:29.593626 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6300e-d405-48b9-a0b7-d12d2a9e0ea0 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:29.610885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-3ba6300e-d405-48b9-a0b7-d12d2a9e0ea0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:29.610885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:29.610885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:29.610885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:29.610885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:29.610885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:29.610885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:29.610885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:29.610885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:29.610885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:29.610885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:29.610885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:29.610885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 19:42:29.610885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 19:42:29.610885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 19:42:29.611969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 19:42:29.611969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:29.611969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:29.611969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:29.611969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:29.611969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:29.611969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:29.611969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:29.611969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:29.611969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:29.611969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:29.611969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:29.611969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:29.611969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:29.611969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:29.611969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:29.611969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:29.613116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 19:42:29.613116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 19:42:29.613116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 19:42:29.613116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:42:29.613116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 643/1283] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:29.618759 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7b7f5-745c-4062-a1c8-04db66d1fdeb None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:29.722274 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7b7f5-745c-4062-a1c8-04db66d1fdeb None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:29.757131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd88dc-0bbe-47cf-9854-5bde5e407b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:29.757807 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd88dc-0bbe-47cf-9854-5bde5e407b78 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:29.758091 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd88dc-0bbe-47cf-9854-5bde5e407b78 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:29.758369 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd88dc-0bbe-47cf-9854-5bde5e407b78 None admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:29.759085 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd88dc-0bbe-47cf-9854-5bde5e407b78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:29.759391 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd88dc-0bbe-47cf-9854-5bde5e407b78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:29.760761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd88dc-0bbe-47cf-9854-5bde5e407b78 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:29.772026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 641/1284] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 19:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:29.777835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6300e-d405-48b9-a0b7-d12d2a9e0ea0 None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:29.877781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6300e-d405-48b9-a0b7-d12d2a9e0ea0 None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:29.892599 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:29.913510 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49d6f9-8473-4795-940d-877b30eff39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:29.914367 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49d6f9-8473-4795-940d-877b30eff39f None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:29.915522 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49d6f9-8473-4795-940d-877b30eff39f None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:29.915522 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49d6f9-8473-4795-940d-877b30eff39f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:29.921778 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49d6f9-8473-4795-940d-877b30eff39f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:29.923205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49d6f9-8473-4795-940d-877b30eff39f None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:29.937829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application [None req-7b49d6f9-8473-4795-940d-877b30eff39f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:42:29.937829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:29.937829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:29.937829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:29.937829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:29.937829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:29.937829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:29.937829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:29.937829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:29.937829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:29.937829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:29.937829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:29.937829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 19:42:29.937829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 19:42:29.937829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 19:42:29.940900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 19:42:29.940900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:29.940900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:29.940900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:29.940900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:29.940900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:29.940900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:29.940900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:29.940900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:29.940900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:29.940900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:29.940900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:29.940900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:29.940900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:29.940900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:29.940900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:29.940900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:29.942085 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 19:42:29.942085 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 19:42:29.942085 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 19:42:29.942085 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 19:42:29.942085 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 19:42:29.942085 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 19:42:29.942085 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 19:42:29.942085 dv-cinder-847274-2-smb devstack@keystone.service[91966]: ERROR keystone.server.flask.application Jun 23 19:42:29.942085 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 644/1285] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 19:42:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:29.945054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd88dc-0bbe-47cf-9854-5bde5e407b78 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:29.995797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:30.046748 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd88dc-0bbe-47cf-9854-5bde5e407b78 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:30.079917 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a99ad-26d8-4eb8-b98c-3687110d0b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:30.080611 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a99ad-26d8-4eb8-b98c-3687110d0b62 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:30.080908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a99ad-26d8-4eb8-b98c-3687110d0b62 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:30.081213 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a99ad-26d8-4eb8-b98c-3687110d0b62 None admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:30.082009 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a99ad-26d8-4eb8-b98c-3687110d0b62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:30.083570 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a99ad-26d8-4eb8-b98c-3687110d0b62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:30.084493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a99ad-26d8-4eb8-b98c-3687110d0b62 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:30.096289 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 642/1286] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 19:42:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:30.102498 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49d6f9-8473-4795-940d-877b30eff39f None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:30.200556 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49d6f9-8473-4795-940d-877b30eff39f None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:30.234275 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085a52b-d73c-4ff6-9b15-b801358fc1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:30.234911 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085a52b-d73c-4ff6-9b15-b801358fc1ba None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:30.235192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085a52b-d73c-4ff6-9b15-b801358fc1ba None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:30.235466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085a52b-d73c-4ff6-9b15-b801358fc1ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:30.236278 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085a52b-d73c-4ff6-9b15-b801358fc1ba None admin] RBAC: Adding query filter params (role.id=76bd0cf7bf094e4fa3db121b96215004, scope.project.id=368f41dc1ae64e199b604ee72545c88e, user.id=7e9ba6d33e8640ec8dcda9971f59c5dc) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:30.236588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085a52b-d73c-4ff6-9b15-b801358fc1ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:30.238030 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085a52b-d73c-4ff6-9b15-b801358fc1ba None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:30.243846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 645/1287] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 19:42:30 2022] GET /identity/v3/role_assignments?user.id=7e9ba6d33e8640ec8dcda9971f59c5dc&scope.project.id=368f41dc1ae64e199b604ee72545c88e&role.id=76bd0cf7bf094e4fa3db121b96215004 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:32.302261 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690db58-97f2-4bc4-a313-4af608a3930c None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:32.302784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690db58-97f2-4bc4-a313-4af608a3930c None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:32.302784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690db58-97f2-4bc4-a313-4af608a3930c None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:32.304330 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 643/1288] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:42:32.309518 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08723ae5-54cd-49b8-8816-c9df424c6c10 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:32.310028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08723ae5-54cd-49b8-8816-c9df424c6c10 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:32.310123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08723ae5-54cd-49b8-8816-c9df424c6c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:32.327321 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-08723ae5-54cd-49b8-8816-c9df424c6c10 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:42:32.328493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-08723ae5-54cd-49b8-8816-c9df424c6c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:42:32.357977 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:32.396989 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 646/1289] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:42:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:42:32.419377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690db58-97f2-4bc4-a313-4af608a3930c None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:32.523127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690db58-97f2-4bc4-a313-4af608a3930c None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:32.533770 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:32.557354 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb330098-6d4b-4a59-ad9d-082aaf7acc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:32.558083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb330098-6d4b-4a59-ad9d-082aaf7acc3d None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:32.558366 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb330098-6d4b-4a59-ad9d-082aaf7acc3d None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:32.558640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb330098-6d4b-4a59-ad9d-082aaf7acc3d None admin] PATH_INFO: `/v3/services/placement` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:32.559287 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb330098-6d4b-4a59-ad9d-082aaf7acc3d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:32.560655 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb330098-6d4b-4a59-ad9d-082aaf7acc3d None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:32.573210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-bb330098-6d4b-4a59-ad9d-082aaf7acc3d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 19:42:32.573210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:32.573210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:42:32.573210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:42:32.573210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:42:32.573210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:42:32.573210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:42:32.573210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:42:32.573210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 19:42:32.573210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:32.573210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:42:32.573210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:32.573210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:32.573210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:32.573210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:32.573210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:32.573210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:32.574542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:32.574542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:32.574542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:32.574542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:32.574542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:32.574542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:32.574542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:42:32.574542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:42:32.574542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:42:32.574542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:42:32.574542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:32.574542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:32.574542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:32.574542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:32.574542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:32.574542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:32.575467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:32.575467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:32.575467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:32.575467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:32.575467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:32.575467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:32.575467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:32.575467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:32.575467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:32.575467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:32.575467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:42:32.575467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:42:32.575467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 19:42:32.575467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:32.575467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 644/1290] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 23 19:42:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:32.580715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08723ae5-54cd-49b8-8816-c9df424c6c10 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:32.690318 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08723ae5-54cd-49b8-8816-c9df424c6c10 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:32.727374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731d7bc-8cfe-45ac-82c0-01dc07d3876f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:32.728056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731d7bc-8cfe-45ac-82c0-01dc07d3876f None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:32.728343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731d7bc-8cfe-45ac-82c0-01dc07d3876f None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:32.728622 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731d7bc-8cfe-45ac-82c0-01dc07d3876f None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:32.729378 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731d7bc-8cfe-45ac-82c0-01dc07d3876f None admin] RBAC: Adding query filter params (name=placement) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:32.729687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731d7bc-8cfe-45ac-82c0-01dc07d3876f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:32.731087 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731d7bc-8cfe-45ac-82c0-01dc07d3876f None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:32.736698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 647/1291] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Jun 23 19:42:32 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:32.743649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb330098-6d4b-4a59-ad9d-082aaf7acc3d None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:32.853922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb330098-6d4b-4a59-ad9d-082aaf7acc3d None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:32.891308 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21748835-90e0-4ccf-8823-fb219d371aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:32.892086 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21748835-90e0-4ccf-8823-fb219d371aa3 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:32.892378 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21748835-90e0-4ccf-8823-fb219d371aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:32.892662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21748835-90e0-4ccf-8823-fb219d371aa3 None admin] PATH_INFO: `/v3/services` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:32.893429 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21748835-90e0-4ccf-8823-fb219d371aa3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:32.893746 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21748835-90e0-4ccf-8823-fb219d371aa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:32.895229 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21748835-90e0-4ccf-8823-fb219d371aa3 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:32.901430 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 645/1292] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Jun 23 19:42:32 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:34.945589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960b2b1-7c36-47e2-a649-8015fc6a6fa9 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:34.946076 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960b2b1-7c36-47e2-a649-8015fc6a6fa9 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:34.946196 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960b2b1-7c36-47e2-a649-8015fc6a6fa9 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:34.947494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 648/1293] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:42:34.953078 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cd3a1-3b4f-40d3-9388-bd1665f86f7d None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:34.953512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cd3a1-3b4f-40d3-9388-bd1665f86f7d None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:34.955094 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cd3a1-3b4f-40d3-9388-bd1665f86f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:34.970909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-4d8cd3a1-3b4f-40d3-9388-bd1665f86f7d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:42:34.972132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-4d8cd3a1-3b4f-40d3-9388-bd1665f86f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:42:35.001906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:35.046610 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 646/1294] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:42:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:42:35.072258 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960b2b1-7c36-47e2-a649-8015fc6a6fa9 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:35.105037 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:35.175918 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960b2b1-7c36-47e2-a649-8015fc6a6fa9 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:35.212389 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46480fda-fc92-4888-969d-339a82ddbb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:35.213046 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46480fda-fc92-4888-969d-339a82ddbb38 None admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:35.213364 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46480fda-fc92-4888-969d-339a82ddbb38 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:35.213727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46480fda-fc92-4888-969d-339a82ddbb38 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:35.214376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46480fda-fc92-4888-969d-339a82ddbb38 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:35.215733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46480fda-fc92-4888-969d-339a82ddbb38 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:35.315610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 649/1295] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 19:42:35 2022] POST /identity/v3/services => generated 246 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:42:37.401556 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2963b8-acf7-4a71-86fc-4c746fa15844 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:37.402068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2963b8-acf7-4a71-86fc-4c746fa15844 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:37.402160 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2963b8-acf7-4a71-86fc-4c746fa15844 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:37.405566 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 647/1296] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:42:37.408570 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716ec83-45bd-49d4-ae61-7e915ef62326 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:37.408941 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716ec83-45bd-49d4-ae61-7e915ef62326 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:37.409136 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716ec83-45bd-49d4-ae61-7e915ef62326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:37.425957 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-5716ec83-45bd-49d4-ae61-7e915ef62326 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:42:37.427885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-5716ec83-45bd-49d4-ae61-7e915ef62326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:42:37.499086 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 650/1297] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:42:37 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:42:37.522214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2963b8-acf7-4a71-86fc-4c746fa15844 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:37.621976 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2963b8-acf7-4a71-86fc-4c746fa15844 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:37.656010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157340ff-1068-4a09-95ad-b2d4ad5ff7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:37.656731 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157340ff-1068-4a09-95ad-b2d4ad5ff7e1 None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:37.657024 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157340ff-1068-4a09-95ad-b2d4ad5ff7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:37.657338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157340ff-1068-4a09-95ad-b2d4ad5ff7e1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:37.657993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157340ff-1068-4a09-95ad-b2d4ad5ff7e1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:37.659363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157340ff-1068-4a09-95ad-b2d4ad5ff7e1 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:37.671201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-157340ff-1068-4a09-95ad-b2d4ad5ff7e1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 19:42:37.671201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:37.671201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:42:37.671201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:42:37.671201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:42:37.671201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:42:37.671201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:42:37.671201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:42:37.671201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 19:42:37.671201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:37.671201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:42:37.671201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:37.671201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:37.671201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:37.671201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:37.671201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:37.671201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:37.672393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:37.672393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:37.672393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:37.672393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:37.672393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:37.672393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:37.672393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:42:37.672393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:42:37.672393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:42:37.672393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:42:37.672393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:37.672393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:37.672393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:37.672393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:37.672393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:37.672393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:37.673329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:37.673329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:37.673329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:37.673329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:37.673329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:37.673329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:37.673329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:37.673329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:37.673329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:37.673329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:37.673329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:42:37.673329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:42:37.673329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 19:42:37.673329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:37.673329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 648/1298] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 23 19:42:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:37.678559 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716ec83-45bd-49d4-ae61-7e915ef62326 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:37.697040 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:37.775337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716ec83-45bd-49d4-ae61-7e915ef62326 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:37.809922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2fc56-3df2-483b-b076-8a4cd125c8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:37.811006 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2fc56-3df2-483b-b076-8a4cd125c8cd None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:37.811325 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2fc56-3df2-483b-b076-8a4cd125c8cd None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:37.811769 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2fc56-3df2-483b-b076-8a4cd125c8cd None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:37.813119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2fc56-3df2-483b-b076-8a4cd125c8cd None admin] RBAC: Adding query filter params (name=placement) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:37.813457 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2fc56-3df2-483b-b076-8a4cd125c8cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:37.814825 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2fc56-3df2-483b-b076-8a4cd125c8cd None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:37.820582 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 651/1299] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Jun 23 19:42:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:37.826912 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157340ff-1068-4a09-95ad-b2d4ad5ff7e1 None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:37.858009 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:37.927470 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157340ff-1068-4a09-95ad-b2d4ad5ff7e1 None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:37.960732 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915478d9-85d9-4e4f-9cf9-a258fc4c7a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:37.961399 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915478d9-85d9-4e4f-9cf9-a258fc4c7a4b None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:37.961682 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915478d9-85d9-4e4f-9cf9-a258fc4c7a4b None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:37.961957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915478d9-85d9-4e4f-9cf9-a258fc4c7a4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:37.962740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915478d9-85d9-4e4f-9cf9-a258fc4c7a4b None admin] RBAC: Adding query filter params (interface=public, service_id=805e6c6af9a643d18b83d430b909b6c3, region_id=RegionOne) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:37.963049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915478d9-85d9-4e4f-9cf9-a258fc4c7a4b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:37.964405 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915478d9-85d9-4e4f-9cf9-a258fc4c7a4b None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:37.969352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 649/1300] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 23 19:42:37 2022] GET /identity/v3/endpoints?service_id=805e6c6af9a643d18b83d430b909b6c3&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:37.975104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2fc56-3df2-483b-b076-8a4cd125c8cd None admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:38.055086 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:38.072670 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2fc56-3df2-483b-b076-8a4cd125c8cd None admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:38.105631 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78a3de-1388-4a6a-abea-f2aae39a3248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:38.106293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78a3de-1388-4a6a-abea-f2aae39a3248 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:38.106576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78a3de-1388-4a6a-abea-f2aae39a3248 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:38.106853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78a3de-1388-4a6a-abea-f2aae39a3248 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:38.107539 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78a3de-1388-4a6a-abea-f2aae39a3248 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:38.108901 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78a3de-1388-4a6a-abea-f2aae39a3248 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:38.116283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 652/1301] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 23 19:42:37 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:42:40.132379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4c393-5a96-4b7f-bd80-730e34909f58 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:40.132906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4c393-5a96-4b7f-bd80-730e34909f58 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:40.133091 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4c393-5a96-4b7f-bd80-730e34909f58 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:40.135586 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 650/1302] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:42:40.139954 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086fdc-9ee6-442d-bf19-a6542cb9aaa1 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:40.140366 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086fdc-9ee6-442d-bf19-a6542cb9aaa1 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:40.140527 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086fdc-9ee6-442d-bf19-a6542cb9aaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:40.156922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-6e086fdc-9ee6-442d-bf19-a6542cb9aaa1 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:42:40.158056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-6e086fdc-9ee6-442d-bf19-a6542cb9aaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:42:40.227222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 653/1303] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:42:40 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 19:42:40.250474 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4c393-5a96-4b7f-bd80-730e34909f58 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:40.353055 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:40.359598 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4c393-5a96-4b7f-bd80-730e34909f58 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:40.392804 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b50d5-1d5c-410b-b293-0a7c0c832e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:40.393614 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b50d5-1d5c-410b-b293-0a7c0c832e9f None admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:40.393897 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b50d5-1d5c-410b-b293-0a7c0c832e9f None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:40.394170 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b50d5-1d5c-410b-b293-0a7c0c832e9f None admin] PATH_INFO: `/v3/services/placement` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:40.394814 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b50d5-1d5c-410b-b293-0a7c0c832e9f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:40.396680 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b50d5-1d5c-410b-b293-0a7c0c832e9f None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:40.408708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application [None req-817b50d5-1d5c-410b-b293-0a7c0c832e9f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 19:42:40.408708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:40.408708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 19:42:40.408708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 19:42:40.408708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 19:42:40.408708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 19:42:40.408708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 19:42:40.408708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:42:40.408708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 19:42:40.408708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:40.408708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 19:42:40.408708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:40.408708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 19:42:40.408708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 19:42:40.408708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 19:42:40.408708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 19:42:40.408708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 19:42:40.409963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 19:42:40.409963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 19:42:40.409963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 19:42:40.409963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 19:42:40.409963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 19:42:40.409963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 19:42:40.409963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 19:42:40.409963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 19:42:40.409963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 19:42:40.409963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 19:42:40.409963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 19:42:40.409963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 19:42:40.409963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 19:42:40.409963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 19:42:40.409963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 19:42:40.409963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 19:42:40.411579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 19:42:40.411579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application with Lock( Jun 23 19:42:40.411579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 19:42:40.411579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self._enter() Jun 23 19:42:40.411579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 19:42:40.411579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 19:42:40.411579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 19:42:40.411579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application return self.creator() Jun 23 19:42:40.411579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 19:42:40.411579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application created_value = creator( Jun 23 19:42:40.411579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 19:42:40.411579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 19:42:40.411579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 19:42:40.411579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: ERROR keystone.server.flask.application Jun 23 19:42:40.411579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 651/1304] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 23 19:42:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 19:42:40.416684 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e086fdc-9ee6-442d-bf19-a6542cb9aaa1 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:40.492306 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:40.513523 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e086fdc-9ee6-442d-bf19-a6542cb9aaa1 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:40.546687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c093af3-c600-4835-81ba-7f6fecc48481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:40.547341 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c093af3-c600-4835-81ba-7f6fecc48481 None admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:40.547627 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c093af3-c600-4835-81ba-7f6fecc48481 None admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:40.547924 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c093af3-c600-4835-81ba-7f6fecc48481 None admin] PATH_INFO: `/v3/services` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:40.548603 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c093af3-c600-4835-81ba-7f6fecc48481 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:42:40.548909 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c093af3-c600-4835-81ba-7f6fecc48481 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:40.550351 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c093af3-c600-4835-81ba-7f6fecc48481 None admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:40.555906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 654/1305] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Jun 23 19:42:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:42:40.561696 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b50d5-1d5c-410b-b293-0a7c0c832e9f None admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:42:40.658654 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b50d5-1d5c-410b-b293-0a7c0c832e9f None admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:42:40.693557 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990e4cc-46e0-42f6-8f9a-d9371d1c6071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:42:40.694125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990e4cc-46e0-42f6-8f9a-d9371d1c6071 None admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:42:40.694407 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990e4cc-46e0-42f6-8f9a-d9371d1c6071 None admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:42:40.694685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990e4cc-46e0-42f6-8f9a-d9371d1c6071 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:42:40.695421 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990e4cc-46e0-42f6-8f9a-d9371d1c6071 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:42:40.696780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990e4cc-46e0-42f6-8f9a-d9371d1c6071 None admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:42:40.796206 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 652/1306] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 23 19:42:40 2022] POST /identity/v3/endpoints => generated 331 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:42:50.562717 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=30 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:42:50.791727 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:48:54.683623 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e72e3-3388-49ba-8edd-df0d77666f86 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:48:54.684201 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e72e3-3388-49ba-8edd-df0d77666f86 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:48:54.684201 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e72e3-3388-49ba-8edd-df0d77666f86 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:48:54.685877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 655/1307] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:48:54.691665 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d1de4-977b-4f38-904f-b56382d10acd None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:48:54.692112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d1de4-977b-4f38-904f-b56382d10acd None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:48:54.692333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d1de4-977b-4f38-904f-b56382d10acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:48:54.783870 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-936d1de4-977b-4f38-904f-b56382d10acd None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:48:54.785521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-936d1de4-977b-4f38-904f-b56382d10acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:48:54.935991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 653/1308] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:48:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:48:54.989373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea39f5f-beb8-4751-830c-ed9bafdc5891 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:48:54.989373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea39f5f-beb8-4751-830c-ed9bafdc5891 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:48:54.989373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea39f5f-beb8-4751-830c-ed9bafdc5891 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:48:54.989373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 656/1309] 10.222.0.13 () {54 vars in 964 bytes} [Thu Jun 23 19:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:48:54.993910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341692f3-91f5-4749-a677-084f74977b10 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:48:54.994205 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341692f3-91f5-4749-a677-084f74977b10 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:48:54.994489 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341692f3-91f5-4749-a677-084f74977b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:48:55.109737 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-341692f3-91f5-4749-a677-084f74977b10 None None] MFA Rules not processed for user `24bb6f31e87045f5b17f561b42edca6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:48:55.110987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-341692f3-91f5-4749-a677-084f74977b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:48:55.142129 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:48:55.200904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 654/1310] 10.222.0.13 () {58 vars in 1061 bytes} [Thu Jun 23 19:48:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:48:55.211164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea39f5f-beb8-4751-830c-ed9bafdc5891 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:48:55.212977 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-8ea39f5f-beb8-4751-830c-ed9bafdc5891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:48:55.337041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea39f5f-beb8-4751-830c-ed9bafdc5891 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:48:55.411763 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03378e93-0e5c-4c5a-8a58-688b2b226502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:48:55.412953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03378e93-0e5c-4c5a-8a58-688b2b226502 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:48:55.413269 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03378e93-0e5c-4c5a-8a58-688b2b226502 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:48:55.413552 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03378e93-0e5c-4c5a-8a58-688b2b226502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:48:55.415292 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-03378e93-0e5c-4c5a-8a58-688b2b226502 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:48:55.470476 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:48:55.527197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03378e93-0e5c-4c5a-8a58-688b2b226502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:48:55.528748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03378e93-0e5c-4c5a-8a58-688b2b226502 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:48:55.548693 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 657/1311] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:48:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:48:57.956579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26565e20-76f9-4d2b-af96-faf654b5abbe None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:48:57.957203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26565e20-76f9-4d2b-af96-faf654b5abbe None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:48:57.957203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26565e20-76f9-4d2b-af96-faf654b5abbe None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:48:57.958686 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 655/1312] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:48:57.963827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff705b4-08c6-4036-8110-13074ebc9ca6 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:48:57.964253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff705b4-08c6-4036-8110-13074ebc9ca6 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:48:57.964472 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff705b4-08c6-4036-8110-13074ebc9ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:48:58.048133 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-1ff705b4-08c6-4036-8110-13074ebc9ca6 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:48:58.049387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-1ff705b4-08c6-4036-8110-13074ebc9ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:48:58.156681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 658/1313] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:48:58.195731 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26565e20-76f9-4d2b-af96-faf654b5abbe None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:48:58.197506 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-26565e20-76f9-4d2b-af96-faf654b5abbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:48:58.313591 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26565e20-76f9-4d2b-af96-faf654b5abbe None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:48:58.396436 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:48:58.399932 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ca8ad-858e-42db-966f-b7c02d150d03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:48:58.400601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ca8ad-858e-42db-966f-b7c02d150d03 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:48:58.400888 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ca8ad-858e-42db-966f-b7c02d150d03 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:48:58.401191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ca8ad-858e-42db-966f-b7c02d150d03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:48:58.402908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-539ca8ad-858e-42db-966f-b7c02d150d03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:48:58.531524 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ca8ad-858e-42db-966f-b7c02d150d03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:48:58.532989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ca8ad-858e-42db-966f-b7c02d150d03 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:48:58.554939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 656/1314] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:48:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:49:01.130253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0aede7-a1c2-4f2b-b680-e3362fedfa3d None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:01.131291 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0aede7-a1c2-4f2b-b680-e3362fedfa3d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:01.131291 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0aede7-a1c2-4f2b-b680-e3362fedfa3d None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:01.132601 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 659/1315] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:49:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:01.137683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cc44a-59cc-4f4b-a560-ce1c672ebc15 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:01.138078 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cc44a-59cc-4f4b-a560-ce1c672ebc15 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:01.138249 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cc44a-59cc-4f4b-a560-ce1c672ebc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:01.200771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-ed5cc44a-59cc-4f4b-a560-ce1c672ebc15 None None] MFA Rules not processed for user `c75ee1380a57446ab1c1e588bd5bfa97`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:01.201993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ed5cc44a-59cc-4f4b-a560-ce1c672ebc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:01.253533 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:01.297111 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 657/1316] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:49:01 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:49:01.338011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0aede7-a1c2-4f2b-b680-e3362fedfa3d None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:49:01.339537 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-0c0aede7-a1c2-4f2b-b680-e3362fedfa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:01.349114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:01.444933 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0aede7-a1c2-4f2b-b680-e3362fedfa3d None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:49:01.517922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea688b-904a-44bc-bc21-e05542a1c371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:49:01.518571 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea688b-904a-44bc-bc21-e05542a1c371 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:01.518859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea688b-904a-44bc-bc21-e05542a1c371 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:01.519140 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea688b-904a-44bc-bc21-e05542a1c371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:01.520844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-4eea688b-904a-44bc-bc21-e05542a1c371 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:01.582873 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:01.627300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea688b-904a-44bc-bc21-e05542a1c371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:49:01.628723 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea688b-904a-44bc-bc21-e05542a1c371 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:49:01.647148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 660/1317] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:49:01 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:49:04.508965 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f45ca-51d0-4229-ac9a-8b30671d62a9 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:04.509643 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f45ca-51d0-4229-ac9a-8b30671d62a9 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:04.509643 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f45ca-51d0-4229-ac9a-8b30671d62a9 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:04.510906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 658/1318] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:04.516118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de26f3c-7310-4795-8eb8-7f1f37f327f6 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:04.516550 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de26f3c-7310-4795-8eb8-7f1f37f327f6 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:04.516662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de26f3c-7310-4795-8eb8-7f1f37f327f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:04.581920 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-8de26f3c-7310-4795-8eb8-7f1f37f327f6 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:04.583136 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-8de26f3c-7310-4795-8eb8-7f1f37f327f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:04.676449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 661/1319] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:49:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:49:04.716100 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f45ca-51d0-4229-ac9a-8b30671d62a9 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:49:04.717658 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-643f45ca-51d0-4229-ac9a-8b30671d62a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:04.818255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f45ca-51d0-4229-ac9a-8b30671d62a9 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:49:04.890567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fbdb2-b6d4-4616-94b9-b8ea881f7dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:49:04.891219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fbdb2-b6d4-4616-94b9-b8ea881f7dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:04.891505 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fbdb2-b6d4-4616-94b9-b8ea881f7dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:04.891785 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fbdb2-b6d4-4616-94b9-b8ea881f7dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:04.893457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-763fbdb2-b6d4-4616-94b9-b8ea881f7dc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:04.901570 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:05.000840 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763fbdb2-b6d4-4616-94b9-b8ea881f7dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:49:05.002354 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763fbdb2-b6d4-4616-94b9-b8ea881f7dc4 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:49:05.020290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 659/1320] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:49:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:49:08.214658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b80f2-cb07-46f1-8eac-2d1a4bb9a46a None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:08.215166 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b80f2-cb07-46f1-8eac-2d1a4bb9a46a None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:08.215166 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b80f2-cb07-46f1-8eac-2d1a4bb9a46a None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:08.216567 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 662/1321] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:08.221711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d1dc8-3eaa-40c5-bad8-b5d8481c462d None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:08.222158 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d1dc8-3eaa-40c5-bad8-b5d8481c462d None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:08.222257 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d1dc8-3eaa-40c5-bad8-b5d8481c462d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:08.289572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-191d1dc8-3eaa-40c5-bad8-b5d8481c462d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:08.291128 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-191d1dc8-3eaa-40c5-bad8-b5d8481c462d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:08.352384 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:08.395824 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 660/1322] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:49:08.448423 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec54ee-1509-416e-b6b4-71f424aa968b None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:08.452490 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec54ee-1509-416e-b6b4-71f424aa968b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:08.452490 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec54ee-1509-416e-b6b4-71f424aa968b None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:08.452490 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 663/1323] 10.222.0.13 () {54 vars in 964 bytes} [Thu Jun 23 19:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:08.457204 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cb3b6-5bd8-43cf-b04d-ff7cbe163546 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:08.457505 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cb3b6-5bd8-43cf-b04d-ff7cbe163546 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:08.457792 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cb3b6-5bd8-43cf-b04d-ff7cbe163546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:08.541724 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-819cb3b6-5bd8-43cf-b04d-ff7cbe163546 None None] MFA Rules not processed for user `24bb6f31e87045f5b17f561b42edca6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:08.542976 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-819cb3b6-5bd8-43cf-b04d-ff7cbe163546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:08.622010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 661/1324] 10.222.0.13 () {58 vars in 1061 bytes} [Thu Jun 23 19:49:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:49:08.631167 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec54ee-1509-416e-b6b4-71f424aa968b None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:49:08.632697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-41ec54ee-1509-416e-b6b4-71f424aa968b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:08.652253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:08.739105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec54ee-1509-416e-b6b4-71f424aa968b None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:49:08.813378 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97404f7f-90bb-4696-9ed2-84fffcd61698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:49:08.813925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97404f7f-90bb-4696-9ed2-84fffcd61698 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:08.814213 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97404f7f-90bb-4696-9ed2-84fffcd61698 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:08.814493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97404f7f-90bb-4696-9ed2-84fffcd61698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:08.816158 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-97404f7f-90bb-4696-9ed2-84fffcd61698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:08.888430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:08.927242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97404f7f-90bb-4696-9ed2-84fffcd61698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:49:08.929337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97404f7f-90bb-4696-9ed2-84fffcd61698 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:49:08.947651 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 664/1325] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:49:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:49:11.263532 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185eae5-31f2-408d-a53d-c9c15ce75147 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:11.264096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185eae5-31f2-408d-a53d-c9c15ce75147 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:11.264096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185eae5-31f2-408d-a53d-c9c15ce75147 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:11.265490 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 662/1326] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:11.270904 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b341c4f-da6c-4d58-8857-0be9028bab48 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:11.271506 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b341c4f-da6c-4d58-8857-0be9028bab48 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:11.271693 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b341c4f-da6c-4d58-8857-0be9028bab48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:11.342238 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-3b341c4f-da6c-4d58-8857-0be9028bab48 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:11.343448 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-3b341c4f-da6c-4d58-8857-0be9028bab48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:11.442362 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 665/1327] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:49:11.483549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185eae5-31f2-408d-a53d-c9c15ce75147 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:49:11.489440 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0185eae5-31f2-408d-a53d-c9c15ce75147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:11.548989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:11.592907 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185eae5-31f2-408d-a53d-c9c15ce75147 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:49:11.668435 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703576ba-1cad-4763-b7c6-5fd448740b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:49:11.669097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703576ba-1cad-4763-b7c6-5fd448740b6f service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:11.669416 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703576ba-1cad-4763-b7c6-5fd448740b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:11.669697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703576ba-1cad-4763-b7c6-5fd448740b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:11.671343 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-703576ba-1cad-4763-b7c6-5fd448740b6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:11.777979 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:11.780308 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703576ba-1cad-4763-b7c6-5fd448740b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:49:11.781792 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703576ba-1cad-4763-b7c6-5fd448740b6f service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:49:11.799911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 663/1328] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:49:13.895049 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb64c96-01b8-4a8d-9709-7d645f852e54 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:13.895595 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb64c96-01b8-4a8d-9709-7d645f852e54 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:13.895595 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb64c96-01b8-4a8d-9709-7d645f852e54 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:13.897756 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 666/1329] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:49:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:13.903096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae623331-9b94-49d2-9618-efef4ee459d4 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:13.903540 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae623331-9b94-49d2-9618-efef4ee459d4 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:13.903669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae623331-9b94-49d2-9618-efef4ee459d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:13.972428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-ae623331-9b94-49d2-9618-efef4ee459d4 None None] MFA Rules not processed for user `c75ee1380a57446ab1c1e588bd5bfa97`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:13.973653 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ae623331-9b94-49d2-9618-efef4ee459d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:14.080175 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 664/1330] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:49:13 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:49:14.119103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb64c96-01b8-4a8d-9709-7d645f852e54 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:49:14.120573 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-9bb64c96-01b8-4a8d-9709-7d645f852e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:14.154497 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:14.231589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb64c96-01b8-4a8d-9709-7d645f852e54 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:49:14.304852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd503a-35a8-4808-b0b7-aea1b16668e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:49:14.305530 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd503a-35a8-4808-b0b7-aea1b16668e6 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:14.305817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd503a-35a8-4808-b0b7-aea1b16668e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:14.306097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd503a-35a8-4808-b0b7-aea1b16668e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:14.307725 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-c4fd503a-35a8-4808-b0b7-aea1b16668e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:14.385756 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:14.416124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd503a-35a8-4808-b0b7-aea1b16668e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:49:14.417558 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd503a-35a8-4808-b0b7-aea1b16668e6 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:49:14.436213 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 667/1331] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:49:14 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:49:16.995594 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83563f-9838-4fbd-b8e3-ea91d17b05c8 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:16.996098 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83563f-9838-4fbd-b8e3-ea91d17b05c8 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:16.996098 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83563f-9838-4fbd-b8e3-ea91d17b05c8 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:16.997475 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 665/1332] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:17.002696 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11073e-61ba-4dc7-a142-0bc5abf227a7 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:17.003080 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11073e-61ba-4dc7-a142-0bc5abf227a7 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:17.003284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11073e-61ba-4dc7-a142-0bc5abf227a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:17.067539 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-6b11073e-61ba-4dc7-a142-0bc5abf227a7 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:17.069743 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-6b11073e-61ba-4dc7-a142-0bc5abf227a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:17.164842 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 668/1333] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:49:17.200302 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83563f-9838-4fbd-b8e3-ea91d17b05c8 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:49:17.201872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0f83563f-9838-4fbd-b8e3-ea91d17b05c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:17.270703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:17.304963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83563f-9838-4fbd-b8e3-ea91d17b05c8 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:49:17.377395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b3c2d-6308-47f0-bb29-421d524c2c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:49:17.378043 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b3c2d-6308-47f0-bb29-421d524c2c95 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:17.378329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b3c2d-6308-47f0-bb29-421d524c2c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:17.378605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b3c2d-6308-47f0-bb29-421d524c2c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:17.380240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-691b3c2d-6308-47f0-bb29-421d524c2c95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:17.486303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b3c2d-6308-47f0-bb29-421d524c2c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:49:17.487733 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b3c2d-6308-47f0-bb29-421d524c2c95 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:49:17.498209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:17.506938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 666/1334] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:49:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:49:19.628430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbbde8-2d69-47ce-8ac3-192ee221e406 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:19.628998 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbbde8-2d69-47ce-8ac3-192ee221e406 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:19.628998 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbbde8-2d69-47ce-8ac3-192ee221e406 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:19.630416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 669/1335] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:19.635924 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc259ce4-b9a9-46f5-8725-c42e6cb2b6e3 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:19.636334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc259ce4-b9a9-46f5-8725-c42e6cb2b6e3 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:19.636480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc259ce4-b9a9-46f5-8725-c42e6cb2b6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:19.700564 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-bc259ce4-b9a9-46f5-8725-c42e6cb2b6e3 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:19.701789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-bc259ce4-b9a9-46f5-8725-c42e6cb2b6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:19.797544 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 667/1336] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:49:19.838932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbbde8-2d69-47ce-8ac3-192ee221e406 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:49:19.840482 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-b3dbbde8-2d69-47ce-8ac3-192ee221e406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:19.881466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:19.945357 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbbde8-2d69-47ce-8ac3-192ee221e406 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:49:20.016268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4cd3a-2ca6-410a-9efc-3c2f7ef11368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:49:20.016902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4cd3a-2ca6-410a-9efc-3c2f7ef11368 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:20.017209 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4cd3a-2ca6-410a-9efc-3c2f7ef11368 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:20.017493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4cd3a-2ca6-410a-9efc-3c2f7ef11368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:20.019122 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-1cc4cd3a-2ca6-410a-9efc-3c2f7ef11368 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:20.102290 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:20.126916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4cd3a-2ca6-410a-9efc-3c2f7ef11368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:49:20.128344 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4cd3a-2ca6-410a-9efc-3c2f7ef11368 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:49:20.147398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 670/1337] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:49:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:49:22.850829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed62d1-0735-4076-a800-1eaec8e7a927 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:22.851353 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed62d1-0735-4076-a800-1eaec8e7a927 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:22.851353 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed62d1-0735-4076-a800-1eaec8e7a927 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:22.852736 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 668/1338] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:49:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:22.857859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f924a-2e52-4f08-bcd9-6ecc333275e2 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:22.858284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f924a-2e52-4f08-bcd9-6ecc333275e2 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:22.858419 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f924a-2e52-4f08-bcd9-6ecc333275e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:22.924504 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-c57f924a-2e52-4f08-bcd9-6ecc333275e2 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:22.925730 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-c57f924a-2e52-4f08-bcd9-6ecc333275e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:23.020045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 671/1339] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:49:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:49:23.056891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed62d1-0735-4076-a800-1eaec8e7a927 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:49:23.058451 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-60ed62d1-0735-4076-a800-1eaec8e7a927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:23.133746 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:23.160190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed62d1-0735-4076-a800-1eaec8e7a927 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:49:23.233378 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48b6d8-e758-442e-be2f-63e8d0b0f0c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:49:23.234026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48b6d8-e758-442e-be2f-63e8d0b0f0c7 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:23.234308 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48b6d8-e758-442e-be2f-63e8d0b0f0c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:23.234584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48b6d8-e758-442e-be2f-63e8d0b0f0c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:23.236201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0c48b6d8-e758-442e-be2f-63e8d0b0f0c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:23.342346 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48b6d8-e758-442e-be2f-63e8d0b0f0c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:49:23.343742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48b6d8-e758-442e-be2f-63e8d0b0f0c7 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:49:23.362216 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 669/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:49:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:49:27.546897 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f15a3-e1fe-4f8e-a459-4f7a0d847925 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:27.547379 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f15a3-e1fe-4f8e-a459-4f7a0d847925 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:27.547494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f15a3-e1fe-4f8e-a459-4f7a0d847925 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:27.549017 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 672/1341] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:27.554389 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61cf62-0528-4804-9e5f-b7f3fda509e8 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:27.554826 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61cf62-0528-4804-9e5f-b7f3fda509e8 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:27.554954 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61cf62-0528-4804-9e5f-b7f3fda509e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:27.561081 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:27.629386 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-1d61cf62-0528-4804-9e5f-b7f3fda509e8 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:27.631124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-1d61cf62-0528-4804-9e5f-b7f3fda509e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:27.745191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 670/1342] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:49:27.780554 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f15a3-e1fe-4f8e-a459-4f7a0d847925 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:49:27.782861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ff4f15a3-e1fe-4f8e-a459-4f7a0d847925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:27.833856 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:27.881147 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f15a3-e1fe-4f8e-a459-4f7a0d847925 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:49:27.885438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446f41a-5a49-47a8-a1d2-435cdd138bb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:49:27.886092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446f41a-5a49-47a8-a1d2-435cdd138bb9 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:27.886376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446f41a-5a49-47a8-a1d2-435cdd138bb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:27.886655 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446f41a-5a49-47a8-a1d2-435cdd138bb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:27.897111 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446f41a-5a49-47a8-a1d2-435cdd138bb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:49:27.898805 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446f41a-5a49-47a8-a1d2-435cdd138bb9 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:49:27.909502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 673/1343] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:49:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:49:31.029147 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e4bda-f464-464e-8b4e-28e23bffdab2 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:31.029748 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e4bda-f464-464e-8b4e-28e23bffdab2 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:31.029748 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e4bda-f464-464e-8b4e-28e23bffdab2 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:31.031045 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 671/1344] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:31.036707 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ff200-d5a6-4e76-ab8f-7d7366be3c3b None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:31.038403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ff200-d5a6-4e76-ab8f-7d7366be3c3b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:31.038403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ff200-d5a6-4e76-ab8f-7d7366be3c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:31.067691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-378ff200-d5a6-4e76-ab8f-7d7366be3c3b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:31.069025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-378ff200-d5a6-4e76-ab8f-7d7366be3c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:31.153909 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 674/1345] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:49:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:49:31.201430 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e4bda-f464-464e-8b4e-28e23bffdab2 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:49:31.213312 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e4bda-f464-464e-8b4e-28e23bffdab2 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:49:31.216735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44ebfc-eaca-4f8b-bd50-263242256244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:49:31.217514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44ebfc-eaca-4f8b-bd50-263242256244 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:31.217801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44ebfc-eaca-4f8b-bd50-263242256244 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:31.218079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44ebfc-eaca-4f8b-bd50-263242256244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:31.227564 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44ebfc-eaca-4f8b-bd50-263242256244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:49:31.229001 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44ebfc-eaca-4f8b-bd50-263242256244 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:49:31.238511 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 672/1346] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:49:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:49:35.502137 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd1c8a-3cd1-49da-868f-f63944185173 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:35.502625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd1c8a-3cd1-49da-868f-f63944185173 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:35.502718 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd1c8a-3cd1-49da-868f-f63944185173 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:35.504071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 675/1347] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:35.509972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d7ca3-54ba-49b0-a8cf-fd1a1e6c4623 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:35.510442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d7ca3-54ba-49b0-a8cf-fd1a1e6c4623 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:35.510548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d7ca3-54ba-49b0-a8cf-fd1a1e6c4623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:35.528092 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-c50d7ca3-54ba-49b0-a8cf-fd1a1e6c4623 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:35.529331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c50d7ca3-54ba-49b0-a8cf-fd1a1e6c4623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:35.537462 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 673/1348] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:49:35.576159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd1c8a-3cd1-49da-868f-f63944185173 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:49:35.577981 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-06cd1c8a-3cd1-49da-868f-f63944185173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:35.593198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd1c8a-3cd1-49da-868f-f63944185173 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:49:35.596643 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a86c80-5706-45d3-93ac-1082e197feb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:49:35.597315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a86c80-5706-45d3-93ac-1082e197feb9 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:35.597603 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a86c80-5706-45d3-93ac-1082e197feb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:35.597881 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a86c80-5706-45d3-93ac-1082e197feb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:35.607450 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a86c80-5706-45d3-93ac-1082e197feb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:49:35.608888 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a86c80-5706-45d3-93ac-1082e197feb9 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:49:35.619457 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 676/1349] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:49:40.786252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ce9ea-6b32-4db4-aefd-675c62ced361 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:40.787471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ce9ea-6b32-4db4-aefd-675c62ced361 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:40.787991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ce9ea-6b32-4db4-aefd-675c62ced361 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:40.789965 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 674/1350] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 19:49:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:40.794643 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc754cb-9f25-4fb3-bace-2535aad0bae8 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:40.795039 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc754cb-9f25-4fb3-bace-2535aad0bae8 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:40.795204 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc754cb-9f25-4fb3-bace-2535aad0bae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:40.867155 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-1fc754cb-9f25-4fb3-bace-2535aad0bae8 None None] MFA Rules not processed for user `7e9ba6d33e8640ec8dcda9971f59c5dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:40.868574 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-1fc754cb-9f25-4fb3-bace-2535aad0bae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:40.898254 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:40.971991 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 677/1351] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 19:49:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:49:45.320431 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dde8d-ed2d-4689-9326-bd339e7b6c8e None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:45.320928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dde8d-ed2d-4689-9326-bd339e7b6c8e None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:45.320928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dde8d-ed2d-4689-9326-bd339e7b6c8e None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:45.322153 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 675/1352] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 19:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:45.329451 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57c24d-3f4f-4906-aa39-ddb304143eb0 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:45.330310 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57c24d-3f4f-4906-aa39-ddb304143eb0 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:45.330928 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57c24d-3f4f-4906-aa39-ddb304143eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:45.351628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-9c57c24d-3f4f-4906-aa39-ddb304143eb0 None None] MFA Rules not processed for user `7e9ba6d33e8640ec8dcda9971f59c5dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:45.353139 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-9c57c24d-3f4f-4906-aa39-ddb304143eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:45.362568 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 678/1353] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 19:49:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:49:45.523051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=72 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:47.042258 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0d173-f7ac-41d7-8747-8a26f7831949 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:47.042883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0d173-f7ac-41d7-8747-8a26f7831949 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:47.042883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0d173-f7ac-41d7-8747-8a26f7831949 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:47.044151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 676/1354] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 19:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:47.049003 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4cbe3-d4bf-4969-883b-0226361ffe22 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:47.049477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4cbe3-d4bf-4969-883b-0226361ffe22 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:47.049621 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4cbe3-d4bf-4969-883b-0226361ffe22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:47.068190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-98f4cbe3-d4bf-4969-883b-0226361ffe22 None None] MFA Rules not processed for user `7e9ba6d33e8640ec8dcda9971f59c5dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:47.069425 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-98f4cbe3-d4bf-4969-883b-0226361ffe22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:47.078321 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 679/1355] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 19:49:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:49:50.734727 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab191e60-acd2-419e-a0ed-b51c9c504941 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:50.735251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab191e60-acd2-419e-a0ed-b51c9c504941 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:50.735251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab191e60-acd2-419e-a0ed-b51c9c504941 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:50.738138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 677/1356] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:50.742381 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33621c82-9dce-44c0-92a8-08ff1d40fe12 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:50.742871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33621c82-9dce-44c0-92a8-08ff1d40fe12 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:50.742969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33621c82-9dce-44c0-92a8-08ff1d40fe12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:50.765030 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-33621c82-9dce-44c0-92a8-08ff1d40fe12 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:50.766736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-33621c82-9dce-44c0-92a8-08ff1d40fe12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:50.776733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 680/1357] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:49:50.832233 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e795ce-0cc1-4a1c-a151-279b1da7e584 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:50.832717 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e795ce-0cc1-4a1c-a151-279b1da7e584 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:50.833149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e795ce-0cc1-4a1c-a151-279b1da7e584 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:50.835468 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 678/1358] 10.222.0.13 () {54 vars in 961 bytes} [Thu Jun 23 19:49:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:50.845416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1aa5b8-c40c-49b1-a714-9346bef16bd3 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:50.846150 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1aa5b8-c40c-49b1-a714-9346bef16bd3 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:50.846727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1aa5b8-c40c-49b1-a714-9346bef16bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:50.904919 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-5e1aa5b8-c40c-49b1-a714-9346bef16bd3 None None] MFA Rules not processed for user `83bff5cd7782423eaa0bc5b29b208ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:50.906138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-5e1aa5b8-c40c-49b1-a714-9346bef16bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:51.011666 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 681/1359] 10.222.0.13 () {58 vars in 1058 bytes} [Thu Jun 23 19:49:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:49:51.012316 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e795ce-0cc1-4a1c-a151-279b1da7e584 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:49:51.027845 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e795ce-0cc1-4a1c-a151-279b1da7e584 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:49:51.034088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cb852-b005-4682-be60-7a467fee64c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:49:51.035089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cb852-b005-4682-be60-7a467fee64c3 service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:51.035557 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cb852-b005-4682-be60-7a467fee64c3 service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:51.035843 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cb852-b005-4682-be60-7a467fee64c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:51.044849 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cb852-b005-4682-be60-7a467fee64c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:49:51.046486 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cb852-b005-4682-be60-7a467fee64c3 service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:49:51.058583 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 679/1360] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:49:53.328646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d883862-a328-4304-be27-844c077a531f None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:53.329301 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d883862-a328-4304-be27-844c077a531f None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:53.329301 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d883862-a328-4304-be27-844c077a531f None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:53.331022 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 682/1361] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:53.336564 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b56e0-8340-4777-878a-a70d1d3e4fc9 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:53.336966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b56e0-8340-4777-878a-a70d1d3e4fc9 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:53.337130 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b56e0-8340-4777-878a-a70d1d3e4fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:53.355760 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-1d5b56e0-8340-4777-878a-a70d1d3e4fc9 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:53.356964 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-1d5b56e0-8340-4777-878a-a70d1d3e4fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:53.364898 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 680/1362] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:49:53.409918 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d883862-a328-4304-be27-844c077a531f None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:49:53.425858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d883862-a328-4304-be27-844c077a531f None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:49:53.431589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a0bcf-d989-4536-ac6f-b6e256f0a9d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:49:53.432346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a0bcf-d989-4536-ac6f-b6e256f0a9d2 service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:53.432763 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a0bcf-d989-4536-ac6f-b6e256f0a9d2 service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:53.433053 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a0bcf-d989-4536-ac6f-b6e256f0a9d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:53.442521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a0bcf-d989-4536-ac6f-b6e256f0a9d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:49:53.444335 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a0bcf-d989-4536-ac6f-b6e256f0a9d2 service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:49:53.455003 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 683/1363] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:49:55.937237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547a67e-9eb2-4316-8168-6e8a753dea54 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:55.937769 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547a67e-9eb2-4316-8168-6e8a753dea54 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:55.937862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547a67e-9eb2-4316-8168-6e8a753dea54 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:55.939157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 681/1364] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:55.946848 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1421f-228a-466a-a798-50a0b1982b8b None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:55.947251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1421f-228a-466a-a798-50a0b1982b8b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:55.947409 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1421f-228a-466a-a798-50a0b1982b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:55.981043 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-d0c1421f-228a-466a-a798-50a0b1982b8b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:55.982523 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d0c1421f-228a-466a-a798-50a0b1982b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:55.990947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 684/1365] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:49:56.038408 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02ed8f-6f5c-4ef2-ad91-cf5d100cd0fb None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:56.038766 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02ed8f-6f5c-4ef2-ad91-cf5d100cd0fb None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:56.039052 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02ed8f-6f5c-4ef2-ad91-cf5d100cd0fb None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:56.040400 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 682/1366] 10.222.0.13 () {54 vars in 961 bytes} [Thu Jun 23 19:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:56.045775 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89776dd8-7d95-4bd3-8645-ae7509fdf770 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:56.046062 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89776dd8-7d95-4bd3-8645-ae7509fdf770 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:56.046341 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89776dd8-7d95-4bd3-8645-ae7509fdf770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:56.064333 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-89776dd8-7d95-4bd3-8645-ae7509fdf770 None None] MFA Rules not processed for user `83bff5cd7782423eaa0bc5b29b208ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:56.065555 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-89776dd8-7d95-4bd3-8645-ae7509fdf770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:56.075591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 685/1367] 10.222.0.13 () {58 vars in 1058 bytes} [Thu Jun 23 19:49:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:49:56.084278 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02ed8f-6f5c-4ef2-ad91-cf5d100cd0fb None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:49:56.098662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02ed8f-6f5c-4ef2-ad91-cf5d100cd0fb None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:49:56.104326 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85220404-82ae-4a37-89a5-f9e25d6c17b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:49:56.105032 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85220404-82ae-4a37-89a5-f9e25d6c17b1 service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:56.105414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85220404-82ae-4a37-89a5-f9e25d6c17b1 service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:56.105702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85220404-82ae-4a37-89a5-f9e25d6c17b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:56.114077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85220404-82ae-4a37-89a5-f9e25d6c17b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:49:56.115860 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85220404-82ae-4a37-89a5-f9e25d6c17b1 service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:49:56.125313 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 683/1368] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:49:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:49:58.425952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207a5e5-1fe0-44b3-b1dd-860b869e1c5d None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:58.426478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207a5e5-1fe0-44b3-b1dd-860b869e1c5d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:58.426592 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207a5e5-1fe0-44b3-b1dd-860b869e1c5d None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:58.427936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 686/1369] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:58.433294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35152a4c-f829-4769-9297-8faa93663d3b None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:58.434060 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35152a4c-f829-4769-9297-8faa93663d3b None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:58.434497 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35152a4c-f829-4769-9297-8faa93663d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:58.453942 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-35152a4c-f829-4769-9297-8faa93663d3b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:58.455356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-35152a4c-f829-4769-9297-8faa93663d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:58.464606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 684/1370] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:49:58.510629 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207a5e5-1fe0-44b3-b1dd-860b869e1c5d None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:49:58.525663 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207a5e5-1fe0-44b3-b1dd-860b869e1c5d None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:49:58.531097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c534ed-06ae-486b-99f9-c5344ac7ed26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:49:58.531829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c534ed-06ae-486b-99f9-c5344ac7ed26 service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:58.532185 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c534ed-06ae-486b-99f9-c5344ac7ed26 service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:58.532534 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c534ed-06ae-486b-99f9-c5344ac7ed26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:58.541184 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c534ed-06ae-486b-99f9-c5344ac7ed26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:49:58.542840 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c534ed-06ae-486b-99f9-c5344ac7ed26 service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:49:58.553198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 687/1371] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:49:58.975744 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7002b0-3eb4-41d6-a74f-bd9de09acc3f None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:58.976436 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7002b0-3eb4-41d6-a74f-bd9de09acc3f None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:58.976722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7002b0-3eb4-41d6-a74f-bd9de09acc3f None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:58.978138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 685/1372] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:49:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:58.984887 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4c5ed-477c-40fc-9385-5b8dd18fe1af None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:58.985285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4c5ed-477c-40fc-9385-5b8dd18fe1af None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:58.985620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4c5ed-477c-40fc-9385-5b8dd18fe1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:59.007889 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-c6b4c5ed-477c-40fc-9385-5b8dd18fe1af None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:59.009413 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-c6b4c5ed-477c-40fc-9385-5b8dd18fe1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:59.017380 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 688/1373] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:49:59.359456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c7258-4cee-4a17-87d1-9ae2dd951475 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:59.359456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c7258-4cee-4a17-87d1-9ae2dd951475 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:59.359456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c7258-4cee-4a17-87d1-9ae2dd951475 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:59.360713 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 686/1374] 10.222.0.13 () {54 vars in 963 bytes} [Thu Jun 23 19:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:49:59.366156 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66868cb-292e-48e8-9268-50be51d54021 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:59.366449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66868cb-292e-48e8-9268-50be51d54021 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:59.366733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66868cb-292e-48e8-9268-50be51d54021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:59.373687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:49:59.418533 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-a66868cb-292e-48e8-9268-50be51d54021 None None] MFA Rules not processed for user `4ab2b3700cdf48f08a049fbb76ee189c`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:49:59.419745 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-a66868cb-292e-48e8-9268-50be51d54021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:49:59.487908 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 689/1375] 10.222.0.13 () {58 vars in 1060 bytes} [Thu Jun 23 19:49:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:49:59.493518 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c7258-4cee-4a17-87d1-9ae2dd951475 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:49:59.504596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c7258-4cee-4a17-87d1-9ae2dd951475 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:49:59.509030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2de14c-0af5-42bf-bbe5-4c254268890c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:49:59.509802 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2de14c-0af5-42bf-bbe5-4c254268890c service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:49:59.510161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2de14c-0af5-42bf-bbe5-4c254268890c service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:49:59.510517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2de14c-0af5-42bf-bbe5-4c254268890c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:49:59.520333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2de14c-0af5-42bf-bbe5-4c254268890c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:49:59.522126 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2de14c-0af5-42bf-bbe5-4c254268890c service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:49:59.532220 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 687/1376] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:50:00.845061 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf859792-3fc6-4f41-82f8-b7f91e8edba8 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:00.845640 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf859792-3fc6-4f41-82f8-b7f91e8edba8 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:00.845640 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf859792-3fc6-4f41-82f8-b7f91e8edba8 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:00.847031 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 690/1377] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:00.852626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76c772-7b55-4260-92a6-1a4665bd2a13 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:00.853046 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76c772-7b55-4260-92a6-1a4665bd2a13 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:00.853446 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76c772-7b55-4260-92a6-1a4665bd2a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:00.871703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-4c76c772-7b55-4260-92a6-1a4665bd2a13 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:00.873002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-4c76c772-7b55-4260-92a6-1a4665bd2a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:00.881725 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 688/1378] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:00.925676 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf859792-3fc6-4f41-82f8-b7f91e8edba8 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:00.940495 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf859792-3fc6-4f41-82f8-b7f91e8edba8 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:00.946771 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197c4b3-b84d-42fc-9e96-e2343a79dac3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:00.947410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197c4b3-b84d-42fc-9e96-e2343a79dac3 service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:00.947696 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197c4b3-b84d-42fc-9e96-e2343a79dac3 service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:00.947975 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197c4b3-b84d-42fc-9e96-e2343a79dac3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:00.956655 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197c4b3-b84d-42fc-9e96-e2343a79dac3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:00.958309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197c4b3-b84d-42fc-9e96-e2343a79dac3 service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:00.971839 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 691/1379] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:50:03.158474 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22cb84-5c8f-4c53-b7f2-d5cd3cf67943 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:03.158988 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22cb84-5c8f-4c53-b7f2-d5cd3cf67943 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:03.159083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22cb84-5c8f-4c53-b7f2-d5cd3cf67943 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:03.160378 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 689/1380] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:50:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:03.166358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24744a-db44-4214-a12b-c0769234c33b None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:03.166853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24744a-db44-4214-a12b-c0769234c33b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:03.167965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24744a-db44-4214-a12b-c0769234c33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:03.187873 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-2f24744a-db44-4214-a12b-c0769234c33b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:03.189449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-2f24744a-db44-4214-a12b-c0769234c33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:03.202003 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 692/1381] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:03.247247 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22cb84-5c8f-4c53-b7f2-d5cd3cf67943 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:03.264159 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22cb84-5c8f-4c53-b7f2-d5cd3cf67943 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:03.271003 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451266a5-7b02-4c67-a482-56648376728a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:03.271962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451266a5-7b02-4c67-a482-56648376728a service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:03.272474 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451266a5-7b02-4c67-a482-56648376728a service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:03.272962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451266a5-7b02-4c67-a482-56648376728a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:03.283545 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451266a5-7b02-4c67-a482-56648376728a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:03.285345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451266a5-7b02-4c67-a482-56648376728a service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:03.302365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 690/1382] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:50:05.549850 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdc590-55c6-4277-97af-8e382bbce638 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:05.550727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdc590-55c6-4277-97af-8e382bbce638 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:05.551177 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdc590-55c6-4277-97af-8e382bbce638 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:05.553070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 693/1383] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:05.558424 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9f436-6086-4f89-b25a-37e95e5056a7 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:05.558893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9f436-6086-4f89-b25a-37e95e5056a7 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:05.559012 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9f436-6086-4f89-b25a-37e95e5056a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:05.578458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-f4b9f436-6086-4f89-b25a-37e95e5056a7 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:05.579775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f4b9f436-6086-4f89-b25a-37e95e5056a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:05.600287 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 691/1384] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:05.633174 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdc590-55c6-4277-97af-8e382bbce638 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:05.651572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdc590-55c6-4277-97af-8e382bbce638 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:05.657452 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64faa4ef-86f7-4a47-8afd-7c29968247a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:05.658223 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faa4ef-86f7-4a47-8afd-7c29968247a4 service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:05.658834 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faa4ef-86f7-4a47-8afd-7c29968247a4 service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:05.659242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faa4ef-86f7-4a47-8afd-7c29968247a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:05.670292 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64faa4ef-86f7-4a47-8afd-7c29968247a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:05.671939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64faa4ef-86f7-4a47-8afd-7c29968247a4 service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:05.682647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 694/1385] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:50:07.835598 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daaf04-f876-4a85-8e13-c865cfaa5878 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:07.836204 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daaf04-f876-4a85-8e13-c865cfaa5878 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:07.836300 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daaf04-f876-4a85-8e13-c865cfaa5878 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:07.838105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 692/1386] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:50:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:07.844220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1129fb-64d4-4a22-9a8a-be94e471832a None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:07.844636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1129fb-64d4-4a22-9a8a-be94e471832a None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:07.844850 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1129fb-64d4-4a22-9a8a-be94e471832a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:07.863560 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-8f1129fb-64d4-4a22-9a8a-be94e471832a None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:07.865468 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-8f1129fb-64d4-4a22-9a8a-be94e471832a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:07.873666 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 695/1387] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:07.919904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daaf04-f876-4a85-8e13-c865cfaa5878 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:07.936993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daaf04-f876-4a85-8e13-c865cfaa5878 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:07.942814 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88147baa-1cbe-4a25-9273-5f766834e73f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:07.943474 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88147baa-1cbe-4a25-9273-5f766834e73f service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:07.943773 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88147baa-1cbe-4a25-9273-5f766834e73f service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:07.944067 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88147baa-1cbe-4a25-9273-5f766834e73f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:07.952898 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88147baa-1cbe-4a25-9273-5f766834e73f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:07.954579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88147baa-1cbe-4a25-9273-5f766834e73f service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:07.965123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 693/1388] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:50:10.214183 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417494-6dc5-4015-aaa8-8d9d196af27c None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:10.214712 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417494-6dc5-4015-aaa8-8d9d196af27c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:10.214712 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417494-6dc5-4015-aaa8-8d9d196af27c None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:10.216054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 696/1389] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:10.222785 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ad372-e57f-41bd-9518-46438601bed9 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:10.223226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ad372-e57f-41bd-9518-46438601bed9 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:10.223599 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ad372-e57f-41bd-9518-46438601bed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:10.244038 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-929ad372-e57f-41bd-9518-46438601bed9 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:10.245273 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-929ad372-e57f-41bd-9518-46438601bed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:10.253376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 694/1390] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:10.305885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13417494-6dc5-4015-aaa8-8d9d196af27c None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:10.319943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13417494-6dc5-4015-aaa8-8d9d196af27c None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:10.340115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769385a4-e256-4c8c-956f-24b4055b5caa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:10.340115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769385a4-e256-4c8c-956f-24b4055b5caa service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:10.340115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769385a4-e256-4c8c-956f-24b4055b5caa service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:10.340115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769385a4-e256-4c8c-956f-24b4055b5caa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:10.340487 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769385a4-e256-4c8c-956f-24b4055b5caa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:10.340487 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769385a4-e256-4c8c-956f-24b4055b5caa service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:10.348027 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 697/1391] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:50:12.608594 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50b877-d96b-4f03-9288-0b1a4a2acce1 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:12.609400 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50b877-d96b-4f03-9288-0b1a4a2acce1 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:12.609400 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50b877-d96b-4f03-9288-0b1a4a2acce1 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:12.610523 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 695/1392] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:12.617170 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6e2c2-2629-4ff1-b57b-04e3cde1e2a9 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:12.617641 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6e2c2-2629-4ff1-b57b-04e3cde1e2a9 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:12.617936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6e2c2-2629-4ff1-b57b-04e3cde1e2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:12.640094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-35d6e2c2-2629-4ff1-b57b-04e3cde1e2a9 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:12.641735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-35d6e2c2-2629-4ff1-b57b-04e3cde1e2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:12.652196 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 698/1393] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:12.698281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50b877-d96b-4f03-9288-0b1a4a2acce1 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:12.713865 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50b877-d96b-4f03-9288-0b1a4a2acce1 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:12.719200 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88c580-de05-4cbe-81d9-e1ab29ae5bb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:12.727224 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88c580-de05-4cbe-81d9-e1ab29ae5bb7 service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:12.727224 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88c580-de05-4cbe-81d9-e1ab29ae5bb7 service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:12.727224 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88c580-de05-4cbe-81d9-e1ab29ae5bb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:12.731557 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88c580-de05-4cbe-81d9-e1ab29ae5bb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:12.733233 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88c580-de05-4cbe-81d9-e1ab29ae5bb7 service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:12.743512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 696/1394] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:50:14.955114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075e26d-690d-4804-824d-8f84244ed193 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:14.955696 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075e26d-690d-4804-824d-8f84244ed193 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:14.955696 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075e26d-690d-4804-824d-8f84244ed193 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:14.957347 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 699/1395] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:14.963172 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f6418-d519-4dc2-b10c-6d5dc09c19e1 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:14.963584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f6418-d519-4dc2-b10c-6d5dc09c19e1 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:14.963736 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f6418-d519-4dc2-b10c-6d5dc09c19e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:14.981069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-1d1f6418-d519-4dc2-b10c-6d5dc09c19e1 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:14.982241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-1d1f6418-d519-4dc2-b10c-6d5dc09c19e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:14.990598 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 697/1396] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:15.035018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075e26d-690d-4804-824d-8f84244ed193 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:15.049992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075e26d-690d-4804-824d-8f84244ed193 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:15.055702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a06475-5941-496e-a2bb-c980be63c6a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:15.056344 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a06475-5941-496e-a2bb-c980be63c6a4 service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:15.056660 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a06475-5941-496e-a2bb-c980be63c6a4 service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:15.056941 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a06475-5941-496e-a2bb-c980be63c6a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:15.065099 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a06475-5941-496e-a2bb-c980be63c6a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:15.066708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a06475-5941-496e-a2bb-c980be63c6a4 service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:15.076594 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 700/1397] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:50:15.169540 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f97d3-e464-4ec6-a7c8-7b33cbaaf47c None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:15.169837 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f97d3-e464-4ec6-a7c8-7b33cbaaf47c None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:15.170148 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f97d3-e464-4ec6-a7c8-7b33cbaaf47c None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:15.171515 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 698/1398] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:15.176865 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af64fc-02c6-4f48-8dad-ba7776179127 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:15.181864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af64fc-02c6-4f48-8dad-ba7776179127 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:15.181864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af64fc-02c6-4f48-8dad-ba7776179127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:15.195562 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-88af64fc-02c6-4f48-8dad-ba7776179127 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:15.196806 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-88af64fc-02c6-4f48-8dad-ba7776179127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:15.204902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 701/1399] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:15.261244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d695ba-a4ce-4b23-84f2-8eafd2ab4cf3 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:15.261533 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d695ba-a4ce-4b23-84f2-8eafd2ab4cf3 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:15.261811 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d695ba-a4ce-4b23-84f2-8eafd2ab4cf3 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:15.263209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 699/1400] 10.222.0.13 () {54 vars in 962 bytes} [Thu Jun 23 19:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:15.268233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6df633-f754-4344-86fb-fc50d761c8fe None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:15.272650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6df633-f754-4344-86fb-fc50d761c8fe None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:15.272650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6df633-f754-4344-86fb-fc50d761c8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:15.324797 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-bd6df633-f754-4344-86fb-fc50d761c8fe None None] MFA Rules not processed for user `f078219032be4b619119d1d9d59c499d`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:15.326116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-bd6df633-f754-4344-86fb-fc50d761c8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:15.363024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:50:15.393447 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 702/1401] 10.222.0.13 () {58 vars in 1059 bytes} [Thu Jun 23 19:50:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:15.401858 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d695ba-a4ce-4b23-84f2-8eafd2ab4cf3 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:15.413514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d695ba-a4ce-4b23-84f2-8eafd2ab4cf3 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:15.417019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff6c39-1cc5-4002-aed5-ec52177c93e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f078219032be4b619119d1d9d59c499d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:15.417696 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff6c39-1cc5-4002-aed5-ec52177c93e5 service glance] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:15.417974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff6c39-1cc5-4002-aed5-ec52177c93e5 service glance] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:15.418248 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff6c39-1cc5-4002-aed5-ec52177c93e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:15.428210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff6c39-1cc5-4002-aed5-ec52177c93e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:15.429730 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff6c39-1cc5-4002-aed5-ec52177c93e5 service glance] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:15.439167 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 700/1402] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:50:16.298828 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eeddcc-814e-4feb-b272-18676c976177 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:16.299295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eeddcc-814e-4feb-b272-18676c976177 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:16.302864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eeddcc-814e-4feb-b272-18676c976177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:16.351207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-c5eeddcc-814e-4feb-b272-18676c976177 None None] MFA Rules not processed for user `fec6c1cbf48a44f9922bd82e714861c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:16.352457 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-c5eeddcc-814e-4feb-b272-18676c976177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:16.418724 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 703/1403] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 19:50:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:16.460729 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad070058-30ae-4fba-b525-90703fff5dd2 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:16.461246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad070058-30ae-4fba-b525-90703fff5dd2 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:16.461356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad070058-30ae-4fba-b525-90703fff5dd2 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:16.462687 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 701/1404] 10.222.0.13 () {54 vars in 942 bytes} [Thu Jun 23 19:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:16.468902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ef10f-9959-4568-9e73-fd730dcc0a55 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:16.469216 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ef10f-9959-4568-9e73-fd730dcc0a55 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:16.469495 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ef10f-9959-4568-9e73-fd730dcc0a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:16.516882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-e63ef10f-9959-4568-9e73-fd730dcc0a55 None None] MFA Rules not processed for user `2cc53095a45e4136b37fb6e4e677eff9`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:16.518120 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e63ef10f-9959-4568-9e73-fd730dcc0a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:16.590130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 704/1405] 10.222.0.13 () {58 vars in 1039 bytes} [Thu Jun 23 19:50:16 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:16.600339 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad070058-30ae-4fba-b525-90703fff5dd2 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:16.608126 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=61 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:50:16.614756 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad070058-30ae-4fba-b525-90703fff5dd2 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:16.619767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd75409-5c7e-4deb-8372-8af94e078a0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc53095a45e4136b37fb6e4e677eff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:16.620400 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd75409-5c7e-4deb-8372-8af94e078a0d service swift] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:16.620680 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd75409-5c7e-4deb-8372-8af94e078a0d service swift] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:16.620950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd75409-5c7e-4deb-8372-8af94e078a0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:16.629122 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd75409-5c7e-4deb-8372-8af94e078a0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:16.630811 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd75409-5c7e-4deb-8372-8af94e078a0d service swift] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:16.638975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 702/1406] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 19:50:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 19:50:17.302784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681f826-01b9-4a1d-a30a-05c0edd0cb56 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:17.303235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681f826-01b9-4a1d-a30a-05c0edd0cb56 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:17.303333 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681f826-01b9-4a1d-a30a-05c0edd0cb56 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:17.304877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 705/1407] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:17.310059 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e3faa-1a22-402a-9053-6d3f859764fc None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:17.310359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e3faa-1a22-402a-9053-6d3f859764fc None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:17.310643 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e3faa-1a22-402a-9053-6d3f859764fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:17.329667 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-290e3faa-1a22-402a-9053-6d3f859764fc None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:17.330880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-290e3faa-1a22-402a-9053-6d3f859764fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:17.339509 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 703/1408] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:17.383955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681f826-01b9-4a1d-a30a-05c0edd0cb56 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:17.399297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681f826-01b9-4a1d-a30a-05c0edd0cb56 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:17.404817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06aa7f-9633-46c5-8a54-dda3f9e21e6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:17.405506 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06aa7f-9633-46c5-8a54-dda3f9e21e6d service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:17.405796 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06aa7f-9633-46c5-8a54-dda3f9e21e6d service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:17.406090 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06aa7f-9633-46c5-8a54-dda3f9e21e6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:17.416028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06aa7f-9633-46c5-8a54-dda3f9e21e6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:17.417786 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06aa7f-9633-46c5-8a54-dda3f9e21e6d service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:17.423226 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:50:17.429270 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 706/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:50:27.323983 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=8 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:50:40.288784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fea0b3-ee87-4e87-8940-4b29ca5f8253 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:40.289417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fea0b3-ee87-4e87-8940-4b29ca5f8253 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:40.289417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fea0b3-ee87-4e87-8940-4b29ca5f8253 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:40.290637 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 704/1410] 10.222.0.13 () {54 vars in 918 bytes} [Thu Jun 23 19:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:40.295601 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b885f2-29f2-48de-8b51-b0c99b1f8044 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:40.296024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b885f2-29f2-48de-8b51-b0c99b1f8044 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:40.296136 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b885f2-29f2-48de-8b51-b0c99b1f8044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:40.314253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-24b885f2-29f2-48de-8b51-b0c99b1f8044 None None] MFA Rules not processed for user `7e9ba6d33e8640ec8dcda9971f59c5dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:40.315454 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-24b885f2-29f2-48de-8b51-b0c99b1f8044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:40.324876 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 707/1411] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Jun 23 19:50:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:50:40.339977 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c3786-a573-4f08-9aff-91d54dbdbf0a None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:40.340264 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c3786-a573-4f08-9aff-91d54dbdbf0a None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:40.340539 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c3786-a573-4f08-9aff-91d54dbdbf0a None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:40.341898 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 705/1412] 10.222.0.13 () {54 vars in 918 bytes} [Thu Jun 23 19:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:40.346644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb103a-ff33-418c-a9a0-cc294465ea35 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:40.346931 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb103a-ff33-418c-a9a0-cc294465ea35 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:40.347209 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb103a-ff33-418c-a9a0-cc294465ea35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:40.365537 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-97cb103a-ff33-418c-a9a0-cc294465ea35 None None] MFA Rules not processed for user `83bff5cd7782423eaa0bc5b29b208ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:40.366721 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-97cb103a-ff33-418c-a9a0-cc294465ea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:40.375616 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 708/1413] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Jun 23 19:50:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:50:42.978958 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc6127-4394-407c-b7f1-92825a74a8b6 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:42.979523 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc6127-4394-407c-b7f1-92825a74a8b6 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:42.979624 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc6127-4394-407c-b7f1-92825a74a8b6 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:42.980941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 19:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:42.986291 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc753aa-69af-4e28-86cf-40ace5620bcf None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:42.986754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc753aa-69af-4e28-86cf-40ace5620bcf None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:42.986853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc753aa-69af-4e28-86cf-40ace5620bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:43.021671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-3dc753aa-69af-4e28-86cf-40ace5620bcf None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:43.022910 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-3dc753aa-69af-4e28-86cf-40ace5620bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:43.032187 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 19:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:43.076522 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc6127-4394-407c-b7f1-92825a74a8b6 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:43.091688 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc6127-4394-407c-b7f1-92825a74a8b6 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:43.097117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087630b0-2b53-4d94-acde-2c9e28c3e580 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:43.097777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087630b0-2b53-4d94-acde-2c9e28c3e580 service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:43.098102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087630b0-2b53-4d94-acde-2c9e28c3e580 service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:43.098953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087630b0-2b53-4d94-acde-2c9e28c3e580 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:43.107261 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087630b0-2b53-4d94-acde-2c9e28c3e580 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:43.108845 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087630b0-2b53-4d94-acde-2c9e28c3e580 service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:43.118405 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 707/1416] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:50:44.023007 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81373b66-02f4-4a71-9d24-8bbf7950f7f0 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:44.023624 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81373b66-02f4-4a71-9d24-8bbf7950f7f0 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:44.023624 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81373b66-02f4-4a71-9d24-8bbf7950f7f0 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:44.024955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 19:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:44.030091 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24bd30-1b16-467e-83ad-1eaa5a3aebe8 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:44.030534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24bd30-1b16-467e-83ad-1eaa5a3aebe8 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:44.030630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24bd30-1b16-467e-83ad-1eaa5a3aebe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:44.048877 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-7f24bd30-1b16-467e-83ad-1eaa5a3aebe8 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:44.050108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7f24bd30-1b16-467e-83ad-1eaa5a3aebe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:44.058237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 19:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:44.210394 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81373b66-02f4-4a71-9d24-8bbf7950f7f0 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:44.224679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81373b66-02f4-4a71-9d24-8bbf7950f7f0 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:44.229971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08709e-ba5b-44e6-8786-fc40f659b2c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:44.230600 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08709e-ba5b-44e6-8786-fc40f659b2c4 service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:44.230884 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08709e-ba5b-44e6-8786-fc40f659b2c4 service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:44.231164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08709e-ba5b-44e6-8786-fc40f659b2c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:44.240220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08709e-ba5b-44e6-8786-fc40f659b2c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:44.241836 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08709e-ba5b-44e6-8786-fc40f659b2c4 service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:44.251098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 711/1419] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:50:45.147478 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbbc45-3c85-4093-aa8a-39ed8b34db3f None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:45.148026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbbc45-3c85-4093-aa8a-39ed8b34db3f None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:45.148026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbbc45-3c85-4093-aa8a-39ed8b34db3f None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:45.149570 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 19:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:45.154361 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fad36b-3df5-461a-860d-f254ce625968 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:45.154810 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fad36b-3df5-461a-860d-f254ce625968 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:45.154916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fad36b-3df5-461a-860d-f254ce625968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:45.173291 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-11fad36b-3df5-461a-860d-f254ce625968 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:45.174489 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-11fad36b-3df5-461a-860d-f254ce625968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:45.182581 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 19:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:45.332674 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbbc45-3c85-4093-aa8a-39ed8b34db3f None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:45.347956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbbc45-3c85-4093-aa8a-39ed8b34db3f None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:45.354643 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058ab3e-6458-4c2c-83ed-fce2d78f8dcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:45.355293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058ab3e-6458-4c2c-83ed-fce2d78f8dcd service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:45.355582 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058ab3e-6458-4c2c-83ed-fce2d78f8dcd service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:45.355865 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058ab3e-6458-4c2c-83ed-fce2d78f8dcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:45.365037 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058ab3e-6458-4c2c-83ed-fce2d78f8dcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:45.366660 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058ab3e-6458-4c2c-83ed-fce2d78f8dcd service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:45.376217 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 710/1422] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:50:46.241569 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1846c-ca6f-456f-a975-5a12032a07b0 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:46.242210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1846c-ca6f-456f-a975-5a12032a07b0 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:46.242210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1846c-ca6f-456f-a975-5a12032a07b0 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:46.243471 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 19:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:46.248360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66f4d9-cdc6-4915-9fcd-03c47e8e4d87 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:46.248825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66f4d9-cdc6-4915-9fcd-03c47e8e4d87 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:46.248927 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66f4d9-cdc6-4915-9fcd-03c47e8e4d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:46.266897 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-7c66f4d9-cdc6-4915-9fcd-03c47e8e4d87 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:46.268087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7c66f4d9-cdc6-4915-9fcd-03c47e8e4d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:46.276582 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 19:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:46.426263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1846c-ca6f-456f-a975-5a12032a07b0 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:46.440427 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1846c-ca6f-456f-a975-5a12032a07b0 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:46.446371 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6191223-280a-4df0-b1f3-0ce88848f977 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:46.447004 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6191223-280a-4df0-b1f3-0ce88848f977 service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:46.447294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6191223-280a-4df0-b1f3-0ce88848f977 service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:46.447578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6191223-280a-4df0-b1f3-0ce88848f977 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:46.455668 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6191223-280a-4df0-b1f3-0ce88848f977 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:46.457589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6191223-280a-4df0-b1f3-0ce88848f977 service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:46.467432 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 714/1425] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:50:47.360012 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3eb68-63f7-4b6e-88f3-a680feaee951 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:47.360586 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3eb68-63f7-4b6e-88f3-a680feaee951 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:47.360586 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3eb68-63f7-4b6e-88f3-a680feaee951 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:47.362020 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 19:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:47.366997 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b896930-8599-4ed3-b2bd-1defacdfaed7 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:47.367442 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b896930-8599-4ed3-b2bd-1defacdfaed7 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:47.367551 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b896930-8599-4ed3-b2bd-1defacdfaed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:47.385478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-3b896930-8599-4ed3-b2bd-1defacdfaed7 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:47.386680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-3b896930-8599-4ed3-b2bd-1defacdfaed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:47.394407 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 19:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:47.544742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3eb68-63f7-4b6e-88f3-a680feaee951 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:47.558624 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3eb68-63f7-4b6e-88f3-a680feaee951 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:47.563789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561ee88-d32c-4f3f-954f-588e2e795eab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:47.564415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561ee88-d32c-4f3f-954f-588e2e795eab service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:47.564698 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561ee88-d32c-4f3f-954f-588e2e795eab service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:47.564975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561ee88-d32c-4f3f-954f-588e2e795eab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:47.572926 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561ee88-d32c-4f3f-954f-588e2e795eab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:47.574585 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561ee88-d32c-4f3f-954f-588e2e795eab service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:47.584474 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 713/1428] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:50:48.489261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b17029-31f1-49ea-91db-56e2946d276c None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:48.490324 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b17029-31f1-49ea-91db-56e2946d276c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:48.490439 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b17029-31f1-49ea-91db-56e2946d276c None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:48.491872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 19:50:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:48.496781 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081a60f-9aef-41f3-b96f-1ae039ea1783 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:48.497212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081a60f-9aef-41f3-b96f-1ae039ea1783 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:48.497363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081a60f-9aef-41f3-b96f-1ae039ea1783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:48.514745 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-c081a60f-9aef-41f3-b96f-1ae039ea1783 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:48.515926 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c081a60f-9aef-41f3-b96f-1ae039ea1783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:48.523782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 19:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:48.672726 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b17029-31f1-49ea-91db-56e2946d276c None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:48.687544 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b17029-31f1-49ea-91db-56e2946d276c None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:48.693005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a6ceb-a01f-4af6-8991-e4e61b00031e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:48.693654 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a6ceb-a01f-4af6-8991-e4e61b00031e service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:48.693941 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a6ceb-a01f-4af6-8991-e4e61b00031e service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:48.694222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a6ceb-a01f-4af6-8991-e4e61b00031e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:48.702229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a6ceb-a01f-4af6-8991-e4e61b00031e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:48.703811 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a6ceb-a01f-4af6-8991-e4e61b00031e service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:48.714079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 717/1431] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:50:49.597831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1c12a-8809-4e26-bb2b-a4fa60e55dbf None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:49.599007 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1c12a-8809-4e26-bb2b-a4fa60e55dbf None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:49.599137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1c12a-8809-4e26-bb2b-a4fa60e55dbf None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:49.600488 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 19:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:49.605592 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d7c43-86c8-4006-aeb4-121419b4e21f None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:49.606027 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d7c43-86c8-4006-aeb4-121419b4e21f None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:49.606167 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d7c43-86c8-4006-aeb4-121419b4e21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:49.624027 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-f17d7c43-86c8-4006-aeb4-121419b4e21f None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:49.625266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f17d7c43-86c8-4006-aeb4-121419b4e21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:49.633411 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 19:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:49.783413 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1c12a-8809-4e26-bb2b-a4fa60e55dbf None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:49.797571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1c12a-8809-4e26-bb2b-a4fa60e55dbf None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:49.803418 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5f8d4-b096-4793-9789-0c255815ce38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:49.804048 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5f8d4-b096-4793-9789-0c255815ce38 service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:49.804335 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5f8d4-b096-4793-9789-0c255815ce38 service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:49.804618 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5f8d4-b096-4793-9789-0c255815ce38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:49.812594 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5f8d4-b096-4793-9789-0c255815ce38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:49.814215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5f8d4-b096-4793-9789-0c255815ce38 service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:49.824439 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 716/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:50:50.701143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455779fe-74ae-4fd5-a38a-b15e0ad3bfa9 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:50.701709 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455779fe-74ae-4fd5-a38a-b15e0ad3bfa9 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:50.701709 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455779fe-74ae-4fd5-a38a-b15e0ad3bfa9 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:50.703150 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 19:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:50.708549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4097afe-440d-45b1-bda4-6e159cc5ec98 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:50.709023 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4097afe-440d-45b1-bda4-6e159cc5ec98 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:50.709128 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4097afe-440d-45b1-bda4-6e159cc5ec98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:50.727112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-f4097afe-440d-45b1-bda4-6e159cc5ec98 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:50.728308 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f4097afe-440d-45b1-bda4-6e159cc5ec98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:50.735986 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 19:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:50.888240 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455779fe-74ae-4fd5-a38a-b15e0ad3bfa9 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:50.902676 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455779fe-74ae-4fd5-a38a-b15e0ad3bfa9 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:50.907976 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d9ef9-e65f-4623-9e94-61fa92220e89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:50.908618 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d9ef9-e65f-4623-9e94-61fa92220e89 service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:50.908907 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d9ef9-e65f-4623-9e94-61fa92220e89 service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:50.909221 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d9ef9-e65f-4623-9e94-61fa92220e89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:50.918099 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d9ef9-e65f-4623-9e94-61fa92220e89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:50.919680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d9ef9-e65f-4623-9e94-61fa92220e89 service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:50.929757 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 720/1437] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:50:51.883595 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33824d-35e6-40f0-9100-5eef83a3d9f0 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:51.884117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33824d-35e6-40f0-9100-5eef83a3d9f0 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:51.884233 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33824d-35e6-40f0-9100-5eef83a3d9f0 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:51.885558 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 19:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:51.890550 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d288f2-edd7-4c5e-9702-8e2906ad77cb None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:51.890955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d288f2-edd7-4c5e-9702-8e2906ad77cb None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:51.891108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d288f2-edd7-4c5e-9702-8e2906ad77cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:51.909491 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-73d288f2-edd7-4c5e-9702-8e2906ad77cb None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:51.910799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-73d288f2-edd7-4c5e-9702-8e2906ad77cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:51.918953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 19:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:52.073386 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33824d-35e6-40f0-9100-5eef83a3d9f0 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:52.087987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33824d-35e6-40f0-9100-5eef83a3d9f0 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:52.093365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f7c55-c519-4622-9006-461dd447d29f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:52.094021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f7c55-c519-4622-9006-461dd447d29f service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:52.094311 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f7c55-c519-4622-9006-461dd447d29f service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:52.094595 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f7c55-c519-4622-9006-461dd447d29f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:52.103170 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f7c55-c519-4622-9006-461dd447d29f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:52.104779 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f7c55-c519-4622-9006-461dd447d29f service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:52.114895 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 719/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:50:54.041707 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff18974-0654-43dc-bbb5-4fe5c5b2d28a None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:54.042272 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff18974-0654-43dc-bbb5-4fe5c5b2d28a None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:54.042272 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff18974-0654-43dc-bbb5-4fe5c5b2d28a None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:54.043566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 19:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:54.048892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f85b6d-448b-4d83-8cc6-47560f1fec9b None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:54.049303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f85b6d-448b-4d83-8cc6-47560f1fec9b None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:54.049525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f85b6d-448b-4d83-8cc6-47560f1fec9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:54.067930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-55f85b6d-448b-4d83-8cc6-47560f1fec9b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:54.069134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-55f85b6d-448b-4d83-8cc6-47560f1fec9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:54.076925 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 19:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:54.115525 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff18974-0654-43dc-bbb5-4fe5c5b2d28a None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:54.126121 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff18974-0654-43dc-bbb5-4fe5c5b2d28a None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:54.130293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9e5b5-5197-4b5e-89fe-0e205ef8667a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:54.130923 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9e5b5-5197-4b5e-89fe-0e205ef8667a service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:54.131209 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9e5b5-5197-4b5e-89fe-0e205ef8667a service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:54.131486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9e5b5-5197-4b5e-89fe-0e205ef8667a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:54.140215 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9e5b5-5197-4b5e-89fe-0e205ef8667a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:54.141706 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9e5b5-5197-4b5e-89fe-0e205ef8667a service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:54.151162 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 723/1443] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:50:56.377834 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f3f92-e5b7-47fa-bc93-a62e18ea461d None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:56.378396 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f3f92-e5b7-47fa-bc93-a62e18ea461d None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:56.378396 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f3f92-e5b7-47fa-bc93-a62e18ea461d None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:56.379941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 19:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:56.385531 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e072a56-8b5e-42e0-b353-f36f0f5b6612 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:56.385972 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e072a56-8b5e-42e0-b353-f36f0f5b6612 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:56.386083 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e072a56-8b5e-42e0-b353-f36f0f5b6612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:56.405037 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-2e072a56-8b5e-42e0-b353-f36f0f5b6612 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:56.406259 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-2e072a56-8b5e-42e0-b353-f36f0f5b6612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:56.414859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 19:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:56.452411 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f3f92-e5b7-47fa-bc93-a62e18ea461d None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:56.464187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f3f92-e5b7-47fa-bc93-a62e18ea461d None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:56.467660 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab01c9f-3b62-434f-9dd6-3aadf674bb3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:56.468288 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab01c9f-3b62-434f-9dd6-3aadf674bb3b service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:56.468570 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab01c9f-3b62-434f-9dd6-3aadf674bb3b service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:56.468846 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab01c9f-3b62-434f-9dd6-3aadf674bb3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:56.478734 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab01c9f-3b62-434f-9dd6-3aadf674bb3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:56.480156 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab01c9f-3b62-434f-9dd6-3aadf674bb3b service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:56.489607 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 722/1446] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:50:59.000731 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c24b37-69a6-4192-b4f4-d355ed7059e0 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:59.001265 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c24b37-69a6-4192-b4f4-d355ed7059e0 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:59.001265 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c24b37-69a6-4192-b4f4-d355ed7059e0 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:59.002650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 19:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:50:59.007898 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a362262-76ec-4172-be13-ac581dca416d None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:59.008318 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a362262-76ec-4172-be13-ac581dca416d None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:59.008464 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a362262-76ec-4172-be13-ac581dca416d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:59.025749 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-9a362262-76ec-4172-be13-ac581dca416d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:50:59.026944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-9a362262-76ec-4172-be13-ac581dca416d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:50:59.034689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 19:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:50:59.073766 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c24b37-69a6-4192-b4f4-d355ed7059e0 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:50:59.084705 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c24b37-69a6-4192-b4f4-d355ed7059e0 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:50:59.088276 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b7b01-1f89-45ab-83ef-722b16dca71b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:50:59.088929 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b7b01-1f89-45ab-83ef-722b16dca71b service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:50:59.089253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b7b01-1f89-45ab-83ef-722b16dca71b service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:50:59.089536 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b7b01-1f89-45ab-83ef-722b16dca71b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:50:59.098899 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b7b01-1f89-45ab-83ef-722b16dca71b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:50:59.100347 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b7b01-1f89-45ab-83ef-722b16dca71b service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:50:59.109736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 726/1449] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:51:01.327219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c8e1b-2c86-4e70-94c2-b18376271309 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:01.327813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c8e1b-2c86-4e70-94c2-b18376271309 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:01.327813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c8e1b-2c86-4e70-94c2-b18376271309 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:01.329132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 19:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:51:01.335492 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb53ced-3a6d-4cee-b1db-e01c1ac8ba7d None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:01.335921 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb53ced-3a6d-4cee-b1db-e01c1ac8ba7d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:01.336070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb53ced-3a6d-4cee-b1db-e01c1ac8ba7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:01.353855 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-3cb53ced-3a6d-4cee-b1db-e01c1ac8ba7d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:51:01.355039 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-3cb53ced-3a6d-4cee-b1db-e01c1ac8ba7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:51:01.362746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 19:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:51:01.402962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c8e1b-2c86-4e70-94c2-b18376271309 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:51:01.413992 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c8e1b-2c86-4e70-94c2-b18376271309 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:51:01.417567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d5079-6f64-42df-9070-6f4d3bc006b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:51:01.418211 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d5079-6f64-42df-9070-6f4d3bc006b8 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:01.418492 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d5079-6f64-42df-9070-6f4d3bc006b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:01.418767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d5079-6f64-42df-9070-6f4d3bc006b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:01.428918 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d5079-6f64-42df-9070-6f4d3bc006b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:51:01.430387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d5079-6f64-42df-9070-6f4d3bc006b8 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:51:01.440493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 725/1452] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:51:03.574791 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc462d1-de89-4b5e-a411-a975c169eee9 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:03.575337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc462d1-de89-4b5e-a411-a975c169eee9 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:03.575337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc462d1-de89-4b5e-a411-a975c169eee9 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:03.576712 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 19:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:51:03.582012 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e9613-9912-4394-a909-f0b36f2e79c1 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:03.583259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e9613-9912-4394-a909-f0b36f2e79c1 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:03.583457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e9613-9912-4394-a909-f0b36f2e79c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:03.601412 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-a79e9613-9912-4394-a909-f0b36f2e79c1 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:51:03.602604 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-a79e9613-9912-4394-a909-f0b36f2e79c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:51:03.610549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 19:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:51:03.650042 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc462d1-de89-4b5e-a411-a975c169eee9 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:51:03.660738 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc462d1-de89-4b5e-a411-a975c169eee9 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:51:03.664181 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ad553-c472-43b8-9dbb-fa2957f8021d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:51:03.664812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ad553-c472-43b8-9dbb-fa2957f8021d service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:03.665099 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ad553-c472-43b8-9dbb-fa2957f8021d service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:03.665423 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ad553-c472-43b8-9dbb-fa2957f8021d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:03.674466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ad553-c472-43b8-9dbb-fa2957f8021d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:51:03.675925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ad553-c472-43b8-9dbb-fa2957f8021d service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:51:03.685635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 729/1455] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:51:05.780762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540e808-9b90-4a70-a676-3e3a18f0c856 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:05.781361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540e808-9b90-4a70-a676-3e3a18f0c856 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:05.781361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540e808-9b90-4a70-a676-3e3a18f0c856 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:05.782693 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 19:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:51:05.788012 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f2634-3be9-457e-8ca6-234f1da84c93 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:05.788427 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f2634-3be9-457e-8ca6-234f1da84c93 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:05.788579 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f2634-3be9-457e-8ca6-234f1da84c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:05.806048 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-698f2634-3be9-457e-8ca6-234f1da84c93 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:51:05.807244 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-698f2634-3be9-457e-8ca6-234f1da84c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:51:05.814988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 19:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:51:05.854015 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540e808-9b90-4a70-a676-3e3a18f0c856 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:51:05.864845 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540e808-9b90-4a70-a676-3e3a18f0c856 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:51:05.868385 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf7acc-ae1b-44e3-a643-7a1ee259f6ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:51:05.869032 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf7acc-ae1b-44e3-a643-7a1ee259f6ac service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:05.869375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf7acc-ae1b-44e3-a643-7a1ee259f6ac service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:05.869660 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf7acc-ae1b-44e3-a643-7a1ee259f6ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:05.878962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf7acc-ae1b-44e3-a643-7a1ee259f6ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:51:05.881089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf7acc-ae1b-44e3-a643-7a1ee259f6ac service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:51:05.890598 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 728/1458] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:51:07.999210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1804d45-64ce-4161-9943-c092c8f00877 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:07.999738 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1804d45-64ce-4161-9943-c092c8f00877 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:07.999859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1804d45-64ce-4161-9943-c092c8f00877 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:08.001179 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 19:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:51:08.007065 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc774d27-583f-4c16-a5f7-3e006472d539 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:08.007460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc774d27-583f-4c16-a5f7-3e006472d539 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:08.007638 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc774d27-583f-4c16-a5f7-3e006472d539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:08.013693 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=70 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:51:08.025305 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-bc774d27-583f-4c16-a5f7-3e006472d539 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:51:08.026510 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-bc774d27-583f-4c16-a5f7-3e006472d539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:51:08.034311 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 19:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:51:08.073721 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1804d45-64ce-4161-9943-c092c8f00877 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:51:08.079204 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=73 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:51:08.085176 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1804d45-64ce-4161-9943-c092c8f00877 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:51:08.091635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87138b7d-13e1-4585-abec-2e42d2c2c53c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:51:08.091635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87138b7d-13e1-4585-abec-2e42d2c2c53c service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:08.091635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87138b7d-13e1-4585-abec-2e42d2c2c53c service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:08.091635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87138b7d-13e1-4585-abec-2e42d2c2c53c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:08.098740 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87138b7d-13e1-4585-abec-2e42d2c2c53c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:51:08.100175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87138b7d-13e1-4585-abec-2e42d2c2c53c service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:51:08.109692 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 732/1461] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:51:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:51:10.202655 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043edc67-7e1c-4d74-9560-3ce1b253ae2e None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:10.203185 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043edc67-7e1c-4d74-9560-3ce1b253ae2e None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:10.203185 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043edc67-7e1c-4d74-9560-3ce1b253ae2e None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:10.204553 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 19:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:51:10.210292 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d166a-7217-4950-9ae6-38199827088c None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:10.210730 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d166a-7217-4950-9ae6-38199827088c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:10.210857 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d166a-7217-4950-9ae6-38199827088c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:10.228206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-330d166a-7217-4950-9ae6-38199827088c None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:51:10.229436 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-330d166a-7217-4950-9ae6-38199827088c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:51:10.237119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 19:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:51:10.274681 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043edc67-7e1c-4d74-9560-3ce1b253ae2e None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:51:10.289768 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043edc67-7e1c-4d74-9560-3ce1b253ae2e None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:51:10.293256 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79056b89-9104-41b3-9f36-8e05c3ff02de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:51:10.293883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79056b89-9104-41b3-9f36-8e05c3ff02de service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:10.294163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79056b89-9104-41b3-9f36-8e05c3ff02de service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:10.294436 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79056b89-9104-41b3-9f36-8e05c3ff02de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:10.303950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79056b89-9104-41b3-9f36-8e05c3ff02de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:51:10.305387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79056b89-9104-41b3-9f36-8e05c3ff02de service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:51:10.314788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 731/1464] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:51:12.378324 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23e12c-d078-430c-a520-4d17012b56a9 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:12.378877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23e12c-d078-430c-a520-4d17012b56a9 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:12.378877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23e12c-d078-430c-a520-4d17012b56a9 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:12.380909 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 19:51:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:51:12.386161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a17346-af6c-4731-a7a5-067e833dd4d6 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:12.386584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a17346-af6c-4731-a7a5-067e833dd4d6 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:12.386708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a17346-af6c-4731-a7a5-067e833dd4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:12.404290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-36a17346-af6c-4731-a7a5-067e833dd4d6 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:51:12.405519 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-36a17346-af6c-4731-a7a5-067e833dd4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:51:12.413350 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 19:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:51:12.450274 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23e12c-d078-430c-a520-4d17012b56a9 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:51:12.461119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23e12c-d078-430c-a520-4d17012b56a9 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:51:12.464601 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642021d-150b-4f6e-bd51-53c010675167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:51:12.465257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642021d-150b-4f6e-bd51-53c010675167 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:12.465546 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642021d-150b-4f6e-bd51-53c010675167 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:12.465826 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642021d-150b-4f6e-bd51-53c010675167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:12.474938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642021d-150b-4f6e-bd51-53c010675167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:51:12.476360 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642021d-150b-4f6e-bd51-53c010675167 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:51:12.485744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 735/1467] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:51:14.530259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5de521-928b-448b-bc5e-be91a811ee3a None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:14.530826 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5de521-928b-448b-bc5e-be91a811ee3a None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:14.530826 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5de521-928b-448b-bc5e-be91a811ee3a None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:14.532184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 19:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:51:14.537672 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce808b38-9285-4c73-861e-771d65b3b74a None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:14.538083 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce808b38-9285-4c73-861e-771d65b3b74a None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:14.538267 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce808b38-9285-4c73-861e-771d65b3b74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:14.555812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-ce808b38-9285-4c73-861e-771d65b3b74a None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:51:14.557039 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ce808b38-9285-4c73-861e-771d65b3b74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:51:14.564835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 19:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:51:14.602301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5de521-928b-448b-bc5e-be91a811ee3a None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:51:14.612917 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5de521-928b-448b-bc5e-be91a811ee3a None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:51:14.617266 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd497157-a52d-4c35-aea2-13ad9980cb51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:51:14.617928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd497157-a52d-4c35-aea2-13ad9980cb51 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:14.618216 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd497157-a52d-4c35-aea2-13ad9980cb51 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:14.618501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd497157-a52d-4c35-aea2-13ad9980cb51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:14.627449 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd497157-a52d-4c35-aea2-13ad9980cb51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:51:14.628878 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd497157-a52d-4c35-aea2-13ad9980cb51 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:51:14.639404 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 734/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:51:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:51:24.550614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=17 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:51:24.635076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=17 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:51:34.730681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85796c31-482b-4677-991b-c1f007fb1e3d None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:34.731263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85796c31-482b-4677-991b-c1f007fb1e3d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:34.731263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85796c31-482b-4677-991b-c1f007fb1e3d None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:34.732612 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 737/1471] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:51:34.738042 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184d6d5-c392-420a-b344-666d29a8e4c6 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:34.738698 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184d6d5-c392-420a-b344-666d29a8e4c6 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:34.738698 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184d6d5-c392-420a-b344-666d29a8e4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:34.756097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-3184d6d5-c392-420a-b344-666d29a8e4c6 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:51:34.757315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-3184d6d5-c392-420a-b344-666d29a8e4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:51:34.765001 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 735/1472] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:51:34.811978 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53e0e6-9e02-4cae-b2c9-a28cd49b9df3 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:34.812268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53e0e6-9e02-4cae-b2c9-a28cd49b9df3 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:34.812550 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53e0e6-9e02-4cae-b2c9-a28cd49b9df3 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:34.813956 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 738/1473] 10.222.0.13 () {54 vars in 962 bytes} [Thu Jun 23 19:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:51:34.819104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28487f7-c817-4842-b48b-c06947dd179b None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:34.819397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28487f7-c817-4842-b48b-c06947dd179b None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:34.819681 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28487f7-c817-4842-b48b-c06947dd179b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:34.838493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-d28487f7-c817-4842-b48b-c06947dd179b None None] MFA Rules not processed for user `f078219032be4b619119d1d9d59c499d`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:51:34.839694 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d28487f7-c817-4842-b48b-c06947dd179b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:51:34.846129 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 736/1474] 10.222.0.13 () {58 vars in 1059 bytes} [Thu Jun 23 19:51:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:51:34.853459 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53e0e6-9e02-4cae-b2c9-a28cd49b9df3 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:51:34.864539 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53e0e6-9e02-4cae-b2c9-a28cd49b9df3 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:51:34.868055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6940df-563d-4929-b28b-5a21b9e76be4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f078219032be4b619119d1d9d59c499d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:51:34.868675 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6940df-563d-4929-b28b-5a21b9e76be4 service glance] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:34.868961 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6940df-563d-4929-b28b-5a21b9e76be4 service glance] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:34.869272 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6940df-563d-4929-b28b-5a21b9e76be4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:34.878405 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6940df-563d-4929-b28b-5a21b9e76be4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:51:34.880586 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6940df-563d-4929-b28b-5a21b9e76be4 service glance] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:51:34.890113 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 739/1475] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:51:37.028901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a3505-386e-4bc9-bbc7-ae0466344437 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:37.029461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a3505-386e-4bc9-bbc7-ae0466344437 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:37.029461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a3505-386e-4bc9-bbc7-ae0466344437 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:37.030760 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 737/1476] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:51:37.036103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c20fb-afe9-43d4-9c4c-2fbd6b6ebbee None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:37.036519 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c20fb-afe9-43d4-9c4c-2fbd6b6ebbee None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:37.036666 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c20fb-afe9-43d4-9c4c-2fbd6b6ebbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:37.054307 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-107c20fb-afe9-43d4-9c4c-2fbd6b6ebbee None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:51:37.058910 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-107c20fb-afe9-43d4-9c4c-2fbd6b6ebbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:51:37.063398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 740/1477] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:51:37.088422 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a3505-386e-4bc9-bbc7-ae0466344437 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:51:37.101327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a3505-386e-4bc9-bbc7-ae0466344437 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:51:37.106047 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdc1ad-8f44-4cb4-bd24-a39fd4720186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:51:37.106701 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdc1ad-8f44-4cb4-bd24-a39fd4720186 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:37.106990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdc1ad-8f44-4cb4-bd24-a39fd4720186 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:37.107270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdc1ad-8f44-4cb4-bd24-a39fd4720186 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:37.108064 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdc1ad-8f44-4cb4-bd24-a39fd4720186 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:51:37.109893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: WARNING py.warnings [None req-b2bdc1ad-8f44-4cb4-bd24-a39fd4720186 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 19:51:37.109893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: warnings.warn(msg) Jun 23 19:51:37.109893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: Jun 23 19:51:37.111036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdc1ad-8f44-4cb4-bd24-a39fd4720186 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:51:37.131376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 738/1478] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 19:51:37 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:51:39.190968 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9daae7-5173-49f3-bc52-6b6d82d89cf2 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:39.192048 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9daae7-5173-49f3-bc52-6b6d82d89cf2 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:39.192244 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9daae7-5173-49f3-bc52-6b6d82d89cf2 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:39.193682 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 741/1479] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:51:39.199037 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429e32d-fdef-4c56-b564-eebcdd4e0886 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:39.199443 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429e32d-fdef-4c56-b564-eebcdd4e0886 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:39.199610 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429e32d-fdef-4c56-b564-eebcdd4e0886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:39.217950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-7429e32d-fdef-4c56-b564-eebcdd4e0886 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:51:39.219157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7429e32d-fdef-4c56-b564-eebcdd4e0886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:51:39.226987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 739/1480] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:51:39.269496 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9daae7-5173-49f3-bc52-6b6d82d89cf2 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:51:39.284393 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9daae7-5173-49f3-bc52-6b6d82d89cf2 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:51:39.290032 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909a783-d9f9-4ac1-bbd3-4520f8cb5de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:51:39.290670 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909a783-d9f9-4ac1-bbd3-4520f8cb5de4 service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:39.290958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909a783-d9f9-4ac1-bbd3-4520f8cb5de4 service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:39.291239 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909a783-d9f9-4ac1-bbd3-4520f8cb5de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:39.299521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909a783-d9f9-4ac1-bbd3-4520f8cb5de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:51:39.301126 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909a783-d9f9-4ac1-bbd3-4520f8cb5de4 service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:51:39.310542 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 742/1481] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:51:41.527944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1d01a-a5f0-4aef-9305-f287b2e85563 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:41.528512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1d01a-a5f0-4aef-9305-f287b2e85563 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:41.528512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1d01a-a5f0-4aef-9305-f287b2e85563 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:41.529903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 740/1482] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:51:41.536210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555027a9-aaca-4df6-b5d2-ce6aaf9759b3 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:41.536616 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555027a9-aaca-4df6-b5d2-ce6aaf9759b3 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:41.536774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555027a9-aaca-4df6-b5d2-ce6aaf9759b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:41.554859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-555027a9-aaca-4df6-b5d2-ce6aaf9759b3 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:51:41.556047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-555027a9-aaca-4df6-b5d2-ce6aaf9759b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:51:41.563665 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 743/1483] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:51:41.601535 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1d01a-a5f0-4aef-9305-f287b2e85563 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:51:41.612165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1d01a-a5f0-4aef-9305-f287b2e85563 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:51:41.616207 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3806565-8281-4872-9d65-316b5bed1c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:51:41.621303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3806565-8281-4872-9d65-316b5bed1c15 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:41.621303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3806565-8281-4872-9d65-316b5bed1c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:41.621303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3806565-8281-4872-9d65-316b5bed1c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:41.626188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3806565-8281-4872-9d65-316b5bed1c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:51:41.627612 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3806565-8281-4872-9d65-316b5bed1c15 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:51:41.637283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 741/1484] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:51:43.798034 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa17a7a-d72a-4c45-92d8-77dfaad6aa5f None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:43.798599 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa17a7a-d72a-4c45-92d8-77dfaad6aa5f None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:43.798599 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa17a7a-d72a-4c45-92d8-77dfaad6aa5f None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:43.800001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 744/1485] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:51:43.805590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ac059-9ee6-40df-a6f8-ba0bb4cbfeca None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:43.805988 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ac059-9ee6-40df-a6f8-ba0bb4cbfeca None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:43.806148 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ac059-9ee6-40df-a6f8-ba0bb4cbfeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:43.823875 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-d45ac059-9ee6-40df-a6f8-ba0bb4cbfeca None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:51:43.825050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d45ac059-9ee6-40df-a6f8-ba0bb4cbfeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:51:43.833540 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 742/1486] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:51:43.871424 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa17a7a-d72a-4c45-92d8-77dfaad6aa5f None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:51:43.882710 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa17a7a-d72a-4c45-92d8-77dfaad6aa5f None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:51:43.886165 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df305113-5cc4-4d8a-9cc4-ce4694e1ae03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:51:43.886795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df305113-5cc4-4d8a-9cc4-ce4694e1ae03 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:43.887076 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df305113-5cc4-4d8a-9cc4-ce4694e1ae03 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:43.887348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df305113-5cc4-4d8a-9cc4-ce4694e1ae03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:43.896328 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df305113-5cc4-4d8a-9cc4-ce4694e1ae03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:51:43.897804 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df305113-5cc4-4d8a-9cc4-ce4694e1ae03 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:51:43.907161 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 745/1487] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:51:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:51:46.107962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540551e2-7cf2-4c1d-b779-e8ff5347ace9 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:46.108551 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540551e2-7cf2-4c1d-b779-e8ff5347ace9 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:46.108551 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540551e2-7cf2-4c1d-b779-e8ff5347ace9 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:46.109918 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 743/1488] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:51:46.115715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10717175-f435-48ad-babf-823470c93053 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:46.116118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10717175-f435-48ad-babf-823470c93053 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:46.116285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10717175-f435-48ad-babf-823470c93053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:46.134698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-10717175-f435-48ad-babf-823470c93053 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:51:46.135889 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-10717175-f435-48ad-babf-823470c93053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:51:46.143686 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 746/1489] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:51:46.183534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540551e2-7cf2-4c1d-b779-e8ff5347ace9 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:51:46.194212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540551e2-7cf2-4c1d-b779-e8ff5347ace9 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:51:46.197672 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316ced8-51f3-4857-910d-8c8945aac34d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:51:46.198299 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316ced8-51f3-4857-910d-8c8945aac34d service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:46.198584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316ced8-51f3-4857-910d-8c8945aac34d service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:46.198863 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316ced8-51f3-4857-910d-8c8945aac34d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:46.208359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316ced8-51f3-4857-910d-8c8945aac34d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:51:46.209838 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316ced8-51f3-4857-910d-8c8945aac34d service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:51:46.219076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 744/1490] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:51:48.661876 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a629ce3-f567-48d1-a4bc-2d44325f2fca None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:48.662521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a629ce3-f567-48d1-a4bc-2d44325f2fca None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:48.662521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a629ce3-f567-48d1-a4bc-2d44325f2fca None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:48.663795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 747/1491] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 19:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:51:48.669174 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e5883-ce21-4e84-bc64-6c4d964c6bf4 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:48.669632 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e5883-ce21-4e84-bc64-6c4d964c6bf4 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:48.669745 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e5883-ce21-4e84-bc64-6c4d964c6bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:48.688411 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-ef6e5883-ce21-4e84-bc64-6c4d964c6bf4 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:51:48.689645 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ef6e5883-ce21-4e84-bc64-6c4d964c6bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:51:48.699961 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 745/1492] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 19:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:51:48.740771 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a629ce3-f567-48d1-a4bc-2d44325f2fca None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:51:48.751527 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a629ce3-f567-48d1-a4bc-2d44325f2fca None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:51:48.755245 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc29b8-d9b2-48a7-99bc-e106cf0c9a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:51:48.755883 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc29b8-d9b2-48a7-99bc-e106cf0c9a79 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:51:48.756170 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc29b8-d9b2-48a7-99bc-e106cf0c9a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:51:48.756450 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc29b8-d9b2-48a7-99bc-e106cf0c9a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:51:48.765401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc29b8-d9b2-48a7-99bc-e106cf0c9a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:51:48.766836 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc29b8-d9b2-48a7-99bc-e106cf0c9a79 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:51:48.776769 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 748/1493] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:51:58.683174 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=33 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:51:58.772359 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=33 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:53:29.987387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63510748-65e2-4de3-802c-294767a45b5f None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:53:29.987945 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63510748-65e2-4de3-802c-294767a45b5f None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:53:29.987945 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63510748-65e2-4de3-802c-294767a45b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:53:30.005711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-63510748-65e2-4de3-802c-294767a45b5f None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:53:30.006916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-63510748-65e2-4de3-802c-294767a45b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:53:30.014737 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 746/1494] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:53:30.024464 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292687f-2171-4cfb-8b48-0f128b905f02 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:53:30.024945 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292687f-2171-4cfb-8b48-0f128b905f02 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:53:30.025047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292687f-2171-4cfb-8b48-0f128b905f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:53:30.042979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-9292687f-2171-4cfb-8b48-0f128b905f02 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:53:30.044173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-9292687f-2171-4cfb-8b48-0f128b905f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:53:30.052078 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 749/1495] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:53:30.056499 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63510748-65e2-4de3-802c-294767a45b5f None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:53:30.066114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63510748-65e2-4de3-802c-294767a45b5f None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:53:30.070631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e54105-2337-4cdb-9185-828789194f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:53:30.071306 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e54105-2337-4cdb-9185-828789194f77 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:53:30.071599 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e54105-2337-4cdb-9185-828789194f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:53:30.071881 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e54105-2337-4cdb-9185-828789194f77 admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:53:30.072619 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e54105-2337-4cdb-9185-828789194f77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:53:30.072928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e54105-2337-4cdb-9185-828789194f77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:53:30.073994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: WARNING py.warnings [None req-35e54105-2337-4cdb-9185-828789194f77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 19:53:30.073994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: warnings.warn(msg) Jun 23 19:53:30.073994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: Jun 23 19:53:30.074880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e54105-2337-4cdb-9185-828789194f77 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:53:30.086910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 747/1496] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:53:30.094721 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292687f-2171-4cfb-8b48-0f128b905f02 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:53:30.104308 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292687f-2171-4cfb-8b48-0f128b905f02 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:53:30.108854 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29b953-7bfe-4648-ac80-2305e3832287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:53:30.109528 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29b953-7bfe-4648-ac80-2305e3832287 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:53:30.109815 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29b953-7bfe-4648-ac80-2305e3832287 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:53:30.110119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29b953-7bfe-4648-ac80-2305e3832287 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:53:30.110798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29b953-7bfe-4648-ac80-2305e3832287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:53:30.112566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: WARNING py.warnings [None req-2a29b953-7bfe-4648-ac80-2305e3832287 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 19:53:30.112566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: warnings.warn(msg) Jun 23 19:53:30.112566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: Jun 23 19:53:30.113860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29b953-7bfe-4648-ac80-2305e3832287 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:53:30.233403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 750/1497] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:53:30 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:53:30.237456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e54105-2337-4cdb-9185-828789194f77 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:53:30.247385 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e54105-2337-4cdb-9185-828789194f77 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:53:30.303220 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ea324-f391-44bc-b8ed-85722dc42163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:53:30.303892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ea324-f391-44bc-b8ed-85722dc42163 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:53:30.304179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ea324-f391-44bc-b8ed-85722dc42163 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:53:30.304460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ea324-f391-44bc-b8ed-85722dc42163 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:53:30.305176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ea324-f391-44bc-b8ed-85722dc42163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:53:30.306202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: WARNING py.warnings [None req-fb7ea324-f391-44bc-b8ed-85722dc42163 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 19:53:30.306202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: warnings.warn(msg) Jun 23 19:53:30.306202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: Jun 23 19:53:30.307403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ea324-f391-44bc-b8ed-85722dc42163 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:53:30.553656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 748/1498] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:53:30 2022] POST /identity/v3/users => generated 290 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:53:30.557610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29b953-7bfe-4648-ac80-2305e3832287 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:53:30.568810 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29b953-7bfe-4648-ac80-2305e3832287 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:53:30.573940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303cff4-0b40-4ea2-9304-fc66bea96237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:53:30.573940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303cff4-0b40-4ea2-9304-fc66bea96237 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:53:30.574223 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303cff4-0b40-4ea2-9304-fc66bea96237 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:53:30.574502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303cff4-0b40-4ea2-9304-fc66bea96237 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:53:30.575327 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303cff4-0b40-4ea2-9304-fc66bea96237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:53:30.576337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: WARNING py.warnings [None req-8303cff4-0b40-4ea2-9304-fc66bea96237 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 19:53:30.576337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: warnings.warn(msg) Jun 23 19:53:30.576337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: Jun 23 19:53:30.577246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303cff4-0b40-4ea2-9304-fc66bea96237 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:53:30.593309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 751/1499] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:53:30.597496 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ea324-f391-44bc-b8ed-85722dc42163 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:53:30.607357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ea324-f391-44bc-b8ed-85722dc42163 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:53:30.612059 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ce87f-be29-48a0-bebe-1b8cc2fa6156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:53:30.612727 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ce87f-be29-48a0-bebe-1b8cc2fa6156 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:53:30.613045 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ce87f-be29-48a0-bebe-1b8cc2fa6156 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:53:30.622888 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ce87f-be29-48a0-bebe-1b8cc2fa6156 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:53:30.622888 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ce87f-be29-48a0-bebe-1b8cc2fa6156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:53:30.622888 dv-cinder-847274-2-smb devstack@keystone.service[91965]: WARNING py.warnings [None req-3f4ce87f-be29-48a0-bebe-1b8cc2fa6156 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 19:53:30.622888 dv-cinder-847274-2-smb devstack@keystone.service[91965]: warnings.warn(msg) Jun 23 19:53:30.622888 dv-cinder-847274-2-smb devstack@keystone.service[91965]: Jun 23 19:53:30.622888 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ce87f-be29-48a0-bebe-1b8cc2fa6156 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:53:30.630253 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 749/1500] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:53:30.634206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303cff4-0b40-4ea2-9304-fc66bea96237 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:53:30.644144 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303cff4-0b40-4ea2-9304-fc66bea96237 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:53:30.649745 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc69c3-d282-48ca-8bfc-3a720273721c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:53:30.650632 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc69c3-d282-48ca-8bfc-3a720273721c admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:53:30.661071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc69c3-d282-48ca-8bfc-3a720273721c admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:53:30.661071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc69c3-d282-48ca-8bfc-3a720273721c admin admin] PATH_INFO: `/v3/projects/a9c0b9d86455479ab822df8660518cbc/users/3dbbfc3552e940c2a0b3a5b74439bfe5/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:53:30.666217 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc69c3-d282-48ca-8bfc-3a720273721c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9c0b9d86455479ab822df8660518cbc, user_id=3dbbfc3552e940c2a0b3a5b74439bfe5, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:53:30.667256 dv-cinder-847274-2-smb devstack@keystone.service[91966]: WARNING py.warnings [None req-50cc69c3-d282-48ca-8bfc-3a720273721c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 19:53:30.667256 dv-cinder-847274-2-smb devstack@keystone.service[91966]: warnings.warn(msg) Jun 23 19:53:30.667256 dv-cinder-847274-2-smb devstack@keystone.service[91966]: Jun 23 19:53:30.669204 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc69c3-d282-48ca-8bfc-3a720273721c admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:53:30.746447 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 752/1501] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:53:30 2022] PUT /identity/v3/projects/a9c0b9d86455479ab822df8660518cbc/users/3dbbfc3552e940c2a0b3a5b74439bfe5/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:53:30.758630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af600467-5bbf-496e-8a73-31525cf0fc0c None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:53:30.758924 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af600467-5bbf-496e-8a73-31525cf0fc0c None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:53:30.766275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af600467-5bbf-496e-8a73-31525cf0fc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:53:30.786149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-af600467-5bbf-496e-8a73-31525cf0fc0c None None] MFA Rules not processed for user `3dbbfc3552e940c2a0b3a5b74439bfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:53:30.787344 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-af600467-5bbf-496e-8a73-31525cf0fc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:53:30.851478 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 750/1502] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:53:30.869402 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cfcb6-5063-435b-aa5e-6963d77a2ea4 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:53:30.869693 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cfcb6-5063-435b-aa5e-6963d77a2ea4 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:53:30.869969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cfcb6-5063-435b-aa5e-6963d77a2ea4 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:53:30.871332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 753/1503] 10.222.0.13 () {54 vars in 963 bytes} [Thu Jun 23 19:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:53:30.876212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113b1ea-4392-42da-8293-85eadfaf8777 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:53:30.876506 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113b1ea-4392-42da-8293-85eadfaf8777 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:53:30.876789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113b1ea-4392-42da-8293-85eadfaf8777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:53:30.895767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-1113b1ea-4392-42da-8293-85eadfaf8777 None None] MFA Rules not processed for user `4ab2b3700cdf48f08a049fbb76ee189c`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:53:30.896986 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-1113b1ea-4392-42da-8293-85eadfaf8777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:53:30.940018 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:53:30.947968 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 751/1504] 10.222.0.13 () {58 vars in 1060 bytes} [Thu Jun 23 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:53:30.955697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cfcb6-5063-435b-aa5e-6963d77a2ea4 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:53:30.966609 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cfcb6-5063-435b-aa5e-6963d77a2ea4 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:53:30.970131 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1aec8-1883-4171-84c3-9a3481b24c9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:53:30.970762 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1aec8-1883-4171-84c3-9a3481b24c9f service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:53:30.971048 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1aec8-1883-4171-84c3-9a3481b24c9f service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:53:30.971330 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1aec8-1883-4171-84c3-9a3481b24c9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:53:30.979980 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1aec8-1883-4171-84c3-9a3481b24c9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:53:30.981441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1aec8-1883-4171-84c3-9a3481b24c9f service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:53:30.990713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 754/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:53:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:53:31.035083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62062-a13c-43cc-be70-c5e3593967aa None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:53:31.035572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62062-a13c-43cc-be70-c5e3593967aa None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:53:31.035689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62062-a13c-43cc-be70-c5e3593967aa None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:53:31.037226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 752/1506] 10.222.0.13 () {52 vars in 829 bytes} [Thu Jun 23 19:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:53:31.040788 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1aec8-1883-4171-84c3-9a3481b24c9f service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:53:31.104268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1aec8-1883-4171-84c3-9a3481b24c9f service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:53:31.108740 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f5059-97e6-48e3-b309-be4b0453f075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:53:31.109631 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f5059-97e6-48e3-b309-be4b0453f075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:53:31.109919 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f5059-97e6-48e3-b309-be4b0453f075 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:53:31.110201 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f5059-97e6-48e3-b309-be4b0453f075 admin admin] PATH_INFO: `/v3/users/3dbbfc3552e940c2a0b3a5b74439bfe5` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:53:31.111377 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f5059-97e6-48e3-b309-be4b0453f075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dbbfc3552e940c2a0b3a5b74439bfe5)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:53:31.112394 dv-cinder-847274-2-smb devstack@keystone.service[91966]: WARNING py.warnings [None req-493f5059-97e6-48e3-b309-be4b0453f075 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 19:53:31.112394 dv-cinder-847274-2-smb devstack@keystone.service[91966]: warnings.warn(msg) Jun 23 19:53:31.112394 dv-cinder-847274-2-smb devstack@keystone.service[91966]: Jun 23 19:53:31.114301 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f5059-97e6-48e3-b309-be4b0453f075 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:53:31.346997 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-493f5059-97e6-48e3-b309-be4b0453f075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dbbfc3552e940c2a0b3a5b74439bfe5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:53:31.366226 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-493f5059-97e6-48e3-b309-be4b0453f075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dbbfc3552e940c2a0b3a5b74439bfe5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:53:31.449140 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-493f5059-97e6-48e3-b309-be4b0453f075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dbbfc3552e940c2a0b3a5b74439bfe5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:53:31.449805 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-493f5059-97e6-48e3-b309-be4b0453f075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dbbfc3552e940c2a0b3a5b74439bfe5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:53:31.459331 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:53:31.463571 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-493f5059-97e6-48e3-b309-be4b0453f075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dbbfc3552e940c2a0b3a5b74439bfe5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:53:31.469710 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 755/1507] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:53:31 2022] DELETE /identity/v3/users/3dbbfc3552e940c2a0b3a5b74439bfe5 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:53:31.475365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f822488-3ab3-4924-a9f5-b24b1f8b0b95 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:53:31.475654 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f822488-3ab3-4924-a9f5-b24b1f8b0b95 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:53:31.475934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f822488-3ab3-4924-a9f5-b24b1f8b0b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:53:31.493993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-0f822488-3ab3-4924-a9f5-b24b1f8b0b95 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:53:31.500702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0f822488-3ab3-4924-a9f5-b24b1f8b0b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:53:31.555060 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 753/1508] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:53:31.564463 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f5059-97e6-48e3-b309-be4b0453f075 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:53:31.565881 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-493f5059-97e6-48e3-b309-be4b0453f075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:53:31.623899 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f5059-97e6-48e3-b309-be4b0453f075 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:53:31.627316 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812aff8a-c463-44b1-a1d8-cea26d4bbb60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:53:31.627948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aff8a-c463-44b1-a1d8-cea26d4bbb60 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:53:31.628238 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aff8a-c463-44b1-a1d8-cea26d4bbb60 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:53:31.628517 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aff8a-c463-44b1-a1d8-cea26d4bbb60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:53:31.637777 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812aff8a-c463-44b1-a1d8-cea26d4bbb60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:53:31.639207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812aff8a-c463-44b1-a1d8-cea26d4bbb60 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:53:31.649437 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 756/1509] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:53:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:53:32.222737 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f822488-3ab3-4924-a9f5-b24b1f8b0b95 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:53:32.229604 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0f822488-3ab3-4924-a9f5-b24b1f8b0b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:53:32.236132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f822488-3ab3-4924-a9f5-b24b1f8b0b95 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:53:32.242066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373396e-ac96-40bc-93b0-1015006d27d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:53:32.243539 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373396e-ac96-40bc-93b0-1015006d27d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:53:32.243990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373396e-ac96-40bc-93b0-1015006d27d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:53:32.244289 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373396e-ac96-40bc-93b0-1015006d27d7 admin admin] PATH_INFO: `/v3/projects/a9c0b9d86455479ab822df8660518cbc` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:53:32.245562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373396e-ac96-40bc-93b0-1015006d27d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9c0b9d86455479ab822df8660518cbc)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:53:32.246594 dv-cinder-847274-2-smb devstack@keystone.service[91965]: WARNING py.warnings [None req-9373396e-ac96-40bc-93b0-1015006d27d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 19:53:32.246594 dv-cinder-847274-2-smb devstack@keystone.service[91965]: warnings.warn(msg) Jun 23 19:53:32.246594 dv-cinder-847274-2-smb devstack@keystone.service[91965]: Jun 23 19:53:32.248614 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373396e-ac96-40bc-93b0-1015006d27d7 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:53:32.379708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9373396e-ac96-40bc-93b0-1015006d27d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9c0b9d86455479ab822df8660518cbc', 'request_id': 'req-9373396e-ac96-40bc-93b0-1015006d27d7'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:53:32.394353 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9373396e-ac96-40bc-93b0-1015006d27d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9c0b9d86455479ab822df8660518cbc', 'request_id': 'req-9373396e-ac96-40bc-93b0-1015006d27d7'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:53:32.400902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9373396e-ac96-40bc-93b0-1015006d27d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9c0b9d86455479ab822df8660518cbc', 'request_id': 'req-9373396e-ac96-40bc-93b0-1015006d27d7'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:53:32.499224 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9373396e-ac96-40bc-93b0-1015006d27d7 admin admin] The token cache is being invalidate because project a9c0b9d86455479ab822df8660518cbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:53:32.499447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9373396e-ac96-40bc-93b0-1015006d27d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:53:32.500199 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9373396e-ac96-40bc-93b0-1015006d27d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:53:32.501824 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 754/1510] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:53:32 2022] DELETE /identity/v3/projects/a9c0b9d86455479ab822df8660518cbc => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:53:41.644305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=29 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:53:42.496074 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:55:18.811350 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dff66-1cb9-4f82-ad6d-aff12c719ecd None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:18.811958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dff66-1cb9-4f82-ad6d-aff12c719ecd None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:18.811958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dff66-1cb9-4f82-ad6d-aff12c719ecd None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:18.813303 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 19:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:55:18.818259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f913c-9cad-4574-9c62-c0cbc0d65898 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:18.818698 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f913c-9cad-4574-9c62-c0cbc0d65898 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:18.818836 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f913c-9cad-4574-9c62-c0cbc0d65898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:18.837294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-370f913c-9cad-4574-9c62-c0cbc0d65898 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:55:18.838771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-370f913c-9cad-4574-9c62-c0cbc0d65898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:55:18.898066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 19:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:55:19.052150 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dff66-1cb9-4f82-ad6d-aff12c719ecd None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:55:19.053863 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-1a3dff66-1cb9-4f82-ad6d-aff12c719ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:55:19.127586 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dff66-1cb9-4f82-ad6d-aff12c719ecd None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:55:19.132842 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ed965-589c-40bc-b63a-b025f09b783a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:55:19.133520 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ed965-589c-40bc-b63a-b025f09b783a service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:19.133813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ed965-589c-40bc-b63a-b025f09b783a service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:19.134096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ed965-589c-40bc-b63a-b025f09b783a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:19.142746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ed965-589c-40bc-b63a-b025f09b783a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:55:19.144345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ed965-589c-40bc-b63a-b025f09b783a service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:55:19.153723 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 758/1513] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:55:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:55:19.996428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd00ca-5eca-4dca-aa2d-46e3b164d332 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:19.996961 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd00ca-5eca-4dca-aa2d-46e3b164d332 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:19.997073 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd00ca-5eca-4dca-aa2d-46e3b164d332 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:19.998428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 19:55:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:55:20.003433 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571ff5a-94b2-4c10-84e5-b841e9a59d09 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:20.003848 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571ff5a-94b2-4c10-84e5-b841e9a59d09 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:20.004003 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571ff5a-94b2-4c10-84e5-b841e9a59d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:20.021966 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-e571ff5a-94b2-4c10-84e5-b841e9a59d09 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:55:20.023175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e571ff5a-94b2-4c10-84e5-b841e9a59d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:55:20.031630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 19:55:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:55:20.181746 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd00ca-5eca-4dca-aa2d-46e3b164d332 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:55:20.196277 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd00ca-5eca-4dca-aa2d-46e3b164d332 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:55:20.202376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653ace8-ff62-4a6c-9aaf-de5d067cf154 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:55:20.203006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653ace8-ff62-4a6c-9aaf-de5d067cf154 service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:20.203288 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653ace8-ff62-4a6c-9aaf-de5d067cf154 service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:20.203564 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653ace8-ff62-4a6c-9aaf-de5d067cf154 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:20.211549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653ace8-ff62-4a6c-9aaf-de5d067cf154 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:55:20.213437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653ace8-ff62-4a6c-9aaf-de5d067cf154 service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:55:20.224812 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 757/1516] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:55:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:55:20.955045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466157b-4327-4361-8de1-3e6607baab4a None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:20.955338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466157b-4327-4361-8de1-3e6607baab4a None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:20.955622 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466157b-4327-4361-8de1-3e6607baab4a None None] PATH_INFO: `/v3` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:20.956973 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 760/1517] 10.222.0.16 () {54 vars in 925 bytes} [Thu Jun 23 19:55:20 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:55:20.965311 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493e412-60a7-4214-b0e5-b274fef2886c None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:20.965614 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493e412-60a7-4214-b0e5-b274fef2886c None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:20.965901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493e412-60a7-4214-b0e5-b274fef2886c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:20.984450 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-e493e412-60a7-4214-b0e5-b274fef2886c None None] MFA Rules not processed for user `7e9ba6d33e8640ec8dcda9971f59c5dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:55:20.991368 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e493e412-60a7-4214-b0e5-b274fef2886c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:55:21.051067 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 758/1518] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Jun 23 19:55:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:55:30.016653 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=37 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:55:30.184994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea874a-a5b9-413f-81a7-3d6f34830f6c None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:30.185227 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea874a-a5b9-413f-81a7-3d6f34830f6c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:30.185517 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea874a-a5b9-413f-81a7-3d6f34830f6c None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:30.187167 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 761/1519] 10.222.0.13 () {54 vars in 960 bytes} [Thu Jun 23 19:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:55:30.192008 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c61de1-b518-4ef9-b65c-60ae3f166479 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:30.192489 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c61de1-b518-4ef9-b65c-60ae3f166479 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:30.192596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c61de1-b518-4ef9-b65c-60ae3f166479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:30.210821 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-15c61de1-b518-4ef9-b65c-60ae3f166479 None None] MFA Rules not processed for user `7e9ba6d33e8640ec8dcda9971f59c5dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:55:30.212025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-15c61de1-b518-4ef9-b65c-60ae3f166479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:55:30.221355 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 759/1520] 10.222.0.13 () {58 vars in 1057 bytes} [Thu Jun 23 19:55:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:55:30.228736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea874a-a5b9-413f-81a7-3d6f34830f6c None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:55:30.241953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea874a-a5b9-413f-81a7-3d6f34830f6c None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:55:30.246763 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d70300-e17a-4854-aff6-9eb544cbcac9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9ba6d33e8640ec8dcda9971f59c5dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:55:30.247377 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d70300-e17a-4854-aff6-9eb544cbcac9 service placement] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:30.247698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d70300-e17a-4854-aff6-9eb544cbcac9 service placement] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:30.247992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d70300-e17a-4854-aff6-9eb544cbcac9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:30.256210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d70300-e17a-4854-aff6-9eb544cbcac9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:55:30.257908 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d70300-e17a-4854-aff6-9eb544cbcac9 service placement] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:55:30.268862 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 762/1521] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:55:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:55:31.484411 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39196f-fd40-4ca8-9e8a-95c2cba65555 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:31.484965 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39196f-fd40-4ca8-9e8a-95c2cba65555 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:31.484965 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39196f-fd40-4ca8-9e8a-95c2cba65555 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:31.486350 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 19:55:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:55:31.491430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6649df-a4ca-469e-99d3-8a0d161f6d1c None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:31.491863 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6649df-a4ca-469e-99d3-8a0d161f6d1c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:31.491988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6649df-a4ca-469e-99d3-8a0d161f6d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:31.509561 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-bb6649df-a4ca-469e-99d3-8a0d161f6d1c None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:55:31.513213 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-bb6649df-a4ca-469e-99d3-8a0d161f6d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:55:31.518581 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 19:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:55:31.672729 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39196f-fd40-4ca8-9e8a-95c2cba65555 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:55:31.687069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39196f-fd40-4ca8-9e8a-95c2cba65555 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:55:31.692384 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b80f63-ac9d-4f65-b93e-34706e6b36ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:55:31.693019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b80f63-ac9d-4f65-b93e-34706e6b36ab service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:31.693397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b80f63-ac9d-4f65-b93e-34706e6b36ab service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:31.693679 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b80f63-ac9d-4f65-b93e-34706e6b36ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:31.702566 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b80f63-ac9d-4f65-b93e-34706e6b36ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:55:31.704168 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b80f63-ac9d-4f65-b93e-34706e6b36ab service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:55:31.713823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 761/1524] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:55:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:55:32.530136 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b744b85-a7d7-4272-957c-9d61016f0321 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:32.530705 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b744b85-a7d7-4272-957c-9d61016f0321 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:32.530705 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b744b85-a7d7-4272-957c-9d61016f0321 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:32.532085 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 19:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:55:32.537093 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7297f1-62b1-48b9-8727-1712bd053a4a None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:32.537532 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7297f1-62b1-48b9-8727-1712bd053a4a None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:32.537682 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7297f1-62b1-48b9-8727-1712bd053a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:32.555501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-7e7297f1-62b1-48b9-8727-1712bd053a4a None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:55:32.556728 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7e7297f1-62b1-48b9-8727-1712bd053a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:55:32.565115 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 19:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:55:32.716993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b744b85-a7d7-4272-957c-9d61016f0321 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:55:32.731465 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b744b85-a7d7-4272-957c-9d61016f0321 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:55:32.737568 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dee80d-26eb-4195-9f74-f7cd24255480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:55:32.738193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dee80d-26eb-4195-9f74-f7cd24255480 service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:32.738476 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dee80d-26eb-4195-9f74-f7cd24255480 service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:32.738753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dee80d-26eb-4195-9f74-f7cd24255480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:32.746671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dee80d-26eb-4195-9f74-f7cd24255480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:55:32.748242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dee80d-26eb-4195-9f74-f7cd24255480 service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:55:32.757573 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 765/1527] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:55:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:55:36.714913 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f73427-e0d5-4f2c-b50a-8405c17ae7ae None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:36.715459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f73427-e0d5-4f2c-b50a-8405c17ae7ae None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:36.715459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f73427-e0d5-4f2c-b50a-8405c17ae7ae None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:36.716741 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 19:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:55:36.722299 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932edbb2-e581-492f-ab24-d139ed48ec46 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:36.722744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932edbb2-e581-492f-ab24-d139ed48ec46 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:36.722856 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932edbb2-e581-492f-ab24-d139ed48ec46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:36.740418 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-932edbb2-e581-492f-ab24-d139ed48ec46 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:55:36.741659 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-932edbb2-e581-492f-ab24-d139ed48ec46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:55:36.749732 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 19:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:55:36.787376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f73427-e0d5-4f2c-b50a-8405c17ae7ae None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:55:36.789063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-63f73427-e0d5-4f2c-b50a-8405c17ae7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:55:36.846620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f73427-e0d5-4f2c-b50a-8405c17ae7ae None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:55:36.850277 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca81445-4547-49a8-8fff-034a01f0aab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:55:36.850946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca81445-4547-49a8-8fff-034a01f0aab1 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:36.851241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca81445-4547-49a8-8fff-034a01f0aab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:36.851524 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca81445-4547-49a8-8fff-034a01f0aab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:36.860944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca81445-4547-49a8-8fff-034a01f0aab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:55:36.862437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca81445-4547-49a8-8fff-034a01f0aab1 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:55:36.867434 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:55:36.872082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 764/1530] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:55:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:55:38.903662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ea996-3e93-4474-ab86-487335d1407d None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:38.904093 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ea996-3e93-4474-ab86-487335d1407d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:38.904222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ea996-3e93-4474-ab86-487335d1407d None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:38.905711 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 19:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:55:38.911836 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c981717-2ea7-4d79-a982-991d16ef7d27 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:38.912290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c981717-2ea7-4d79-a982-991d16ef7d27 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:38.912413 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c981717-2ea7-4d79-a982-991d16ef7d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:38.930626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-3c981717-2ea7-4d79-a982-991d16ef7d27 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:55:38.931809 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-3c981717-2ea7-4d79-a982-991d16ef7d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:55:38.939938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 19:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:55:38.975799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ea996-3e93-4474-ab86-487335d1407d None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:55:38.987172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ea996-3e93-4474-ab86-487335d1407d None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:55:38.990672 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e706eb-e5d5-48aa-8fef-8510cfe7e3b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:55:38.991309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e706eb-e5d5-48aa-8fef-8510cfe7e3b9 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:38.991599 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e706eb-e5d5-48aa-8fef-8510cfe7e3b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:38.991882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e706eb-e5d5-48aa-8fef-8510cfe7e3b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:39.000654 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e706eb-e5d5-48aa-8fef-8510cfe7e3b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:55:39.002441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e706eb-e5d5-48aa-8fef-8510cfe7e3b9 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:55:39.012017 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 768/1533] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:55:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:55:42.652142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a66ef-593e-4137-bd29-172f98099bca None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:42.652698 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a66ef-593e-4137-bd29-172f98099bca None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:42.652803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a66ef-593e-4137-bd29-172f98099bca None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:42.654128 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 19:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:55:42.659793 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b97404-89ca-4a70-a813-d672aac4f984 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:42.660223 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b97404-89ca-4a70-a813-d672aac4f984 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:42.660356 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b97404-89ca-4a70-a813-d672aac4f984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:42.678805 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-54b97404-89ca-4a70-a813-d672aac4f984 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:55:42.679990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-54b97404-89ca-4a70-a813-d672aac4f984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:55:42.687979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 19:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:55:42.989037 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a66ef-593e-4137-bd29-172f98099bca None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:55:42.990728 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-051a66ef-593e-4137-bd29-172f98099bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:55:43.047305 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a66ef-593e-4137-bd29-172f98099bca None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:55:43.051148 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ce491-ae41-448e-ac0d-81b86bac7579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:55:43.051785 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ce491-ae41-448e-ac0d-81b86bac7579 service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:43.052075 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ce491-ae41-448e-ac0d-81b86bac7579 service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:43.052354 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ce491-ae41-448e-ac0d-81b86bac7579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:43.061220 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ce491-ae41-448e-ac0d-81b86bac7579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:55:43.062632 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ce491-ae41-448e-ac0d-81b86bac7579 service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:55:43.072427 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 767/1536] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:55:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:55:45.129924 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb789e-16e3-45c1-88c9-6385fddd6d66 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:45.130466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb789e-16e3-45c1-88c9-6385fddd6d66 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:45.130466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb789e-16e3-45c1-88c9-6385fddd6d66 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:45.131874 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 19:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:55:45.137047 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668c6ab-a1c5-4ced-870b-00fb76615a79 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:45.137476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668c6ab-a1c5-4ced-870b-00fb76615a79 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:45.137638 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668c6ab-a1c5-4ced-870b-00fb76615a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:45.156320 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-0668c6ab-a1c5-4ced-870b-00fb76615a79 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:55:45.157809 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0668c6ab-a1c5-4ced-870b-00fb76615a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:55:45.166302 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 19:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:55:45.474412 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb789e-16e3-45c1-88c9-6385fddd6d66 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:55:45.476141 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-85bb789e-16e3-45c1-88c9-6385fddd6d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:55:45.490216 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb789e-16e3-45c1-88c9-6385fddd6d66 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:55:45.493685 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d116c35-a798-4108-af48-92029299b91a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:55:45.494325 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d116c35-a798-4108-af48-92029299b91a service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:55:45.494609 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d116c35-a798-4108-af48-92029299b91a service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:55:45.494887 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d116c35-a798-4108-af48-92029299b91a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:55:45.504285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d116c35-a798-4108-af48-92029299b91a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:55:45.505729 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d116c35-a798-4108-af48-92029299b91a service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:55:45.515099 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 771/1539] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:55:55.150904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=32 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:55:55.510999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=33 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:16.371593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01ed24-351d-430f-8fa8-539f861dfe15 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:16.373348 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01ed24-351d-430f-8fa8-539f861dfe15 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:16.373348 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01ed24-351d-430f-8fa8-539f861dfe15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:16.398157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-7c01ed24-351d-430f-8fa8-539f861dfe15 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:16.400334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7c01ed24-351d-430f-8fa8-539f861dfe15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:16.413737 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 769/1540] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:16.423279 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be015c49-7bb5-4174-9a45-acfa1b65d87a None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:16.423875 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be015c49-7bb5-4174-9a45-acfa1b65d87a None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:16.423875 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be015c49-7bb5-4174-9a45-acfa1b65d87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:16.446203 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-be015c49-7bb5-4174-9a45-acfa1b65d87a None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:16.447447 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-be015c49-7bb5-4174-9a45-acfa1b65d87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:16.462015 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 772/1541] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:16.466566 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01ed24-351d-430f-8fa8-539f861dfe15 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:16.477790 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01ed24-351d-430f-8fa8-539f861dfe15 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:16.483565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4380ac1-5ed5-42a6-b8e7-5db7daae7675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:16.484209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4380ac1-5ed5-42a6-b8e7-5db7daae7675 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:16.484489 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4380ac1-5ed5-42a6-b8e7-5db7daae7675 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:16.484764 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4380ac1-5ed5-42a6-b8e7-5db7daae7675 admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:16.485538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4380ac1-5ed5-42a6-b8e7-5db7daae7675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:57:16.485875 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4380ac1-5ed5-42a6-b8e7-5db7daae7675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:16.488195 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4380ac1-5ed5-42a6-b8e7-5db7daae7675 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:16.504196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 770/1542] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:57:16.512249 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be015c49-7bb5-4174-9a45-acfa1b65d87a None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:16.526942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be015c49-7bb5-4174-9a45-acfa1b65d87a None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:16.535508 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9997e8-4d17-4d9b-83be-5ab39dc32ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:16.536406 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9997e8-4d17-4d9b-83be-5ab39dc32ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:16.536859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9997e8-4d17-4d9b-83be-5ab39dc32ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:16.537415 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9997e8-4d17-4d9b-83be-5ab39dc32ef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:16.538286 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9997e8-4d17-4d9b-83be-5ab39dc32ef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:16.540451 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9997e8-4d17-4d9b-83be-5ab39dc32ef2 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:16.642924 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 773/1543] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:16 2022] POST /identity/v3/projects => generated 357 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:16.648235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4380ac1-5ed5-42a6-b8e7-5db7daae7675 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:16.670813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4380ac1-5ed5-42a6-b8e7-5db7daae7675 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:16.750328 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297dd93-6802-46b8-87ee-eeba1007ce72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:16.751685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297dd93-6802-46b8-87ee-eeba1007ce72 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:16.752240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297dd93-6802-46b8-87ee-eeba1007ce72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:16.752745 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297dd93-6802-46b8-87ee-eeba1007ce72 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:16.753752 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297dd93-6802-46b8-87ee-eeba1007ce72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:16.756064 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297dd93-6802-46b8-87ee-eeba1007ce72 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:16.873962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 771/1544] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:16 2022] POST /identity/v3/users => generated 279 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:16.882028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9997e8-4d17-4d9b-83be-5ab39dc32ef2 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:16.898501 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9997e8-4d17-4d9b-83be-5ab39dc32ef2 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:16.907022 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d89ce-e9d7-405e-b598-a6297559a207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:16.907720 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d89ce-e9d7-405e-b598-a6297559a207 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:16.908044 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d89ce-e9d7-405e-b598-a6297559a207 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:16.908324 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d89ce-e9d7-405e-b598-a6297559a207 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:16.909081 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d89ce-e9d7-405e-b598-a6297559a207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:16.911279 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d89ce-e9d7-405e-b598-a6297559a207 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:16.931189 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 774/1545] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:16.935419 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297dd93-6802-46b8-87ee-eeba1007ce72 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:16.959830 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297dd93-6802-46b8-87ee-eeba1007ce72 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:16.973964 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac99b5f-e00f-4c2f-a56c-72c8c86cf76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:16.974672 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac99b5f-e00f-4c2f-a56c-72c8c86cf76c admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:16.974966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac99b5f-e00f-4c2f-a56c-72c8c86cf76c admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:16.975255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac99b5f-e00f-4c2f-a56c-72c8c86cf76c admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:16.976158 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac99b5f-e00f-4c2f-a56c-72c8c86cf76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:16.978316 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac99b5f-e00f-4c2f-a56c-72c8c86cf76c admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:16.997268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 772/1546] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:17.001409 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d89ce-e9d7-405e-b598-a6297559a207 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:17.010560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddc8a3-3c6d-4c86-b5d8-6a028b37b72d None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.010905 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddc8a3-3c6d-4c86-b5d8-6a028b37b72d None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.011136 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddc8a3-3c6d-4c86-b5d8-6a028b37b72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.017290 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d89ce-e9d7-405e-b598-a6297559a207 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:17.030213 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cce7a-3374-4acc-b431-cd715962d5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:17.031113 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cce7a-3374-4acc-b431-cd715962d5e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.031860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cce7a-3374-4acc-b431-cd715962d5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.032300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cce7a-3374-4acc-b431-cd715962d5e6 admin admin] PATH_INFO: `/v3/projects/8fc9f5b486bb4dbca78f5be25775ab2c/users/cd42fe903b954cdd8986800d3b089cfb/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.040509 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-80ddc8a3-3c6d-4c86-b5d8-6a028b37b72d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:17.041787 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-80ddc8a3-3c6d-4c86-b5d8-6a028b37b72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:17.059280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cce7a-3374-4acc-b431-cd715962d5e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fc9f5b486bb4dbca78f5be25775ab2c, user_id=cd42fe903b954cdd8986800d3b089cfb, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:17.059507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 773/1547] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:17.061345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f923b8-4d93-4529-a763-eafd9e9fa462 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.061641 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f923b8-4d93-4529-a763-eafd9e9fa462 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.061923 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f923b8-4d93-4529-a763-eafd9e9fa462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.062302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cce7a-3374-4acc-b431-cd715962d5e6 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:17.088924 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-71f923b8-4d93-4529-a763-eafd9e9fa462 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:17.132246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-71f923b8-4d93-4529-a763-eafd9e9fa462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:17.132246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 774/1548] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:17.132246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59621f7-e0e4-4aec-86a2-90dd1818520c None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.132246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59621f7-e0e4-4aec-86a2-90dd1818520c None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.132246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59621f7-e0e4-4aec-86a2-90dd1818520c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.132703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-a59621f7-e0e4-4aec-86a2-90dd1818520c None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:17.133806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-a59621f7-e0e4-4aec-86a2-90dd1818520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:17.142303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 775/1549] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:17.144773 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e7a71-44b7-4de8-befa-e8c582fd453b None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.144912 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e7a71-44b7-4de8-befa-e8c582fd453b None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.145263 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e7a71-44b7-4de8-befa-e8c582fd453b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.177959 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-ee0e7a71-44b7-4de8-befa-e8c582fd453b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:17.177959 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ee0e7a71-44b7-4de8-befa-e8c582fd453b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:17.182759 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 776/1550] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:57:17.183648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e7a71-44b7-4de8-befa-e8c582fd453b None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:17.194740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e7a71-44b7-4de8-befa-e8c582fd453b None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:17.199819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9a41e-8d7f-443a-9583-d0557c227023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:17.200567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9a41e-8d7f-443a-9583-d0557c227023 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.201031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9a41e-8d7f-443a-9583-d0557c227023 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.201349 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9a41e-8d7f-443a-9583-d0557c227023 admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.202096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9a41e-8d7f-443a-9583-d0557c227023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:57:17.202417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9a41e-8d7f-443a-9583-d0557c227023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:17.204092 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9a41e-8d7f-443a-9583-d0557c227023 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:17.217889 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 777/1551] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:57:17.219744 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f99abf-334f-4665-9e69-8bd03e63c300 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.220218 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f99abf-334f-4665-9e69-8bd03e63c300 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.220344 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f99abf-334f-4665-9e69-8bd03e63c300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.242878 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-f8f99abf-334f-4665-9e69-8bd03e63c300 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:17.244084 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f8f99abf-334f-4665-9e69-8bd03e63c300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:17.251769 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 775/1552] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:17 2022] PUT /identity/v3/projects/8fc9f5b486bb4dbca78f5be25775ab2c/users/cd42fe903b954cdd8986800d3b089cfb/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:17.258433 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cce7a-3374-4acc-b431-cd715962d5e6 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:17.314603 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 778/1553] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:17.316043 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb627433-1d9b-4c16-9b43-ea560785115c None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.316341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb627433-1d9b-4c16-9b43-ea560785115c None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.316625 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb627433-1d9b-4c16-9b43-ea560785115c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.334973 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-bb627433-1d9b-4c16-9b43-ea560785115c None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:17.335600 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cce7a-3374-4acc-b431-cd715962d5e6 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:17.336178 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-bb627433-1d9b-4c16-9b43-ea560785115c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:17.340196 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be58e2-7cfb-417f-a2ed-569be7ae0158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:17.341197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be58e2-7cfb-417f-a2ed-569be7ae0158 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.341476 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be58e2-7cfb-417f-a2ed-569be7ae0158 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.341753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be58e2-7cfb-417f-a2ed-569be7ae0158 admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.342613 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be58e2-7cfb-417f-a2ed-569be7ae0158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:57:17.342920 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be58e2-7cfb-417f-a2ed-569be7ae0158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:17.343954 dv-cinder-847274-2-smb devstack@keystone.service[91966]: WARNING py.warnings [None req-f9be58e2-7cfb-417f-a2ed-569be7ae0158 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 19:57:17.343954 dv-cinder-847274-2-smb devstack@keystone.service[91966]: warnings.warn(msg) Jun 23 19:57:17.343954 dv-cinder-847274-2-smb devstack@keystone.service[91966]: Jun 23 19:57:17.344394 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 779/1554] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:17.344832 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be58e2-7cfb-417f-a2ed-569be7ae0158 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:17.345142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb627433-1d9b-4c16-9b43-ea560785115c None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:17.355708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb627433-1d9b-4c16-9b43-ea560785115c None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:17.365106 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 776/1555] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:57:17.365106 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54970f-5146-4bca-9003-c794f90dc503 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.365106 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54970f-5146-4bca-9003-c794f90dc503 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.365106 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54970f-5146-4bca-9003-c794f90dc503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.365580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ae685-ccbd-4cb0-9da5-d3fcf04597e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:17.365580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ae685-ccbd-4cb0-9da5-d3fcf04597e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.365580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ae685-ccbd-4cb0-9da5-d3fcf04597e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.365580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ae685-ccbd-4cb0-9da5-d3fcf04597e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.365917 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ae685-ccbd-4cb0-9da5-d3fcf04597e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:17.365917 dv-cinder-847274-2-smb devstack@keystone.service[91965]: WARNING py.warnings [None req-416ae685-ccbd-4cb0-9da5-d3fcf04597e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 19:57:17.365917 dv-cinder-847274-2-smb devstack@keystone.service[91965]: warnings.warn(msg) Jun 23 19:57:17.365917 dv-cinder-847274-2-smb devstack@keystone.service[91965]: Jun 23 19:57:17.365917 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ae685-ccbd-4cb0-9da5-d3fcf04597e1 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:17.375096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:17.378368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-ef54970f-5146-4bca-9003-c794f90dc503 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:17.379580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ef54970f-5146-4bca-9003-c794f90dc503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:17.387293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 777/1556] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:17.395465 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ebd35-37fa-401a-b99a-efc86a812704 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.395465 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ebd35-37fa-401a-b99a-efc86a812704 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.395465 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ebd35-37fa-401a-b99a-efc86a812704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.406716 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-561ebd35-37fa-401a-b99a-efc86a812704 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:17.407890 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-561ebd35-37fa-401a-b99a-efc86a812704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:17.416158 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 778/1557] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:17.417527 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2e036-b6a3-49d2-9c3b-24d89df96b61 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.417815 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2e036-b6a3-49d2-9c3b-24d89df96b61 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.418091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2e036-b6a3-49d2-9c3b-24d89df96b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.443581 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-76d2e036-b6a3-49d2-9c3b-24d89df96b61 None None] MFA Rules not processed for user `cd42fe903b954cdd8986800d3b089cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:17.444769 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-76d2e036-b6a3-49d2-9c3b-24d89df96b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:17.477202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 780/1558] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:17 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:17.477202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb65bb3-7f3f-4f6c-adb4-2c1e83ea3561 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.477202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb65bb3-7f3f-4f6c-adb4-2c1e83ea3561 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.477202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb65bb3-7f3f-4f6c-adb4-2c1e83ea3561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.494294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-3fb65bb3-7f3f-4f6c-adb4-2c1e83ea3561 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:17.495509 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-3fb65bb3-7f3f-4f6c-adb4-2c1e83ea3561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:17.512954 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 779/1559] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:17.514264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a189c-f4d5-4afc-995b-4acbe5c8e46c None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.514554 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a189c-f4d5-4afc-995b-4acbe5c8e46c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.514838 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a189c-f4d5-4afc-995b-4acbe5c8e46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.527598 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:17.533349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-bd3a189c-f4d5-4afc-995b-4acbe5c8e46c None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:17.535507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-bd3a189c-f4d5-4afc-995b-4acbe5c8e46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:17.564964 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 781/1560] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:17.569319 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38057514-a885-41c2-86ef-f6ecaeb7fab6 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.569319 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38057514-a885-41c2-86ef-f6ecaeb7fab6 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.569319 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38057514-a885-41c2-86ef-f6ecaeb7fab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.585717 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-38057514-a885-41c2-86ef-f6ecaeb7fab6 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:17.587027 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-38057514-a885-41c2-86ef-f6ecaeb7fab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:17.595272 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 782/1561] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:17.596082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38057514-a885-41c2-86ef-f6ecaeb7fab6 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:17.603956 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 780/1562] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:17.605459 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a15f25-3b48-4614-96df-9a14c53b2c86 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.605758 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a15f25-3b48-4614-96df-9a14c53b2c86 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.606042 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a15f25-3b48-4614-96df-9a14c53b2c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.607109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38057514-a885-41c2-86ef-f6ecaeb7fab6 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:17.612222 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd157c-3bea-4f10-9500-8ab5b58ed1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:17.612880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd157c-3bea-4f10-9500-8ab5b58ed1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.613185 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd157c-3bea-4f10-9500-8ab5b58ed1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.613511 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd157c-3bea-4f10-9500-8ab5b58ed1c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.614264 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd157c-3bea-4f10-9500-8ab5b58ed1c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:17.616184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd157c-3bea-4f10-9500-8ab5b58ed1c2 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:17.624404 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-12a15f25-3b48-4614-96df-9a14c53b2c86 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:17.625628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-12a15f25-3b48-4614-96df-9a14c53b2c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:17.634331 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 781/1563] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:17.635526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d272d9-97b8-44f4-a836-06c18c890471 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.635816 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d272d9-97b8-44f4-a836-06c18c890471 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.636101 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d272d9-97b8-44f4-a836-06c18c890471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.653677 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-69d272d9-97b8-44f4-a836-06c18c890471 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:17.654835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-69d272d9-97b8-44f4-a836-06c18c890471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:17.662648 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 782/1564] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:17.663384 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d272d9-97b8-44f4-a836-06c18c890471 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:17.672574 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d272d9-97b8-44f4-a836-06c18c890471 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:17.677633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1067f-d327-4935-886e-a1d01ef85b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:17.678283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1067f-d327-4935-886e-a1d01ef85b7e admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.678570 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1067f-d327-4935-886e-a1d01ef85b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.678848 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1067f-d327-4935-886e-a1d01ef85b7e admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.679589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1067f-d327-4935-886e-a1d01ef85b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:17.680639 dv-cinder-847274-2-smb devstack@keystone.service[91966]: WARNING py.warnings [None req-66d1067f-d327-4935-886e-a1d01ef85b7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 19:57:17.680639 dv-cinder-847274-2-smb devstack@keystone.service[91966]: warnings.warn(msg) Jun 23 19:57:17.680639 dv-cinder-847274-2-smb devstack@keystone.service[91966]: Jun 23 19:57:17.681912 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1067f-d327-4935-886e-a1d01ef85b7e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:17.747635 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 783/1565] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:17 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:17.748460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd157c-3bea-4f10-9500-8ab5b58ed1c2 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:17.775908 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 783/1566] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:17 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:17.777367 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53d66a-6316-4b5f-955a-b071e867070b None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.787091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53d66a-6316-4b5f-955a-b071e867070b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.787091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53d66a-6316-4b5f-955a-b071e867070b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.794963 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-6a53d66a-6316-4b5f-955a-b071e867070b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:17.796154 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-6a53d66a-6316-4b5f-955a-b071e867070b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:17.811374 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd157c-3bea-4f10-9500-8ab5b58ed1c2 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:17.817037 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b206a7-4310-4491-b3f2-ecd73f930dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:17.817724 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b206a7-4310-4491-b3f2-ecd73f930dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.818013 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b206a7-4310-4491-b3f2-ecd73f930dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.818289 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b206a7-4310-4491-b3f2-ecd73f930dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.818976 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b206a7-4310-4491-b3f2-ecd73f930dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:17.820891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b206a7-4310-4491-b3f2-ecd73f930dc7 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:17.854484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 784/1567] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:17.855316 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53d66a-6316-4b5f-955a-b071e867070b None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:17.864319 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53d66a-6316-4b5f-955a-b071e867070b None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:17.868705 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e286e-21cf-4898-8bf3-4d533f5c25ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:17.869366 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e286e-21cf-4898-8bf3-4d533f5c25ff admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.869649 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e286e-21cf-4898-8bf3-4d533f5c25ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.869923 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e286e-21cf-4898-8bf3-4d533f5c25ff admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.870636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e286e-21cf-4898-8bf3-4d533f5c25ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:57:17.870978 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e286e-21cf-4898-8bf3-4d533f5c25ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:17.872598 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e286e-21cf-4898-8bf3-4d533f5c25ff admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:17.891241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 785/1568] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:57:17.892135 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e286e-21cf-4898-8bf3-4d533f5c25ff admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:17.903057 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e286e-21cf-4898-8bf3-4d533f5c25ff admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:17.907522 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36eb5e9-dadc-44e7-b38e-ce615f2edd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:17.908165 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eb5e9-dadc-44e7-b38e-ce615f2edd9c admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.908447 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eb5e9-dadc-44e7-b38e-ce615f2edd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.908725 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eb5e9-dadc-44e7-b38e-ce615f2edd9c admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.910032 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36eb5e9-dadc-44e7-b38e-ce615f2edd9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:57:17.918684 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36eb5e9-dadc-44e7-b38e-ce615f2edd9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:17.918684 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36eb5e9-dadc-44e7-b38e-ce615f2edd9c admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:17.924344 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 786/1569] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:57:17.925720 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36eb5e9-dadc-44e7-b38e-ce615f2edd9c admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:17.934894 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36eb5e9-dadc-44e7-b38e-ce615f2edd9c admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:17.940017 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba627e9-51a5-40d2-a0b5-fd8b577c1ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:17.941305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba627e9-51a5-40d2-a0b5-fd8b577c1ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:17.941546 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba627e9-51a5-40d2-a0b5-fd8b577c1ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:17.941825 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba627e9-51a5-40d2-a0b5-fd8b577c1ef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:17.942598 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba627e9-51a5-40d2-a0b5-fd8b577c1ef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:57:17.942904 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba627e9-51a5-40d2-a0b5-fd8b577c1ef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:17.944681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba627e9-51a5-40d2-a0b5-fd8b577c1ef1 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:17.945935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 784/1570] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:17 2022] POST /identity/v3/projects => generated 355 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:17.949589 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b206a7-4310-4491-b3f2-ecd73f930dc7 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:17.957201 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 787/1571] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:57:17.957992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba627e9-51a5-40d2-a0b5-fd8b577c1ef1 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:17.975090 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba627e9-51a5-40d2-a0b5-fd8b577c1ef1 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:18.000565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:18.010575 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:18.014189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b206a7-4310-4491-b3f2-ecd73f930dc7 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:18.019234 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ccc5c-d8ec-4d06-91a1-f7e0e0580b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:18.019842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ccc5c-d8ec-4d06-91a1-f7e0e0580b7a admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:18.020131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ccc5c-d8ec-4d06-91a1-f7e0e0580b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:18.020414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ccc5c-d8ec-4d06-91a1-f7e0e0580b7a admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:18.021150 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ccc5c-d8ec-4d06-91a1-f7e0e0580b7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:57:18.021489 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ccc5c-d8ec-4d06-91a1-f7e0e0580b7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:18.023121 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ccc5c-d8ec-4d06-91a1-f7e0e0580b7a admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:18.032737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b3c5b-4cdc-4022-84e5-1fca4c34cf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:18.033473 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b3c5b-4cdc-4022-84e5-1fca4c34cf56 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:18.033762 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b3c5b-4cdc-4022-84e5-1fca4c34cf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:18.034044 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b3c5b-4cdc-4022-84e5-1fca4c34cf56 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:18.034897 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b3c5b-4cdc-4022-84e5-1fca4c34cf56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:18.035384 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 785/1572] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:57:18.036197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ccc5c-d8ec-4d06-91a1-f7e0e0580b7a admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:18.036812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b3c5b-4cdc-4022-84e5-1fca4c34cf56 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:18.045851 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ccc5c-d8ec-4d06-91a1-f7e0e0580b7a admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:18.051265 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d96c3-305e-47d8-afbc-bd4b966fa372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:18.051911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d96c3-305e-47d8-afbc-bd4b966fa372 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:18.052195 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d96c3-305e-47d8-afbc-bd4b966fa372 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:18.052472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d96c3-305e-47d8-afbc-bd4b966fa372 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:18.053221 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d96c3-305e-47d8-afbc-bd4b966fa372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:18.054845 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d96c3-305e-47d8-afbc-bd4b966fa372 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:18.065177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 786/1573] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:18.066692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d96c3-305e-47d8-afbc-bd4b966fa372 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:18.075689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d96c3-305e-47d8-afbc-bd4b966fa372 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:18.080364 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cbb6c-8cb1-4a2b-a26d-d719a949eed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:18.080996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cbb6c-8cb1-4a2b-a26d-d719a949eed1 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:18.081486 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cbb6c-8cb1-4a2b-a26d-d719a949eed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:18.081932 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cbb6c-8cb1-4a2b-a26d-d719a949eed1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:18.082639 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cbb6c-8cb1-4a2b-a26d-d719a949eed1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:57:18.082949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cbb6c-8cb1-4a2b-a26d-d719a949eed1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:18.084499 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cbb6c-8cb1-4a2b-a26d-d719a949eed1 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:18.095728 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 787/1574] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:57:18.096470 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cbb6c-8cb1-4a2b-a26d-d719a949eed1 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:18.105515 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cbb6c-8cb1-4a2b-a26d-d719a949eed1 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:18.110297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867dcc1-680a-4581-83b8-65988def3038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:18.110921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867dcc1-680a-4581-83b8-65988def3038 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:18.111210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867dcc1-680a-4581-83b8-65988def3038 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:18.111497 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867dcc1-680a-4581-83b8-65988def3038 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:18.112713 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867dcc1-680a-4581-83b8-65988def3038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:18.114709 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867dcc1-680a-4581-83b8-65988def3038 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:18.141091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 788/1575] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:17 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:18.142149 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b3c5b-4cdc-4022-84e5-1fca4c34cf56 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:18.151764 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b3c5b-4cdc-4022-84e5-1fca4c34cf56 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:18.156534 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1d984-8ef1-4339-b9ff-184e176f4b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:18.157244 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1d984-8ef1-4339-b9ff-184e176f4b24 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:18.157536 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1d984-8ef1-4339-b9ff-184e176f4b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:18.157819 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1d984-8ef1-4339-b9ff-184e176f4b24 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:18.158500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1d984-8ef1-4339-b9ff-184e176f4b24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:18.160383 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1d984-8ef1-4339-b9ff-184e176f4b24 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:18.210959 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 788/1576] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:18 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:18.212081 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867dcc1-680a-4581-83b8-65988def3038 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:18.246766 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 789/1577] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:18 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:18.246766 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1d984-8ef1-4339-b9ff-184e176f4b24 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:18.276602 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867dcc1-680a-4581-83b8-65988def3038 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:18.309938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1d984-8ef1-4339-b9ff-184e176f4b24 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:18.314660 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613cf80-07a2-4c33-8a95-1f5c5e03b439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:18.315321 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613cf80-07a2-4c33-8a95-1f5c5e03b439 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:18.316328 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613cf80-07a2-4c33-8a95-1f5c5e03b439 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:18.317062 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613cf80-07a2-4c33-8a95-1f5c5e03b439 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:18.317434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613cf80-07a2-4c33-8a95-1f5c5e03b439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:18.319333 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613cf80-07a2-4c33-8a95-1f5c5e03b439 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:18.335196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82cdc7-07ce-4442-a8a8-aacd7b4e6884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:18.335870 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82cdc7-07ce-4442-a8a8-aacd7b4e6884 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:18.336157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82cdc7-07ce-4442-a8a8-aacd7b4e6884 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:18.336435 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82cdc7-07ce-4442-a8a8-aacd7b4e6884 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:18.337124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82cdc7-07ce-4442-a8a8-aacd7b4e6884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:18.339102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82cdc7-07ce-4442-a8a8-aacd7b4e6884 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:18.432080 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 790/1578] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:18 2022] POST /identity/v3/projects => generated 379 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:18.432901 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613cf80-07a2-4c33-8a95-1f5c5e03b439 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:18.479006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 789/1579] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:18 2022] POST /identity/v3/users => generated 284 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:18.479006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82cdc7-07ce-4442-a8a8-aacd7b4e6884 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:18.487029 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82cdc7-07ce-4442-a8a8-aacd7b4e6884 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:18.492784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba698f8-b469-4856-9b43-99a0890c728a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:18.493527 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba698f8-b469-4856-9b43-99a0890c728a admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:18.493816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba698f8-b469-4856-9b43-99a0890c728a admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:18.494094 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba698f8-b469-4856-9b43-99a0890c728a admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:18.494817 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba698f8-b469-4856-9b43-99a0890c728a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:18.495501 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613cf80-07a2-4c33-8a95-1f5c5e03b439 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:18.496402 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba698f8-b469-4856-9b43-99a0890c728a admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:18.500728 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f4831-5caa-4fb0-b9d3-349c4041ef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:18.501503 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f4831-5caa-4fb0-b9d3-349c4041ef6e admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:18.501790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f4831-5caa-4fb0-b9d3-349c4041ef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:18.502063 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f4831-5caa-4fb0-b9d3-349c4041ef6e admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:18.502752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f4831-5caa-4fb0-b9d3-349c4041ef6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:18.504675 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f4831-5caa-4fb0-b9d3-349c4041ef6e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:18.509961 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 790/1580] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:18.509961 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba698f8-b469-4856-9b43-99a0890c728a admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:18.517197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba698f8-b469-4856-9b43-99a0890c728a admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:18.522073 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6583ac-f41b-487d-a285-6ae5511ea3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:18.522656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6583ac-f41b-487d-a285-6ae5511ea3c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:18.522945 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6583ac-f41b-487d-a285-6ae5511ea3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:18.523224 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6583ac-f41b-487d-a285-6ae5511ea3c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:18.523938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6583ac-f41b-487d-a285-6ae5511ea3c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:18.525908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6583ac-f41b-487d-a285-6ae5511ea3c9 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:18.643613 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 791/1581] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:18 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:18.643613 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f4831-5caa-4fb0-b9d3-349c4041ef6e admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:18.658927 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:18.660958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:18.665757 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 791/1582] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:18 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:18.666747 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6583ac-f41b-487d-a285-6ae5511ea3c9 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:18.705210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f4831-5caa-4fb0-b9d3-349c4041ef6e admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:18.729513 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6583ac-f41b-487d-a285-6ae5511ea3c9 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:18.734202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52b192-98c5-43ec-9da8-43638374e406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:18.734866 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52b192-98c5-43ec-9da8-43638374e406 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:18.735154 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52b192-98c5-43ec-9da8-43638374e406 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:18.735432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52b192-98c5-43ec-9da8-43638374e406 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:18.736119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52b192-98c5-43ec-9da8-43638374e406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:18.738875 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52b192-98c5-43ec-9da8-43638374e406 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:18.760510 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd0758-ab30-43bf-b72a-a30d25f23898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:18.761201 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd0758-ab30-43bf-b72a-a30d25f23898 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:18.761492 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd0758-ab30-43bf-b72a-a30d25f23898 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:18.761775 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd0758-ab30-43bf-b72a-a30d25f23898 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:18.762500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd0758-ab30-43bf-b72a-a30d25f23898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:18.764098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd0758-ab30-43bf-b72a-a30d25f23898 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:18.775005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 792/1583] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:18.775796 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd0758-ab30-43bf-b72a-a30d25f23898 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:18.785690 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd0758-ab30-43bf-b72a-a30d25f23898 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:18.790290 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f788ae-dee1-47c5-82c2-e1d2eced8a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:18.790911 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f788ae-dee1-47c5-82c2-e1d2eced8a6e admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:18.791197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f788ae-dee1-47c5-82c2-e1d2eced8a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:18.791475 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f788ae-dee1-47c5-82c2-e1d2eced8a6e admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:18.792137 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f788ae-dee1-47c5-82c2-e1d2eced8a6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:18.794036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f788ae-dee1-47c5-82c2-e1d2eced8a6e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:18.835385 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 792/1584] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:18 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:18.836380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52b192-98c5-43ec-9da8-43638374e406 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:18.846561 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52b192-98c5-43ec-9da8-43638374e406 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:18.852068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcb20d-a142-42a7-b2f3-4f3bf965e989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:18.852715 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcb20d-a142-42a7-b2f3-4f3bf965e989 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:18.853003 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcb20d-a142-42a7-b2f3-4f3bf965e989 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:18.853317 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcb20d-a142-42a7-b2f3-4f3bf965e989 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:18.853998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcb20d-a142-42a7-b2f3-4f3bf965e989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:18.855914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcb20d-a142-42a7-b2f3-4f3bf965e989 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:18.910231 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 793/1585] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:18 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:18.911130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f788ae-dee1-47c5-82c2-e1d2eced8a6e admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:18.920593 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f788ae-dee1-47c5-82c2-e1d2eced8a6e admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:18.925507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7ba37-a3f6-4020-a5b4-d977e4c01c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:18.926145 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7ba37-a3f6-4020-a5b4-d977e4c01c1a admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:18.926433 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7ba37-a3f6-4020-a5b4-d977e4c01c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:18.926715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7ba37-a3f6-4020-a5b4-d977e4c01c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:18.927422 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7ba37-a3f6-4020-a5b4-d977e4c01c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:18.928999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7ba37-a3f6-4020-a5b4-d977e4c01c1a admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:18.939751 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 794/1586] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:18.940498 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7ba37-a3f6-4020-a5b4-d977e4c01c1a admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:18.946257 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 793/1587] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:18 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:18.949853 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcb20d-a142-42a7-b2f3-4f3bf965e989 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:18.951270 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7ba37-a3f6-4020-a5b4-d977e4c01c1a admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:18.956687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1360f-3007-4447-a8a5-088ca312ad28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:18.957607 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1360f-3007-4447-a8a5-088ca312ad28 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:18.957895 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1360f-3007-4447-a8a5-088ca312ad28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:18.958219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1360f-3007-4447-a8a5-088ca312ad28 admin admin] PATH_INFO: `/v3/projects/403b572a9c7d43db940e143f50370c3e/users/d5157ad1d56246a185f5a25cc6771a6e/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:18.960094 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcb20d-a142-42a7-b2f3-4f3bf965e989 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:18.964749 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94141a-5aaa-4d09-bf30-a08f5a60518d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:18.965697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94141a-5aaa-4d09-bf30-a08f5a60518d admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:18.966006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94141a-5aaa-4d09-bf30-a08f5a60518d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:18.966286 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94141a-5aaa-4d09-bf30-a08f5a60518d admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:18.966971 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94141a-5aaa-4d09-bf30-a08f5a60518d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:18.968965 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94141a-5aaa-4d09-bf30-a08f5a60518d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:18.973452 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1360f-3007-4447-a8a5-088ca312ad28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=403b572a9c7d43db940e143f50370c3e, user_id=d5157ad1d56246a185f5a25cc6771a6e, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:18.976137 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1360f-3007-4447-a8a5-088ca312ad28 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:19.084644 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 794/1588] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:18 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:19.084644 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94141a-5aaa-4d09-bf30-a08f5a60518d admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:19.092182 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94141a-5aaa-4d09-bf30-a08f5a60518d admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:19.097533 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d81466-3893-4d24-9d1c-d2351ef3af85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:19.098357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d81466-3893-4d24-9d1c-d2351ef3af85 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.098640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d81466-3893-4d24-9d1c-d2351ef3af85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.098917 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d81466-3893-4d24-9d1c-d2351ef3af85 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.099594 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d81466-3893-4d24-9d1c-d2351ef3af85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:19.101679 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d81466-3893-4d24-9d1c-d2351ef3af85 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:19.115817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 795/1589] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:18 2022] PUT /identity/v3/projects/403b572a9c7d43db940e143f50370c3e/users/d5157ad1d56246a185f5a25cc6771a6e/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:19.116675 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1360f-3007-4447-a8a5-088ca312ad28 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:19.178138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1360f-3007-4447-a8a5-088ca312ad28 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:19.182662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff3bb8-5a56-4b89-868f-93a26c03fd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:19.183321 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff3bb8-5a56-4b89-868f-93a26c03fd21 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.183608 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff3bb8-5a56-4b89-868f-93a26c03fd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.183890 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff3bb8-5a56-4b89-868f-93a26c03fd21 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.184611 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff3bb8-5a56-4b89-868f-93a26c03fd21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:19.186235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff3bb8-5a56-4b89-868f-93a26c03fd21 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:19.196453 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 796/1590] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:19.197254 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff3bb8-5a56-4b89-868f-93a26c03fd21 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:19.202045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:19.207661 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff3bb8-5a56-4b89-868f-93a26c03fd21 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:19.211687 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 795/1591] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:19 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:19.211687 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d81466-3893-4d24-9d1c-d2351ef3af85 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:19.219123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082b506-1e01-4c66-8d41-1570c99a387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:19.219123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082b506-1e01-4c66-8d41-1570c99a387f admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.219123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082b506-1e01-4c66-8d41-1570c99a387f admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.219123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082b506-1e01-4c66-8d41-1570c99a387f admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.219478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082b506-1e01-4c66-8d41-1570c99a387f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:19.219478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082b506-1e01-4c66-8d41-1570c99a387f admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:19.219871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d81466-3893-4d24-9d1c-d2351ef3af85 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:19.224883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be416bd-7733-4f61-ad37-e768631cb53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:19.225558 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be416bd-7733-4f61-ad37-e768631cb53f admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.225851 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be416bd-7733-4f61-ad37-e768631cb53f admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.226130 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be416bd-7733-4f61-ad37-e768631cb53f admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.226859 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be416bd-7733-4f61-ad37-e768631cb53f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:19.228206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 797/1592] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:19.228569 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be416bd-7733-4f61-ad37-e768631cb53f admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:19.228980 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082b506-1e01-4c66-8d41-1570c99a387f admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:19.238833 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082b506-1e01-4c66-8d41-1570c99a387f admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:19.239027 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 796/1593] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:19.239727 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be416bd-7733-4f61-ad37-e768631cb53f admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:19.243943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34c196-c19d-42a1-9482-f48d3fdf795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:19.244812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34c196-c19d-42a1-9482-f48d3fdf795f admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.245103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34c196-c19d-42a1-9482-f48d3fdf795f admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.245417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34c196-c19d-42a1-9482-f48d3fdf795f admin admin] PATH_INFO: `/v3/projects/a4714a14d0874a1d99d9f92e0967ac49/users/d61662572baa4e36b3cf8df34300e2c6/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.249650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be416bd-7733-4f61-ad37-e768631cb53f admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:19.254760 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62f371-6ab2-4691-bdcb-59e2cf1b5ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:19.256450 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62f371-6ab2-4691-bdcb-59e2cf1b5ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.256450 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62f371-6ab2-4691-bdcb-59e2cf1b5ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.256450 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62f371-6ab2-4691-bdcb-59e2cf1b5ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.256773 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62f371-6ab2-4691-bdcb-59e2cf1b5ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:19.258403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62f371-6ab2-4691-bdcb-59e2cf1b5ea6 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:19.260605 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34c196-c19d-42a1-9482-f48d3fdf795f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4714a14d0874a1d99d9f92e0967ac49, user_id=d61662572baa4e36b3cf8df34300e2c6, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:19.263266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34c196-c19d-42a1-9482-f48d3fdf795f admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:19.268470 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 797/1594] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:19.269880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62f371-6ab2-4691-bdcb-59e2cf1b5ea6 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:19.279380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62f371-6ab2-4691-bdcb-59e2cf1b5ea6 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:19.284051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c409b-e3c7-4ec9-b7b9-4fb16c7b5442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:19.287566 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c409b-e3c7-4ec9-b7b9-4fb16c7b5442 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.287566 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c409b-e3c7-4ec9-b7b9-4fb16c7b5442 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.287566 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c409b-e3c7-4ec9-b7b9-4fb16c7b5442 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.287566 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c409b-e3c7-4ec9-b7b9-4fb16c7b5442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:19.287946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c409b-e3c7-4ec9-b7b9-4fb16c7b5442 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:19.298391 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 798/1595] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:19.299764 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a9e3d-ee4c-499a-b275-69b84b215c51 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.300451 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a9e3d-ee4c-499a-b275-69b84b215c51 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.300635 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a9e3d-ee4c-499a-b275-69b84b215c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.317142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-460a9e3d-ee4c-499a-b275-69b84b215c51 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:19.318398 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-460a9e3d-ee4c-499a-b275-69b84b215c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:19.326381 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 799/1596] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:19.327248 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a9e3d-ee4c-499a-b275-69b84b215c51 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:19.337461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a9e3d-ee4c-499a-b275-69b84b215c51 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:19.344547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 798/1597] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:19 2022] PUT /identity/v3/projects/a4714a14d0874a1d99d9f92e0967ac49/users/d61662572baa4e36b3cf8df34300e2c6/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:19.349304 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34c196-c19d-42a1-9482-f48d3fdf795f admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:19.390332 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:19.397664 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c430a4-8c57-42be-896e-6bec5fd99b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:19.400068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c430a4-8c57-42be-896e-6bec5fd99b06 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.400068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c430a4-8c57-42be-896e-6bec5fd99b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.400068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c430a4-8c57-42be-896e-6bec5fd99b06 admin admin] PATH_INFO: `/v3/projects/507476ff29b34a1085822fdd3e68dcaf/users/073ea72b0441442ebfbbf045eecee2b6/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.407827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34c196-c19d-42a1-9482-f48d3fdf795f admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:19.413405 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c430a4-8c57-42be-896e-6bec5fd99b06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=507476ff29b34a1085822fdd3e68dcaf, user_id=073ea72b0441442ebfbbf045eecee2b6, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:19.413674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a9e87-a0e8-45ff-8eeb-1185c16d0ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:19.414452 dv-cinder-847274-2-smb devstack@keystone.service[91965]: WARNING py.warnings [None req-42c430a4-8c57-42be-896e-6bec5fd99b06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 19:57:19.414452 dv-cinder-847274-2-smb devstack@keystone.service[91965]: warnings.warn(msg) Jun 23 19:57:19.414452 dv-cinder-847274-2-smb devstack@keystone.service[91965]: Jun 23 19:57:19.414713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a9e87-a0e8-45ff-8eeb-1185c16d0ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.415143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a9e87-a0e8-45ff-8eeb-1185c16d0ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.415564 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a9e87-a0e8-45ff-8eeb-1185c16d0ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.416349 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c430a4-8c57-42be-896e-6bec5fd99b06 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:19.416656 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a9e87-a0e8-45ff-8eeb-1185c16d0ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:19.418428 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a9e87-a0e8-45ff-8eeb-1185c16d0ca7 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:19.429295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 799/1598] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:19.438181 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a9e87-a0e8-45ff-8eeb-1185c16d0ca7 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:19.439543 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a9e87-a0e8-45ff-8eeb-1185c16d0ca7 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:19.444964 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6707072-3767-4d04-9fae-4d6b7a52914c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:19.445630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6707072-3767-4d04-9fae-4d6b7a52914c admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.445918 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6707072-3767-4d04-9fae-4d6b7a52914c admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.446194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6707072-3767-4d04-9fae-4d6b7a52914c admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.446892 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6707072-3767-4d04-9fae-4d6b7a52914c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:19.448443 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6707072-3767-4d04-9fae-4d6b7a52914c admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:19.458823 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 800/1599] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:19.459585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6707072-3767-4d04-9fae-4d6b7a52914c admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:19.469148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6707072-3767-4d04-9fae-4d6b7a52914c admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:19.473874 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeb150-e0a0-48d9-b5ce-181b52acdc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:19.474486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeb150-e0a0-48d9-b5ce-181b52acdc57 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.474771 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeb150-e0a0-48d9-b5ce-181b52acdc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.475050 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeb150-e0a0-48d9-b5ce-181b52acdc57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.475741 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeb150-e0a0-48d9-b5ce-181b52acdc57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:19.477304 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeb150-e0a0-48d9-b5ce-181b52acdc57 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:19.486841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 801/1600] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:19.488224 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeb150-e0a0-48d9-b5ce-181b52acdc57 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:19.497673 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeb150-e0a0-48d9-b5ce-181b52acdc57 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:19.502297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c014ca-a728-4b78-b703-5050d148239a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:19.503526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c014ca-a728-4b78-b703-5050d148239a admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.503824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c014ca-a728-4b78-b703-5050d148239a admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.504104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c014ca-a728-4b78-b703-5050d148239a admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.504806 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c014ca-a728-4b78-b703-5050d148239a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:19.506405 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c014ca-a728-4b78-b703-5050d148239a admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:19.516728 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 802/1601] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:19.517529 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c014ca-a728-4b78-b703-5050d148239a admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:19.526603 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c014ca-a728-4b78-b703-5050d148239a admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:19.531278 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc25b3-7f01-42d4-a265-2a96ff71a682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:19.531876 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc25b3-7f01-42d4-a265-2a96ff71a682 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.532164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc25b3-7f01-42d4-a265-2a96ff71a682 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.532445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc25b3-7f01-42d4-a265-2a96ff71a682 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.533132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc25b3-7f01-42d4-a265-2a96ff71a682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:19.534969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc25b3-7f01-42d4-a265-2a96ff71a682 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:19.544465 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 803/1602] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:19.545258 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc25b3-7f01-42d4-a265-2a96ff71a682 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:19.549207 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 800/1603] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:19 2022] PUT /identity/v3/projects/507476ff29b34a1085822fdd3e68dcaf/users/073ea72b0441442ebfbbf045eecee2b6/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:19.550823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c430a4-8c57-42be-896e-6bec5fd99b06 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:19.599589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc25b3-7f01-42d4-a265-2a96ff71a682 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:19.612173 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c430a4-8c57-42be-896e-6bec5fd99b06 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:19.617793 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5d254-a95a-4a96-83fa-78c885df963d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:19.618454 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5d254-a95a-4a96-83fa-78c885df963d admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.618760 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5d254-a95a-4a96-83fa-78c885df963d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.619039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5d254-a95a-4a96-83fa-78c885df963d admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.619844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5d254-a95a-4a96-83fa-78c885df963d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:19.621412 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5d254-a95a-4a96-83fa-78c885df963d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:19.632268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:19.632463 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 801/1604] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:19.633230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5d254-a95a-4a96-83fa-78c885df963d admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:19.643487 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5d254-a95a-4a96-83fa-78c885df963d admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:19.648707 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9c82f-8d58-491c-a689-d60f1e10d516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:19.648864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b0887-7faa-4997-90fb-20239a21169c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:19.649396 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9c82f-8d58-491c-a689-d60f1e10d516 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.649554 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b0887-7faa-4997-90fb-20239a21169c service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.649715 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9c82f-8d58-491c-a689-d60f1e10d516 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.649971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b0887-7faa-4997-90fb-20239a21169c service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.650069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9c82f-8d58-491c-a689-d60f1e10d516 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.650267 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b0887-7faa-4997-90fb-20239a21169c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.650711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9c82f-8d58-491c-a689-d60f1e10d516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:19.652309 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9c82f-8d58-491c-a689-d60f1e10d516 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:19.659566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b0887-7faa-4997-90fb-20239a21169c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:19.661309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b0887-7faa-4997-90fb-20239a21169c service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:19.662095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 802/1605] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:19.662861 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9c82f-8d58-491c-a689-d60f1e10d516 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:19.672172 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9c82f-8d58-491c-a689-d60f1e10d516 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:19.672447 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 804/1606] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:19.672973 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b0887-7faa-4997-90fb-20239a21169c service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:19.677568 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2ee12-12e0-43e6-94dc-dd1ee16e7af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:19.679313 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2ee12-12e0-43e6-94dc-dd1ee16e7af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.679313 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2ee12-12e0-43e6-94dc-dd1ee16e7af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.679313 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2ee12-12e0-43e6-94dc-dd1ee16e7af6 admin admin] PATH_INFO: `/v3/projects/5108544bb1054363a7762b02e9f8f4df/users/43f1bf973dcf4be6b432d1000ec180c4/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.682914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b0887-7faa-4997-90fb-20239a21169c service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:19.688292 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e084cd-57dd-43f4-8fd3-bfb73c2849e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:19.689211 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e084cd-57dd-43f4-8fd3-bfb73c2849e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.689973 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e084cd-57dd-43f4-8fd3-bfb73c2849e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.689973 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e084cd-57dd-43f4-8fd3-bfb73c2849e8 admin admin] PATH_INFO: `/v3/projects/159aebc6706d41ea9458d479504c609f/users/60c46f9a28ae4c038d4cc0b1da1253a8/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.696310 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2ee12-12e0-43e6-94dc-dd1ee16e7af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5108544bb1054363a7762b02e9f8f4df, user_id=43f1bf973dcf4be6b432d1000ec180c4, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:19.699030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2ee12-12e0-43e6-94dc-dd1ee16e7af6 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:19.706880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e084cd-57dd-43f4-8fd3-bfb73c2849e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=159aebc6706d41ea9458d479504c609f, user_id=60c46f9a28ae4c038d4cc0b1da1253a8, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:19.709742 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e084cd-57dd-43f4-8fd3-bfb73c2849e8 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:19.829180 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 805/1608] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:19 2022] PUT /identity/v3/projects/159aebc6706d41ea9458d479504c609f/users/60c46f9a28ae4c038d4cc0b1da1253a8/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:19.829180 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e084cd-57dd-43f4-8fd3-bfb73c2849e8 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:19.829886 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 803/1608] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:19 2022] PUT /identity/v3/projects/5108544bb1054363a7762b02e9f8f4df/users/43f1bf973dcf4be6b432d1000ec180c4/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:19.830909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2ee12-12e0-43e6-94dc-dd1ee16e7af6 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:19.892573 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e084cd-57dd-43f4-8fd3-bfb73c2849e8 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:19.898564 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2ee12-12e0-43e6-94dc-dd1ee16e7af6 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:19.901073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a149d-af83-46f1-b9f4-1c79d9a5cb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:19.901725 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a149d-af83-46f1-b9f4-1c79d9a5cb2e admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.902075 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a149d-af83-46f1-b9f4-1c79d9a5cb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.902425 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a149d-af83-46f1-b9f4-1c79d9a5cb2e admin admin] PATH_INFO: `/v3/projects/bc4fd44ac401461192456626cab5125f/users/fa213d65d4674a43aceb7b6babad4184/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.903229 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837b89d-ad4f-445d-9111-86cd6982beaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:19.904115 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837b89d-ad4f-445d-9111-86cd6982beaa admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:19.904398 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837b89d-ad4f-445d-9111-86cd6982beaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:19.904676 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837b89d-ad4f-445d-9111-86cd6982beaa admin admin] PATH_INFO: `/v3/projects/436fd73ddf1b4ff6b4485c5c06527ef6/users/5c21a483d324416a95fbc0750005dc2c/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:19.918440 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a149d-af83-46f1-b9f4-1c79d9a5cb2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4fd44ac401461192456626cab5125f, user_id=fa213d65d4674a43aceb7b6babad4184, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:19.919497 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837b89d-ad4f-445d-9111-86cd6982beaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=436fd73ddf1b4ff6b4485c5c06527ef6, user_id=5c21a483d324416a95fbc0750005dc2c, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:19.921376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a149d-af83-46f1-b9f4-1c79d9a5cb2e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:19.922173 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837b89d-ad4f-445d-9111-86cd6982beaa admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:20.046908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 804/1609] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:19 2022] PUT /identity/v3/projects/436fd73ddf1b4ff6b4485c5c06527ef6/users/5c21a483d324416a95fbc0750005dc2c/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:20.048124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea84882-ca97-4f08-868f-c47de11e9838 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:20.048418 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea84882-ca97-4f08-868f-c47de11e9838 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:20.048813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea84882-ca97-4f08-868f-c47de11e9838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:20.067571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-3ea84882-ca97-4f08-868f-c47de11e9838 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:20.068822 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-3ea84882-ca97-4f08-868f-c47de11e9838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:20.088586 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:20.121760 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 806/1610] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:19 2022] PUT /identity/v3/projects/bc4fd44ac401461192456626cab5125f/users/fa213d65d4674a43aceb7b6babad4184/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:20.129528 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 805/1611] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:20.130250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea84882-ca97-4f08-868f-c47de11e9838 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:20.132253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a149d-af83-46f1-b9f4-1c79d9a5cb2e admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:20.141596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea84882-ca97-4f08-868f-c47de11e9838 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:20.197182 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a149d-af83-46f1-b9f4-1c79d9a5cb2e admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:20.202978 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46be11-48f7-44f1-97d6-1567541cdbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:20.203341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4174acb-60c9-4964-8c71-4e3eaec7383d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:20.203920 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46be11-48f7-44f1-97d6-1567541cdbcc admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:20.204208 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46be11-48f7-44f1-97d6-1567541cdbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:20.204336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4174acb-60c9-4964-8c71-4e3eaec7383d admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:20.204489 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46be11-48f7-44f1-97d6-1567541cdbcc admin admin] PATH_INFO: `/v3/projects/a4714a14d0874a1d99d9f92e0967ac49/users/d61662572baa4e36b3cf8df34300e2c6/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:20.204603 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4174acb-60c9-4964-8c71-4e3eaec7383d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:20.204799 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4174acb-60c9-4964-8c71-4e3eaec7383d admin admin] PATH_INFO: `/v3/projects/cfe0b05993dd4b26b3fefba611516ca1/users/15266dd9c4c343f8bdd8101905189922/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:20.206676 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46be11-48f7-44f1-97d6-1567541cdbcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4714a14d0874a1d99d9f92e0967ac49, user_id=d61662572baa4e36b3cf8df34300e2c6, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:20.209414 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46be11-48f7-44f1-97d6-1567541cdbcc admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:20.220729 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 807/1612] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:20 2022] PUT /identity/v3/projects/a4714a14d0874a1d99d9f92e0967ac49/users/d61662572baa4e36b3cf8df34300e2c6/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:20.222236 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fab1df-5f76-47f5-b998-abca1c1e31d8 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:20.223154 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fab1df-5f76-47f5-b998-abca1c1e31d8 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:20.223358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fab1df-5f76-47f5-b998-abca1c1e31d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:20.232258 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4174acb-60c9-4964-8c71-4e3eaec7383d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe0b05993dd4b26b3fefba611516ca1, user_id=15266dd9c4c343f8bdd8101905189922, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:20.235042 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4174acb-60c9-4964-8c71-4e3eaec7383d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:20.254007 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-49fab1df-5f76-47f5-b998-abca1c1e31d8 None None] MFA Rules not processed for user `43f1bf973dcf4be6b432d1000ec180c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:20.255574 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-49fab1df-5f76-47f5-b998-abca1c1e31d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:20.281630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:20.324121 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 808/1613] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:20.325534 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a0ccb-5c2d-40f4-8d37-d875c1bcf8f1 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:20.325822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a0ccb-5c2d-40f4-8d37-d875c1bcf8f1 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:20.326103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a0ccb-5c2d-40f4-8d37-d875c1bcf8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:20.356456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 806/1614] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:20 2022] PUT /identity/v3/projects/cfe0b05993dd4b26b3fefba611516ca1/users/15266dd9c4c343f8bdd8101905189922/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:20.356456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256504cf-ee69-47c7-829e-64cd9159c6c1 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:20.356456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256504cf-ee69-47c7-829e-64cd9159c6c1 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:20.356456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256504cf-ee69-47c7-829e-64cd9159c6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:20.367371 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-447a0ccb-5c2d-40f4-8d37-d875c1bcf8f1 None None] MFA Rules not processed for user `60c46f9a28ae4c038d4cc0b1da1253a8`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:20.368211 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-256504cf-ee69-47c7-829e-64cd9159c6c1 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:20.369278 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-447a0ccb-5c2d-40f4-8d37-d875c1bcf8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:20.369419 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-256504cf-ee69-47c7-829e-64cd9159c6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:20.442231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 807/1615] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:20.443928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0160b88-0293-4eff-b813-ba862813a545 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:20.444397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0160b88-0293-4eff-b813-ba862813a545 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:20.444765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0160b88-0293-4eff-b813-ba862813a545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:20.454123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 809/1616] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:20.455218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a0ccb-5c2d-40f4-8d37-d875c1bcf8f1 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:20.495583 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-a0160b88-0293-4eff-b813-ba862813a545 None None] MFA Rules not processed for user `fa213d65d4674a43aceb7b6babad4184`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:20.497134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-a0160b88-0293-4eff-b813-ba862813a545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:20.529057 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a0ccb-5c2d-40f4-8d37-d875c1bcf8f1 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:20.533730 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e10d2-6c9d-4d68-a8b8-dc5fa4de4af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:20.536495 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e10d2-6c9d-4d68-a8b8-dc5fa4de4af7 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:20.536495 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e10d2-6c9d-4d68-a8b8-dc5fa4de4af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:20.536495 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e10d2-6c9d-4d68-a8b8-dc5fa4de4af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:20.540655 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:20.547028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e10d2-6c9d-4d68-a8b8-dc5fa4de4af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:20.548575 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e10d2-6c9d-4d68-a8b8-dc5fa4de4af7 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:20.559419 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 810/1617] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:20.560665 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2698-f799-43f4-8a16-2b8c8fbee767 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:20.561021 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2698-f799-43f4-8a16-2b8c8fbee767 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:20.566952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2698-f799-43f4-8a16-2b8c8fbee767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:20.576260 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 808/1618] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:20.577804 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548508e2-0da2-4d73-82ef-0fc65f969a04 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:20.578119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548508e2-0da2-4d73-82ef-0fc65f969a04 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:20.578569 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548508e2-0da2-4d73-82ef-0fc65f969a04 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:20.584452 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 809/1619] 10.222.0.13 () {54 vars in 961 bytes} [Thu Jun 23 19:57:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:57:20.586873 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070655-59e4-4a83-bae1-534bbc2a85d5 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:20.587162 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070655-59e4-4a83-bae1-534bbc2a85d5 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:20.587439 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070655-59e4-4a83-bae1-534bbc2a85d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:20.592784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-703d2698-f799-43f4-8a16-2b8c8fbee767 None None] MFA Rules not processed for user `d61662572baa4e36b3cf8df34300e2c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:20.595334 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-703d2698-f799-43f4-8a16-2b8c8fbee767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:20.618618 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-94070655-59e4-4a83-bae1-534bbc2a85d5 None None] MFA Rules not processed for user `15266dd9c4c343f8bdd8101905189922`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:20.624187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-94070655-59e4-4a83-bae1-534bbc2a85d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:20.679166 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 811/1620] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:20.679166 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2698-f799-43f4-8a16-2b8c8fbee767 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:20.679166 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-703d2698-f799-43f4-8a16-2b8c8fbee767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:20.689719 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2698-f799-43f4-8a16-2b8c8fbee767 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:20.693452 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f1a1e-7981-42ce-8e9b-4f0880811aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:20.694119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f1a1e-7981-42ce-8e9b-4f0880811aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:20.694401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f1a1e-7981-42ce-8e9b-4f0880811aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:20.694734 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f1a1e-7981-42ce-8e9b-4f0880811aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:20.704377 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f1a1e-7981-42ce-8e9b-4f0880811aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:20.705847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f1a1e-7981-42ce-8e9b-4f0880811aa9 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:20.709892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 810/1621] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:20.711718 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fbd50-3a5e-4cfd-9beb-472d4f7e11b6 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:20.712112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fbd50-3a5e-4cfd-9beb-472d4f7e11b6 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:20.712475 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fbd50-3a5e-4cfd-9beb-472d4f7e11b6 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:20.714126 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 811/1622] 10.222.0.13 () {54 vars in 961 bytes} [Thu Jun 23 19:57:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:57:20.714895 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fbd50-3a5e-4cfd-9beb-472d4f7e11b6 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:20.718747 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 812/1623] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:20.720642 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabaa9b-e175-4d28-b4c8-03ad60546354 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:20.721144 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabaa9b-e175-4d28-b4c8-03ad60546354 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:20.721584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabaa9b-e175-4d28-b4c8-03ad60546354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:20.744615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-ebabaa9b-e175-4d28-b4c8-03ad60546354 None None] MFA Rules not processed for user `83bff5cd7782423eaa0bc5b29b208ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:20.746423 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ebabaa9b-e175-4d28-b4c8-03ad60546354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:20.750915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fbd50-3a5e-4cfd-9beb-472d4f7e11b6 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:20.758919 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7e301-0b58-4a90-b250-f067fc7a1d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:20.761493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7e301-0b58-4a90-b250-f067fc7a1d80 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:20.761493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7e301-0b58-4a90-b250-f067fc7a1d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:20.761493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7e301-0b58-4a90-b250-f067fc7a1d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:20.762525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7e301-0b58-4a90-b250-f067fc7a1d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:20.764728 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7e301-0b58-4a90-b250-f067fc7a1d80 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:20.818734 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 813/1624] 10.222.0.13 () {58 vars in 1058 bytes} [Thu Jun 23 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:20.820039 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabaa9b-e175-4d28-b4c8-03ad60546354 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:20.864582 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:20.873520 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 812/1625] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:20 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:20.873520 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7e301-0b58-4a90-b250-f067fc7a1d80 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:20.882878 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabaa9b-e175-4d28-b4c8-03ad60546354 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:20.940511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8c6fa-9f1e-44c7-93cc-5211dca97b3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:20.941225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8c6fa-9f1e-44c7-93cc-5211dca97b3a service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:20.941512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8c6fa-9f1e-44c7-93cc-5211dca97b3a service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:20.941791 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8c6fa-9f1e-44c7-93cc-5211dca97b3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:20.962160 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7e301-0b58-4a90-b250-f067fc7a1d80 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:20.968789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042220e7-fef7-4484-b7ef-9cdffb9cbbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:20.969607 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042220e7-fef7-4484-b7ef-9cdffb9cbbce admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:20.969967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042220e7-fef7-4484-b7ef-9cdffb9cbbce admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:20.970351 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042220e7-fef7-4484-b7ef-9cdffb9cbbce admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:20.971184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042220e7-fef7-4484-b7ef-9cdffb9cbbce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:20.980017 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042220e7-fef7-4484-b7ef-9cdffb9cbbce admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:21.012156 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8c6fa-9f1e-44c7-93cc-5211dca97b3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:21.014450 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8c6fa-9f1e-44c7-93cc-5211dca97b3a service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:21.027759 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 814/1626] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:20 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:21.029217 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a29b6a-fb6d-4a62-a5d5-63cdace5e382 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:21.029552 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a29b6a-fb6d-4a62-a5d5-63cdace5e382 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:21.029842 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a29b6a-fb6d-4a62-a5d5-63cdace5e382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:21.051248 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-97a29b6a-fb6d-4a62-a5d5-63cdace5e382 None None] MFA Rules not processed for user `83bff5cd7782423eaa0bc5b29b208ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:21.052739 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-97a29b6a-fb6d-4a62-a5d5-63cdace5e382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:21.134487 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 815/1627] 10.222.0.13 () {58 vars in 1058 bytes} [Thu Jun 23 19:57:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:21.135579 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a29b6a-fb6d-4a62-a5d5-63cdace5e382 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:21.147272 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a29b6a-fb6d-4a62-a5d5-63cdace5e382 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:21.154338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6a56a-cec0-4816-8f49-ee780849d1ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:21.155025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6a56a-cec0-4816-8f49-ee780849d1ff service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:21.155263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6a56a-cec0-4816-8f49-ee780849d1ff service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:21.155548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6a56a-cec0-4816-8f49-ee780849d1ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:21.211261 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 813/1628] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:20 2022] POST /identity/v3/projects => generated 381 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:21.211814 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042220e7-fef7-4484-b7ef-9cdffb9cbbce admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:21.249123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6a56a-cec0-4816-8f49-ee780849d1ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:21.251693 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6a56a-cec0-4816-8f49-ee780849d1ff service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:21.269765 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 816/1629] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:21.272722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6a56a-cec0-4816-8f49-ee780849d1ff service nova] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:21.283919 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6a56a-cec0-4816-8f49-ee780849d1ff service nova] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:21.367922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042220e7-fef7-4484-b7ef-9cdffb9cbbce admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:21.381268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c76d6-5592-4e36-b009-9a870558cbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:21.382503 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c76d6-5592-4e36-b009-9a870558cbc2 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:21.382788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c76d6-5592-4e36-b009-9a870558cbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:21.383068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c76d6-5592-4e36-b009-9a870558cbc2 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:21.385230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c76d6-5592-4e36-b009-9a870558cbc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:21.388661 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c76d6-5592-4e36-b009-9a870558cbc2 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:21.405625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c6f0d-dfa7-4e34-a4b7-599396b20377 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:21.406636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c6f0d-dfa7-4e34-a4b7-599396b20377 service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:21.407127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c6f0d-dfa7-4e34-a4b7-599396b20377 service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:21.407676 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c6f0d-dfa7-4e34-a4b7-599396b20377 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:21.484659 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c6f0d-dfa7-4e34-a4b7-599396b20377 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:21.486454 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c6f0d-dfa7-4e34-a4b7-599396b20377 service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:21.499020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 817/1630] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:21.499020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c6f0d-dfa7-4e34-a4b7-599396b20377 service nova] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:21.510076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 814/1631] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:21 2022] POST /identity/v3/users => generated 296 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:21.511026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c76d6-5592-4e36-b009-9a870558cbc2 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:21.511248 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c6f0d-dfa7-4e34-a4b7-599396b20377 service nova] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:21.523059 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f2793-4c7a-4e7d-bc35-caf368042ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:21.523755 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f2793-4c7a-4e7d-bc35-caf368042ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:21.524043 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f2793-4c7a-4e7d-bc35-caf368042ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:21.524321 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f2793-4c7a-4e7d-bc35-caf368042ae6 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:21.526942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f2793-4c7a-4e7d-bc35-caf368042ae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:21.531480 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f2793-4c7a-4e7d-bc35-caf368042ae6 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:21.622640 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 818/1632] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:21 2022] POST /identity/v3/users => generated 297 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:21.623659 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f2793-4c7a-4e7d-bc35-caf368042ae6 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:21.638185 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c76d6-5592-4e36-b009-9a870558cbc2 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:21.648774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f2793-4c7a-4e7d-bc35-caf368042ae6 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:21.650922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14689f0a-05fe-4b1b-9cb9-de4e0952c239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:21.651608 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14689f0a-05fe-4b1b-9cb9-de4e0952c239 service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:21.651888 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14689f0a-05fe-4b1b-9cb9-de4e0952c239 service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:21.652274 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14689f0a-05fe-4b1b-9cb9-de4e0952c239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:21.657823 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87845213-0445-4b6c-bb53-67d380ac2f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:21.659592 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87845213-0445-4b6c-bb53-67d380ac2f46 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:21.661344 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87845213-0445-4b6c-bb53-67d380ac2f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:21.661645 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87845213-0445-4b6c-bb53-67d380ac2f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:21.662396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87845213-0445-4b6c-bb53-67d380ac2f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:21.666243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87845213-0445-4b6c-bb53-67d380ac2f46 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:21.683834 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 819/1633] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:21.685643 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565e5e0-cca3-4bf3-b3a5-2f158ade9f6b None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:21.686946 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565e5e0-cca3-4bf3-b3a5-2f158ade9f6b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:21.687459 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565e5e0-cca3-4bf3-b3a5-2f158ade9f6b None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:21.691661 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 820/1634] 10.222.0.13 () {54 vars in 912 bytes} [Thu Jun 23 19:57:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:57:21.692749 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565e5e0-cca3-4bf3-b3a5-2f158ade9f6b None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:21.710400 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565e5e0-cca3-4bf3-b3a5-2f158ade9f6b None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:21.717643 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e4fd7-b348-4db8-9442-86b989f85ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:21.718701 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e4fd7-b348-4db8-9442-86b989f85ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:21.719197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e4fd7-b348-4db8-9442-86b989f85ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:21.720005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e4fd7-b348-4db8-9442-86b989f85ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:21.722122 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e4fd7-b348-4db8-9442-86b989f85ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:21.727977 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e4fd7-b348-4db8-9442-86b989f85ed3 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:21.745037 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 821/1635] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:21.746561 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e4fd7-b348-4db8-9442-86b989f85ed3 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:21.760993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e4fd7-b348-4db8-9442-86b989f85ed3 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:21.766908 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e70dc-70b3-438b-9074-627dbb980374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:21.768151 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e70dc-70b3-438b-9074-627dbb980374 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:21.768645 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e70dc-70b3-438b-9074-627dbb980374 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:21.769117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e70dc-70b3-438b-9074-627dbb980374 admin admin] PATH_INFO: `/v3/projects/53dcd65496bd4871bfdb5236efd49635/users/f231aa758a4047dd86a8174649edea71/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:21.782220 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14689f0a-05fe-4b1b-9cb9-de4e0952c239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:21.783815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14689f0a-05fe-4b1b-9cb9-de4e0952c239 service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:21.792878 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e70dc-70b3-438b-9074-627dbb980374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53dcd65496bd4871bfdb5236efd49635, user_id=f231aa758a4047dd86a8174649edea71, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:21.798070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e70dc-70b3-438b-9074-627dbb980374 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:21.820132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 815/1636] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:21 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:21.820132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e77f45-a006-413f-ad00-492d26aca27b None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:21.820132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e77f45-a006-413f-ad00-492d26aca27b None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:21.820132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e77f45-a006-413f-ad00-492d26aca27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:21.853035 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-a1e77f45-a006-413f-ad00-492d26aca27b None None] MFA Rules not processed for user `83bff5cd7782423eaa0bc5b29b208ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:21.854290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-a1e77f45-a006-413f-ad00-492d26aca27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:21.883209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 816/1637] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 19:57:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:21.888640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e77f45-a006-413f-ad00-492d26aca27b None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:21.908281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e77f45-a006-413f-ad00-492d26aca27b None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:21.919441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1a112-3e0c-4a3c-9ea4-98bc23a9a0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:21.920397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1a112-3e0c-4a3c-9ea4-98bc23a9a0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:21.920690 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1a112-3e0c-4a3c-9ea4-98bc23a9a0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:21.920967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1a112-3e0c-4a3c-9ea4-98bc23a9a0bd admin admin] PATH_INFO: `/v3/projects/aa7e9bc4d6e0424c9d420d554f12a01c/users/fc0b902e74f4437daa3d8d51da57c5e4/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:21.922263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:21.953568 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1a112-3e0c-4a3c-9ea4-98bc23a9a0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7e9bc4d6e0424c9d420d554f12a01c, user_id=fc0b902e74f4437daa3d8d51da57c5e4, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:21.956296 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1a112-3e0c-4a3c-9ea4-98bc23a9a0bd admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:21.963367 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 822/1638] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:21 2022] PUT /identity/v3/projects/53dcd65496bd4871bfdb5236efd49635/users/f231aa758a4047dd86a8174649edea71/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:21.963367 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d2007-73ff-43e9-a798-e372f62d8049 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:21.963367 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d2007-73ff-43e9-a798-e372f62d8049 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:21.963367 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d2007-73ff-43e9-a798-e372f62d8049 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:21.963367 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 823/1639] 10.222.0.13 () {54 vars in 912 bytes} [Thu Jun 23 19:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:57:21.963367 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d2007-73ff-43e9-a798-e372f62d8049 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:21.987709 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:22.037778 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d2007-73ff-43e9-a798-e372f62d8049 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:22.041710 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d6e42-2455-411f-aec5-cd91e7bcc7a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:22.042431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d6e42-2455-411f-aec5-cd91e7bcc7a8 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:22.042785 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d6e42-2455-411f-aec5-cd91e7bcc7a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:22.043905 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d6e42-2455-411f-aec5-cd91e7bcc7a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:22.070727 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 817/1640] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:21 2022] PUT /identity/v3/projects/aa7e9bc4d6e0424c9d420d554f12a01c/users/fc0b902e74f4437daa3d8d51da57c5e4/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:22.073716 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1a112-3e0c-4a3c-9ea4-98bc23a9a0bd admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:22.214512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d6e42-2455-411f-aec5-cd91e7bcc7a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:22.216959 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d6e42-2455-411f-aec5-cd91e7bcc7a8 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:22.224107 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1a112-3e0c-4a3c-9ea4-98bc23a9a0bd admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:22.230387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce2bb6-e8e6-4358-8266-1730a13e5378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:22.231143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce2bb6-e8e6-4358-8266-1730a13e5378 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:22.231768 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce2bb6-e8e6-4358-8266-1730a13e5378 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:22.231768 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce2bb6-e8e6-4358-8266-1730a13e5378 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:22.232619 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce2bb6-e8e6-4358-8266-1730a13e5378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:22.234573 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce2bb6-e8e6-4358-8266-1730a13e5378 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:22.243414 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 824/1641] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:22.248058 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afec0a3-88af-438d-944b-88d629a1a4f1 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:22.252322 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afec0a3-88af-438d-944b-88d629a1a4f1 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:22.252727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afec0a3-88af-438d-944b-88d629a1a4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:22.264029 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 818/1642] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:22.265428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce2bb6-e8e6-4358-8266-1730a13e5378 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:22.277939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce2bb6-e8e6-4358-8266-1730a13e5378 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:22.283194 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2c748-fe10-49b8-b3a4-e11a49ca331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:22.284211 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2c748-fe10-49b8-b3a4-e11a49ca331b admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:22.284507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2c748-fe10-49b8-b3a4-e11a49ca331b admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:22.284794 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2c748-fe10-49b8-b3a4-e11a49ca331b admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:22.286250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2c748-fe10-49b8-b3a4-e11a49ca331b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:22.287890 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2c748-fe10-49b8-b3a4-e11a49ca331b admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:22.288562 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-2afec0a3-88af-438d-944b-88d629a1a4f1 None None] MFA Rules not processed for user `83bff5cd7782423eaa0bc5b29b208ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:22.290341 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-2afec0a3-88af-438d-944b-88d629a1a4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:22.299325 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 819/1643] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:22.303986 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2c748-fe10-49b8-b3a4-e11a49ca331b admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:22.314698 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2c748-fe10-49b8-b3a4-e11a49ca331b admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:22.319918 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677353f9-abad-484e-9fe5-8c6f6ca8e4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:22.320827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677353f9-abad-484e-9fe5-8c6f6ca8e4b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:22.321112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677353f9-abad-484e-9fe5-8c6f6ca8e4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:22.321420 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677353f9-abad-484e-9fe5-8c6f6ca8e4b4 admin admin] PATH_INFO: `/v3/projects/53dcd65496bd4871bfdb5236efd49635/users/f231aa758a4047dd86a8174649edea71/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:22.323994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677353f9-abad-484e-9fe5-8c6f6ca8e4b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53dcd65496bd4871bfdb5236efd49635, user_id=f231aa758a4047dd86a8174649edea71, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:22.326320 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677353f9-abad-484e-9fe5-8c6f6ca8e4b4 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:22.345200 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 820/1644] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:22 2022] PUT /identity/v3/projects/53dcd65496bd4871bfdb5236efd49635/users/f231aa758a4047dd86a8174649edea71/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:22.345200 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677353f9-abad-484e-9fe5-8c6f6ca8e4b4 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:22.458388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677353f9-abad-484e-9fe5-8c6f6ca8e4b4 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:22.464235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8d07e-ffe2-40f7-82ac-cfe4ea93c695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:22.465045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 825/1645] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 19:57:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:22.465802 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8d07e-ffe2-40f7-82ac-cfe4ea93c695 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:22.466196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8d07e-ffe2-40f7-82ac-cfe4ea93c695 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:22.466580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8d07e-ffe2-40f7-82ac-cfe4ea93c695 admin admin] PATH_INFO: `/v3/projects/aa7e9bc4d6e0424c9d420d554f12a01c/users/fc0b902e74f4437daa3d8d51da57c5e4/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:22.468892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8d07e-ffe2-40f7-82ac-cfe4ea93c695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7e9bc4d6e0424c9d420d554f12a01c, user_id=fc0b902e74f4437daa3d8d51da57c5e4, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:22.472270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8d07e-ffe2-40f7-82ac-cfe4ea93c695 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:22.474351 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94317f0-94da-425c-86b2-b26504bfe900 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:22.474650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94317f0-94da-425c-86b2-b26504bfe900 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:22.474932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94317f0-94da-425c-86b2-b26504bfe900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:22.489791 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 821/1646] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:22 2022] PUT /identity/v3/projects/aa7e9bc4d6e0424c9d420d554f12a01c/users/fc0b902e74f4437daa3d8d51da57c5e4/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:22.498115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:22.505701 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352c8db-9927-44bb-bae2-cb447a0f7cdd None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:22.506077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352c8db-9927-44bb-bae2-cb447a0f7cdd None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:22.506944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352c8db-9927-44bb-bae2-cb447a0f7cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:22.565341 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-f94317f0-94da-425c-86b2-b26504bfe900 None None] MFA Rules not processed for user `f231aa758a4047dd86a8174649edea71`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:22.566879 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f94317f0-94da-425c-86b2-b26504bfe900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:22.604418 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-0352c8db-9927-44bb-bae2-cb447a0f7cdd None None] MFA Rules not processed for user `fc0b902e74f4437daa3d8d51da57c5e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:22.608461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0352c8db-9927-44bb-bae2-cb447a0f7cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:22.832476 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 826/1647] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:22.832476 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94317f0-94da-425c-86b2-b26504bfe900 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:22.849401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 822/1648] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:22.953409 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94317f0-94da-425c-86b2-b26504bfe900 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:22.961794 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5921c-c315-4373-8898-e62775a0173b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:22.962478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5921c-c315-4373-8898-e62775a0173b service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:22.962773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5921c-c315-4373-8898-e62775a0173b service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:22.963058 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5921c-c315-4373-8898-e62775a0173b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:23.108750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:23.132366 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5921c-c315-4373-8898-e62775a0173b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:23.135034 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5921c-c315-4373-8898-e62775a0173b service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:23.179297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 827/1649] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:23.219065 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:23.823925 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352c8db-9927-44bb-bae2-cb447a0f7cdd None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:23.840220 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352c8db-9927-44bb-bae2-cb447a0f7cdd None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:23.844498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6818817-9541-4f07-94bb-b91dc80e936e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:23.845313 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6818817-9541-4f07-94bb-b91dc80e936e service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:23.845599 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6818817-9541-4f07-94bb-b91dc80e936e service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:23.845875 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6818817-9541-4f07-94bb-b91dc80e936e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:23.969274 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6818817-9541-4f07-94bb-b91dc80e936e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:23.970753 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6818817-9541-4f07-94bb-b91dc80e936e service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:23.992932 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 823/1650] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:24.463958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5921c-c315-4373-8898-e62775a0173b service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:24.475840 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5921c-c315-4373-8898-e62775a0173b service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:24.483708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0054e2-01aa-4909-b087-e694857e39ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:24.484782 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0054e2-01aa-4909-b087-e694857e39ed service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:24.484782 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0054e2-01aa-4909-b087-e694857e39ed service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:24.485272 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0054e2-01aa-4909-b087-e694857e39ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:24.504994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0054e2-01aa-4909-b087-e694857e39ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:24.504994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0054e2-01aa-4909-b087-e694857e39ed service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:24.527477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 828/1651] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:25.074580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:25.256246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:25.880565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6818817-9541-4f07-94bb-b91dc80e936e service cinder] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:25.912705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6818817-9541-4f07-94bb-b91dc80e936e service cinder] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:25.916995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7f8a1-8770-4226-89d9-314c740fbf06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:25.917878 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7f8a1-8770-4226-89d9-314c740fbf06 service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:25.918311 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7f8a1-8770-4226-89d9-314c740fbf06 service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:25.918731 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7f8a1-8770-4226-89d9-314c740fbf06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:26.019809 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7f8a1-8770-4226-89d9-314c740fbf06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:26.022398 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7f8a1-8770-4226-89d9-314c740fbf06 service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:26.037457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 824/1652] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:28.642195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24affc4b-7a48-4583-b2db-8a516d049f01 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:28.642680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24affc4b-7a48-4583-b2db-8a516d049f01 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:28.643011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24affc4b-7a48-4583-b2db-8a516d049f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:28.726401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-24affc4b-7a48-4583-b2db-8a516d049f01 None None] MFA Rules not processed for user `d5157ad1d56246a185f5a25cc6771a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:28.726401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-24affc4b-7a48-4583-b2db-8a516d049f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:28.727714 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7f8a1-8770-4226-89d9-314c740fbf06 service cinder] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:28.911772 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 829/1653] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:28.911772 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24affc4b-7a48-4583-b2db-8a516d049f01 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:28.938436 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7f8a1-8770-4226-89d9-314c740fbf06 service cinder] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:28.942303 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24affc4b-7a48-4583-b2db-8a516d049f01 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:28.956345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084309a-19dd-4749-a246-e2a8a07a31c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:28.956345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084309a-19dd-4749-a246-e2a8a07a31c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:28.956345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084309a-19dd-4749-a246-e2a8a07a31c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:28.956345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084309a-19dd-4749-a246-e2a8a07a31c2 admin admin] PATH_INFO: `/v3/users/43f1bf973dcf4be6b432d1000ec180c4` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:28.957113 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084309a-19dd-4749-a246-e2a8a07a31c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f1bf973dcf4be6b432d1000ec180c4)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:28.958331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: WARNING py.warnings [None req-4084309a-19dd-4749-a246-e2a8a07a31c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 19:57:28.958331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: warnings.warn(msg) Jun 23 19:57:28.958331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: Jun 23 19:57:28.959544 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084309a-19dd-4749-a246-e2a8a07a31c2 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:28.969820 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cd8b4-5df8-432e-a61f-08d7f1c7a889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:28.970485 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cd8b4-5df8-432e-a61f-08d7f1c7a889 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:28.970777 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cd8b4-5df8-432e-a61f-08d7f1c7a889 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:28.973795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cd8b4-5df8-432e-a61f-08d7f1c7a889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:29.009090 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cd8b4-5df8-432e-a61f-08d7f1c7a889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:29.010620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cd8b4-5df8-432e-a61f-08d7f1c7a889 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:29.048034 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 830/1654] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:29.051069 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cd8b4-5df8-432e-a61f-08d7f1c7a889 service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:29.115357 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cd8b4-5df8-432e-a61f-08d7f1c7a889 service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:29.151995 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df23268-b39a-4dbb-a6e7-669f6e5f186f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:29.151995 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df23268-b39a-4dbb-a6e7-669f6e5f186f service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:29.151995 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df23268-b39a-4dbb-a6e7-669f6e5f186f service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:29.151995 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df23268-b39a-4dbb-a6e7-669f6e5f186f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:29.192916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df23268-b39a-4dbb-a6e7-669f6e5f186f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:29.204932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df23268-b39a-4dbb-a6e7-669f6e5f186f service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:29.241445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 831/1655] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:29.350739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-4084309a-19dd-4749-a246-e2a8a07a31c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f1bf973dcf4be6b432d1000ec180c4'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:29.433247 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-4084309a-19dd-4749-a246-e2a8a07a31c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f1bf973dcf4be6b432d1000ec180c4'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:29.606813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-4084309a-19dd-4749-a246-e2a8a07a31c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f1bf973dcf4be6b432d1000ec180c4'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:29.607458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-4084309a-19dd-4749-a246-e2a8a07a31c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f1bf973dcf4be6b432d1000ec180c4'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:29.612032 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:29.623143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-4084309a-19dd-4749-a246-e2a8a07a31c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f1bf973dcf4be6b432d1000ec180c4'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:29.639845 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 825/1656] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:57:28 2022] DELETE /identity/v3/users/43f1bf973dcf4be6b432d1000ec180c4 => generated 0 bytes in 913 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:57:29.644994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600ff5a-2df9-4f2a-b0e7-65697648fa4a None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:29.645500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600ff5a-2df9-4f2a-b0e7-65697648fa4a None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:29.657281 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600ff5a-2df9-4f2a-b0e7-65697648fa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:29.698930 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-2600ff5a-2df9-4f2a-b0e7-65697648fa4a None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:29.711051 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-2600ff5a-2df9-4f2a-b0e7-65697648fa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:29.831006 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:29.935690 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 832/1657] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:29.993417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084309a-19dd-4749-a246-e2a8a07a31c2 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:29.994995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-4084309a-19dd-4749-a246-e2a8a07a31c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:30.125274 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084309a-19dd-4749-a246-e2a8a07a31c2 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:30.140425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b591e-dc2e-469e-b47b-d64683349d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:30.144186 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b591e-dc2e-469e-b47b-d64683349d6f service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:30.144186 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b591e-dc2e-469e-b47b-d64683349d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:30.144186 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b591e-dc2e-469e-b47b-d64683349d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:30.169843 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b591e-dc2e-469e-b47b-d64683349d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:30.171373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b591e-dc2e-469e-b47b-d64683349d6f service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:30.202443 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 826/1658] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:31.580921 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600ff5a-2df9-4f2a-b0e7-65697648fa4a None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:31.583873 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-2600ff5a-2df9-4f2a-b0e7-65697648fa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:31.618426 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600ff5a-2df9-4f2a-b0e7-65697648fa4a None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:31.644872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7f031-b9e4-4b73-939d-f23cf43da8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:31.645043 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7f031-b9e4-4b73-939d-f23cf43da8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:31.645328 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7f031-b9e4-4b73-939d-f23cf43da8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:31.645795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7f031-b9e4-4b73-939d-f23cf43da8e7 admin admin] PATH_INFO: `/v3/projects/5108544bb1054363a7762b02e9f8f4df` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:31.649946 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7f031-b9e4-4b73-939d-f23cf43da8e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5108544bb1054363a7762b02e9f8f4df)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:31.652193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: WARNING py.warnings [None req-eca7f031-b9e4-4b73-939d-f23cf43da8e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 19:57:31.652193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: warnings.warn(msg) Jun 23 19:57:31.652193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: Jun 23 19:57:31.653481 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7f031-b9e4-4b73-939d-f23cf43da8e7 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:31.961696 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-eca7f031-b9e4-4b73-939d-f23cf43da8e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5108544bb1054363a7762b02e9f8f4df', 'request_id': 'req-eca7f031-b9e4-4b73-939d-f23cf43da8e7'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:31.996102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-eca7f031-b9e4-4b73-939d-f23cf43da8e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5108544bb1054363a7762b02e9f8f4df', 'request_id': 'req-eca7f031-b9e4-4b73-939d-f23cf43da8e7'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:32.002609 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-eca7f031-b9e4-4b73-939d-f23cf43da8e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5108544bb1054363a7762b02e9f8f4df', 'request_id': 'req-eca7f031-b9e4-4b73-939d-f23cf43da8e7'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:32.172890 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-eca7f031-b9e4-4b73-939d-f23cf43da8e7 admin admin] The token cache is being invalidate because project 5108544bb1054363a7762b02e9f8f4df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:57:32.174074 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-eca7f031-b9e4-4b73-939d-f23cf43da8e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:32.179558 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-eca7f031-b9e4-4b73-939d-f23cf43da8e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:32.186793 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 833/1659] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:57:31 2022] DELETE /identity/v3/projects/5108544bb1054363a7762b02e9f8f4df => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:32.194460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269b796-cc81-4a95-86d1-22ab43cd1f3e None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:32.195800 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269b796-cc81-4a95-86d1-22ab43cd1f3e None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:32.196152 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269b796-cc81-4a95-86d1-22ab43cd1f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:32.258633 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-5269b796-cc81-4a95-86d1-22ab43cd1f3e None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:32.266085 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-5269b796-cc81-4a95-86d1-22ab43cd1f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:32.451501 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7f031-b9e4-4b73-939d-f23cf43da8e7 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:32.453249 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-eca7f031-b9e4-4b73-939d-f23cf43da8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:32.489829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 827/1660] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:32.491671 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2742f4-a81c-4c2c-8816-f17bb4021d23 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:32.492019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2742f4-a81c-4c2c-8816-f17bb4021d23 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:32.492354 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2742f4-a81c-4c2c-8816-f17bb4021d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:32.538890 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-bb2742f4-a81c-4c2c-8816-f17bb4021d23 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:32.540484 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-bb2742f4-a81c-4c2c-8816-f17bb4021d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:32.568009 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 828/1661] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:32.569468 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2742f4-a81c-4c2c-8816-f17bb4021d23 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:32.580712 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2742f4-a81c-4c2c-8816-f17bb4021d23 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:32.589640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b53300-72b5-4e07-9b81-c736046b4f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:32.590857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b53300-72b5-4e07-9b81-c736046b4f5a admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:32.591327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b53300-72b5-4e07-9b81-c736046b4f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:32.591763 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b53300-72b5-4e07-9b81-c736046b4f5a admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:32.592794 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b53300-72b5-4e07-9b81-c736046b4f5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:57:32.593476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b53300-72b5-4e07-9b81-c736046b4f5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:32.596155 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b53300-72b5-4e07-9b81-c736046b4f5a admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:32.614011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7f031-b9e4-4b73-939d-f23cf43da8e7 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:32.636670 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd62c8-f7c7-43da-bb94-936b3b83e6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:32.639468 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 829/1662] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:57:32.643010 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd62c8-f7c7-43da-bb94-936b3b83e6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:32.643010 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd62c8-f7c7-43da-bb94-936b3b83e6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:32.643010 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd62c8-f7c7-43da-bb94-936b3b83e6a8 admin admin] PATH_INFO: `/v3/users/60c46f9a28ae4c038d4cc0b1da1253a8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:32.646288 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd62c8-f7c7-43da-bb94-936b3b83e6a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60c46f9a28ae4c038d4cc0b1da1253a8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:32.646940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b53300-72b5-4e07-9b81-c736046b4f5a admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:32.648637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd62c8-f7c7-43da-bb94-936b3b83e6a8 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:32.685337 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b53300-72b5-4e07-9b81-c736046b4f5a admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:32.708950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9490f-1da5-4247-a625-e64f82b5b896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:32.709946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9490f-1da5-4247-a625-e64f82b5b896 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:32.710373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9490f-1da5-4247-a625-e64f82b5b896 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:32.712479 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9490f-1da5-4247-a625-e64f82b5b896 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:32.718034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9490f-1da5-4247-a625-e64f82b5b896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:32.725775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9490f-1da5-4247-a625-e64f82b5b896 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:32.906541 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 830/1663] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:32 2022] POST /identity/v3/projects => generated 405 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:32.911433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9490f-1da5-4247-a625-e64f82b5b896 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:33.021767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:33.039458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9490f-1da5-4247-a625-e64f82b5b896 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:33.039939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-22cd62c8-f7c7-43da-bb94-936b3b83e6a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60c46f9a28ae4c038d4cc0b1da1253a8'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:33.048427 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19b92b-8b5d-47c2-a4cd-ed31e9dacff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:33.053996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19b92b-8b5d-47c2-a4cd-ed31e9dacff5 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:33.058402 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19b92b-8b5d-47c2-a4cd-ed31e9dacff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:33.058835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19b92b-8b5d-47c2-a4cd-ed31e9dacff5 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:33.059745 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19b92b-8b5d-47c2-a4cd-ed31e9dacff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:33.064055 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19b92b-8b5d-47c2-a4cd-ed31e9dacff5 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:33.064565 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:33.089395 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-22cd62c8-f7c7-43da-bb94-936b3b83e6a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60c46f9a28ae4c038d4cc0b1da1253a8'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:33.213943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-22cd62c8-f7c7-43da-bb94-936b3b83e6a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60c46f9a28ae4c038d4cc0b1da1253a8'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:33.215053 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-22cd62c8-f7c7-43da-bb94-936b3b83e6a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60c46f9a28ae4c038d4cc0b1da1253a8'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:33.222174 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 831/1664] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:32 2022] POST /identity/v3/users => generated 303 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:33.223600 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e3313-117a-43fb-8742-3e04fdb5971b None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:33.223892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e3313-117a-43fb-8742-3e04fdb5971b None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:33.224179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e3313-117a-43fb-8742-3e04fdb5971b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:33.232009 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-22cd62c8-f7c7-43da-bb94-936b3b83e6a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60c46f9a28ae4c038d4cc0b1da1253a8'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:33.238795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 834/1665] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:57:32 2022] DELETE /identity/v3/users/60c46f9a28ae4c038d4cc0b1da1253a8 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:57:33.240137 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd62c8-f7c7-43da-bb94-936b3b83e6a8 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:33.242283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-22cd62c8-f7c7-43da-bb94-936b3b83e6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:33.332404 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-256e3313-117a-43fb-8742-3e04fdb5971b None None] MFA Rules not processed for user `073ea72b0441442ebfbbf045eecee2b6`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:33.337181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-256e3313-117a-43fb-8742-3e04fdb5971b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:33.469615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd62c8-f7c7-43da-bb94-936b3b83e6a8 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:33.480028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e070b06-c6ab-4310-aec2-843dc77f7eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:33.481077 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e070b06-c6ab-4310-aec2-843dc77f7eba admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:33.481479 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e070b06-c6ab-4310-aec2-843dc77f7eba admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:33.481972 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e070b06-c6ab-4310-aec2-843dc77f7eba admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:33.482921 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e070b06-c6ab-4310-aec2-843dc77f7eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:33.485531 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e070b06-c6ab-4310-aec2-843dc77f7eba admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:33.532765 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 835/1666] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:33.536490 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 832/1667] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:33.536745 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f2418-f146-4c53-8682-49731b83277a None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:33.537473 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f2418-f146-4c53-8682-49731b83277a None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:33.537645 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e3313-117a-43fb-8742-3e04fdb5971b None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:33.538050 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f2418-f146-4c53-8682-49731b83277a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:33.584831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e3313-117a-43fb-8742-3e04fdb5971b None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:33.600431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-594f2418-f146-4c53-8682-49731b83277a None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:33.601735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-594f2418-f146-4c53-8682-49731b83277a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:33.617708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e839a-0b49-42e1-ab01-74d0084d2e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:33.618417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e839a-0b49-42e1-ab01-74d0084d2e52 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:33.618712 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e839a-0b49-42e1-ab01-74d0084d2e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:33.618995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e839a-0b49-42e1-ab01-74d0084d2e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:33.619874 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e839a-0b49-42e1-ab01-74d0084d2e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:33.643915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e839a-0b49-42e1-ab01-74d0084d2e52 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:33.644986 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 836/1668] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:33.644986 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f2418-f146-4c53-8682-49731b83277a None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:33.644986 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-594f2418-f146-4c53-8682-49731b83277a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:33.661477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 833/1669] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:33.665862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e839a-0b49-42e1-ab01-74d0084d2e52 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:33.699537 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e839a-0b49-42e1-ab01-74d0084d2e52 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:33.722082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043b438-b485-4c65-9164-4b513135b889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:33.723573 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043b438-b485-4c65-9164-4b513135b889 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:33.723863 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043b438-b485-4c65-9164-4b513135b889 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:33.724146 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043b438-b485-4c65-9164-4b513135b889 admin admin] PATH_INFO: `/v3/projects/7c6885d3fd534ca5b03732f0dcbce9cb/users/f343b816acdb4f87b7cc67b79ad3aba5/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:33.770803 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f2418-f146-4c53-8682-49731b83277a None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:33.772637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45dc26b-76ed-44ce-9dad-c471ac053cae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:33.772768 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043b438-b485-4c65-9164-4b513135b889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6885d3fd534ca5b03732f0dcbce9cb, user_id=f343b816acdb4f87b7cc67b79ad3aba5, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:33.773356 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dc26b-76ed-44ce-9dad-c471ac053cae service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:33.773647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dc26b-76ed-44ce-9dad-c471ac053cae service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:33.774370 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dc26b-76ed-44ce-9dad-c471ac053cae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:33.775436 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043b438-b485-4c65-9164-4b513135b889 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:33.800620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45dc26b-76ed-44ce-9dad-c471ac053cae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:33.808849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45dc26b-76ed-44ce-9dad-c471ac053cae service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:33.830578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 837/1670] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:33.832263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45dc26b-76ed-44ce-9dad-c471ac053cae service nova] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:33.834618 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e45dc26b-76ed-44ce-9dad-c471ac053cae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:33.984255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 834/1671] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:33 2022] PUT /identity/v3/projects/7c6885d3fd534ca5b03732f0dcbce9cb/users/f343b816acdb4f87b7cc67b79ad3aba5/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:33.984255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214f815-1092-438f-9cbb-2735daf0c6dc None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:33.984255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214f815-1092-438f-9cbb-2735daf0c6dc None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:33.986772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214f815-1092-438f-9cbb-2735daf0c6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:33.998202 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45dc26b-76ed-44ce-9dad-c471ac053cae service nova] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:34.075252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-0214f815-1092-438f-9cbb-2735daf0c6dc None None] MFA Rules not processed for user `5c21a483d324416a95fbc0750005dc2c`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:34.088076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0214f815-1092-438f-9cbb-2735daf0c6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:34.135551 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4dead-d159-4fb1-93cb-851443b21921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:34.136518 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4dead-d159-4fb1-93cb-851443b21921 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:34.136915 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4dead-d159-4fb1-93cb-851443b21921 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:34.137777 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4dead-d159-4fb1-93cb-851443b21921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:34.309983 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4dead-d159-4fb1-93cb-851443b21921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:34.314125 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4dead-d159-4fb1-93cb-851443b21921 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:34.320340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 835/1672] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:34.323455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16986983-c780-486d-b133-3bdd7c32c711 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:34.323998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16986983-c780-486d-b133-3bdd7c32c711 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:34.324521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16986983-c780-486d-b133-3bdd7c32c711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:34.337236 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 838/1673] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:34.338996 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64d1b0-9d9d-45ac-b895-d486380920ee None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:34.339511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64d1b0-9d9d-45ac-b895-d486380920ee None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:34.339940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64d1b0-9d9d-45ac-b895-d486380920ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:34.359539 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-3f64d1b0-9d9d-45ac-b895-d486380920ee None None] MFA Rules not processed for user `5c21a483d324416a95fbc0750005dc2c`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:34.361017 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-3f64d1b0-9d9d-45ac-b895-d486380920ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:34.369084 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 839/1674] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:34.382111 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64d1b0-9d9d-45ac-b895-d486380920ee None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:34.384242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-3f64d1b0-9d9d-45ac-b895-d486380920ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:34.390972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-16986983-c780-486d-b133-3bdd7c32c711 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:34.395916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-16986983-c780-486d-b133-3bdd7c32c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:34.422361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 836/1675] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:34.452369 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16986983-c780-486d-b133-3bdd7c32c711 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:34.454461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-16986983-c780-486d-b133-3bdd7c32c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:34.493887 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16986983-c780-486d-b133-3bdd7c32c711 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:34.513999 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c203f92-8e5f-485e-987a-2624846890eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:34.514876 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c203f92-8e5f-485e-987a-2624846890eb service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:34.515496 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c203f92-8e5f-485e-987a-2624846890eb service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:34.515918 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c203f92-8e5f-485e-987a-2624846890eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:34.539400 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c203f92-8e5f-485e-987a-2624846890eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:34.541411 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c203f92-8e5f-485e-987a-2624846890eb service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:34.568690 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 837/1676] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:57:34.815330 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64d1b0-9d9d-45ac-b895-d486380920ee None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:34.835217 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f5013-df14-48f1-9a83-0507b16db941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:34.835984 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f5013-df14-48f1-9a83-0507b16db941 service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:34.836341 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f5013-df14-48f1-9a83-0507b16db941 service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:34.836755 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f5013-df14-48f1-9a83-0507b16db941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:34.870435 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f5013-df14-48f1-9a83-0507b16db941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:34.870435 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f5013-df14-48f1-9a83-0507b16db941 service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:34.883063 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 840/1677] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:35.605770 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1db7a6-2350-4c3d-9cb2-eda094ccecce None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:35.610582 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1db7a6-2350-4c3d-9cb2-eda094ccecce None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:35.610582 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1db7a6-2350-4c3d-9cb2-eda094ccecce None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:35.610582 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 838/1678] 10.222.0.13 () {54 vars in 912 bytes} [Thu Jun 23 19:57:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:57:35.615926 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f5013-df14-48f1-9a83-0507b16db941 service nova] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:35.617123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8800a-2046-4389-a000-362500fae8c6 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:35.617867 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8800a-2046-4389-a000-362500fae8c6 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:35.618718 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8800a-2046-4389-a000-362500fae8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:35.619748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-771f5013-df14-48f1-9a83-0507b16db941 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:35.636555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:35.674776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f5013-df14-48f1-9a83-0507b16db941 service nova] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:35.693754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32767c-1e02-4e68-b694-6326e8babcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:35.694718 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32767c-1e02-4e68-b694-6326e8babcae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:35.695030 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32767c-1e02-4e68-b694-6326e8babcae admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:35.699252 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32767c-1e02-4e68-b694-6326e8babcae admin admin] PATH_INFO: `/v3/projects/159aebc6706d41ea9458d479504c609f` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:35.700171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32767c-1e02-4e68-b694-6326e8babcae admin admin] RBAC: Authorizing `identity:delete_project(project_id=159aebc6706d41ea9458d479504c609f)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:35.707927 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32767c-1e02-4e68-b694-6326e8babcae admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:35.710509 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-f2e8800a-2046-4389-a000-362500fae8c6 None None] MFA Rules not processed for user `24bb6f31e87045f5b17f561b42edca6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:35.711765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f2e8800a-2046-4389-a000-362500fae8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:35.729714 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 839/1679] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 19:57:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:57:35.742387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8800a-2046-4389-a000-362500fae8c6 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:35.755175 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8800a-2046-4389-a000-362500fae8c6 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:35.767897 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2caf8-87e5-4f0f-a68d-77bf03a39a4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:35.768869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2caf8-87e5-4f0f-a68d-77bf03a39a4a service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:35.769250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2caf8-87e5-4f0f-a68d-77bf03a39a4a service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:35.769794 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2caf8-87e5-4f0f-a68d-77bf03a39a4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:35.791001 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2caf8-87e5-4f0f-a68d-77bf03a39a4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:35.791001 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2caf8-87e5-4f0f-a68d-77bf03a39a4a service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:35.807530 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 840/1680] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:57:35.948315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1b32767c-1e02-4e68-b694-6326e8babcae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '159aebc6706d41ea9458d479504c609f', 'request_id': 'req-1b32767c-1e02-4e68-b694-6326e8babcae'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:35.962654 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1b32767c-1e02-4e68-b694-6326e8babcae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '159aebc6706d41ea9458d479504c609f', 'request_id': 'req-1b32767c-1e02-4e68-b694-6326e8babcae'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:35.980162 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1b32767c-1e02-4e68-b694-6326e8babcae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '159aebc6706d41ea9458d479504c609f', 'request_id': 'req-1b32767c-1e02-4e68-b694-6326e8babcae'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:36.109259 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1b32767c-1e02-4e68-b694-6326e8babcae admin admin] The token cache is being invalidate because project 159aebc6706d41ea9458d479504c609f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:57:36.110836 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1b32767c-1e02-4e68-b694-6326e8babcae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:36.111139 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1b32767c-1e02-4e68-b694-6326e8babcae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:36.118491 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 841/1681] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:57:35 2022] DELETE /identity/v3/projects/159aebc6706d41ea9458d479504c609f => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:36.122489 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42945a67-cf02-49c9-acf8-9bc2db4960e2 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:36.122489 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42945a67-cf02-49c9-acf8-9bc2db4960e2 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:36.122489 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42945a67-cf02-49c9-acf8-9bc2db4960e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:36.174455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d6bc6-584a-4686-938c-095d3564e5f7 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:36.176221 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d6bc6-584a-4686-938c-095d3564e5f7 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:36.176513 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d6bc6-584a-4686-938c-095d3564e5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:36.190747 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-42945a67-cf02-49c9-acf8-9bc2db4960e2 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:36.192878 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-42945a67-cf02-49c9-acf8-9bc2db4960e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:36.237275 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-2d7d6bc6-584a-4686-938c-095d3564e5f7 None None] MFA Rules not processed for user `d5157ad1d56246a185f5a25cc6771a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:36.239788 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-2d7d6bc6-584a-4686-938c-095d3564e5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:36.420086 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 841/1682] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:57:36.423167 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d2a45-dd82-4ef6-80b5-3ce5184f9791 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:36.426966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d2a45-dd82-4ef6-80b5-3ce5184f9791 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:36.427275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d2a45-dd82-4ef6-80b5-3ce5184f9791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:36.451717 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 842/1683] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:36.504760 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:36.507689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-e44d2a45-dd82-4ef6-80b5-3ce5184f9791 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:36.511538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e44d2a45-dd82-4ef6-80b5-3ce5184f9791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:36.547329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d6bc6-584a-4686-938c-095d3564e5f7 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:36.561756 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 842/1684] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:36.567726 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d6bc6-584a-4686-938c-095d3564e5f7 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:36.600124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dbdd8-9ba6-416b-9515-532d162e9b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:36.602002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dbdd8-9ba6-416b-9515-532d162e9b20 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:36.603995 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dbdd8-9ba6-416b-9515-532d162e9b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:36.604388 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dbdd8-9ba6-416b-9515-532d162e9b20 admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:36.615913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dbdd8-9ba6-416b-9515-532d162e9b20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:57:36.615913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dbdd8-9ba6-416b-9515-532d162e9b20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:36.615913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dbdd8-9ba6-416b-9515-532d162e9b20 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:36.688646 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d2a45-dd82-4ef6-80b5-3ce5184f9791 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:36.693861 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e44d2a45-dd82-4ef6-80b5-3ce5184f9791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:36.699420 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 843/1685] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:57:36.704460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dbdd8-9ba6-416b-9515-532d162e9b20 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:36.712065 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d2a45-dd82-4ef6-80b5-3ce5184f9791 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:36.731994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490daf2-3043-4d19-9a6f-9dc6ef9e2282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:36.733233 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490daf2-3043-4d19-9a6f-9dc6ef9e2282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:36.733918 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490daf2-3043-4d19-9a6f-9dc6ef9e2282 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:36.745496 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490daf2-3043-4d19-9a6f-9dc6ef9e2282 admin admin] PATH_INFO: `/v3/users/fa213d65d4674a43aceb7b6babad4184` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:36.747857 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dbdd8-9ba6-416b-9515-532d162e9b20 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:36.750744 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490daf2-3043-4d19-9a6f-9dc6ef9e2282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa213d65d4674a43aceb7b6babad4184)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:36.755529 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490daf2-3043-4d19-9a6f-9dc6ef9e2282 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:36.766555 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773d1af-4ee1-475c-b712-0004b751e502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:36.767246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773d1af-4ee1-475c-b712-0004b751e502 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:36.767531 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773d1af-4ee1-475c-b712-0004b751e502 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:36.767809 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773d1af-4ee1-475c-b712-0004b751e502 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:36.768504 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773d1af-4ee1-475c-b712-0004b751e502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:36.770475 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773d1af-4ee1-475c-b712-0004b751e502 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:36.936906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 844/1686] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:36 2022] POST /identity/v3/projects => generated 373 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:36.944313 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773d1af-4ee1-475c-b712-0004b751e502 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:37.104819 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773d1af-4ee1-475c-b712-0004b751e502 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:37.111974 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3e815-0617-4a5d-9036-e796cca3c8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:37.114136 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3e815-0617-4a5d-9036-e796cca3c8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:37.114660 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3e815-0617-4a5d-9036-e796cca3c8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:37.115714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3e815-0617-4a5d-9036-e796cca3c8c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:37.117467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3e815-0617-4a5d-9036-e796cca3c8c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:37.120268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3e815-0617-4a5d-9036-e796cca3c8c1 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:37.121109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-a490daf2-3043-4d19-9a6f-9dc6ef9e2282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa213d65d4674a43aceb7b6babad4184'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:37.146282 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-a490daf2-3043-4d19-9a6f-9dc6ef9e2282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa213d65d4674a43aceb7b6babad4184'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:37.274928 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 845/1687] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:36 2022] POST /identity/v3/users => generated 287 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:57:37.276471 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359c081-06ad-48b3-b32c-ed864bcc4a96 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:37.279060 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359c081-06ad-48b3-b32c-ed864bcc4a96 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:37.279230 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359c081-06ad-48b3-b32c-ed864bcc4a96 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:37.282079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 846/1688] 10.222.0.13 () {54 vars in 960 bytes} [Thu Jun 23 19:57:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:57:37.286581 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359c081-06ad-48b3-b32c-ed864bcc4a96 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:37.292255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-a490daf2-3043-4d19-9a6f-9dc6ef9e2282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa213d65d4674a43aceb7b6babad4184'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:37.293854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-a490daf2-3043-4d19-9a6f-9dc6ef9e2282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa213d65d4674a43aceb7b6babad4184'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:37.310242 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-a490daf2-3043-4d19-9a6f-9dc6ef9e2282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa213d65d4674a43aceb7b6babad4184'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:37.336493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 843/1689] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:57:36 2022] DELETE /identity/v3/users/fa213d65d4674a43aceb7b6babad4184 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:57:37.338842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca481233-8223-4e46-9e2a-e52e46dc5c56 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:37.342037 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359c081-06ad-48b3-b32c-ed864bcc4a96 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:37.342489 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca481233-8223-4e46-9e2a-e52e46dc5c56 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:37.342834 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca481233-8223-4e46-9e2a-e52e46dc5c56 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:37.344314 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 844/1690] 10.222.0.13 () {54 vars in 912 bytes} [Thu Jun 23 19:57:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:57:37.352088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b455989-8d7d-4281-9786-c6da11c8bbde None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:37.352399 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b455989-8d7d-4281-9786-c6da11c8bbde None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:37.357216 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b455989-8d7d-4281-9786-c6da11c8bbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:37.438510 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-9b455989-8d7d-4281-9786-c6da11c8bbde None None] MFA Rules not processed for user `7e9ba6d33e8640ec8dcda9971f59c5dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:37.442023 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-9b455989-8d7d-4281-9786-c6da11c8bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:37.483306 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d85bd6-4f59-4b32-bf98-64bfe2640fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:37.484005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d85bd6-4f59-4b32-bf98-64bfe2640fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:37.484291 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d85bd6-4f59-4b32-bf98-64bfe2640fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:37.484571 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d85bd6-4f59-4b32-bf98-64bfe2640fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:37.487626 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d85bd6-4f59-4b32-bf98-64bfe2640fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:37.493238 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d85bd6-4f59-4b32-bf98-64bfe2640fe2 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:37.530336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 847/1691] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:37.533501 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0069109-510d-4452-bd53-43e2adaa6f55 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:37.534094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0069109-510d-4452-bd53-43e2adaa6f55 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:37.535493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0069109-510d-4452-bd53-43e2adaa6f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:37.578876 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-c0069109-510d-4452-bd53-43e2adaa6f55 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:37.580398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-c0069109-510d-4452-bd53-43e2adaa6f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:37.580934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 845/1692] 10.222.0.13 () {58 vars in 1057 bytes} [Thu Jun 23 19:57:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:37.583141 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b985b-4b2d-4072-ade3-737cdc477498 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:37.583603 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b985b-4b2d-4072-ade3-737cdc477498 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:37.585394 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b985b-4b2d-4072-ade3-737cdc477498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:37.600744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 848/1693] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:37.600744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0069109-510d-4452-bd53-43e2adaa6f55 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:37.600744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-c0069109-510d-4452-bd53-43e2adaa6f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:37.612476 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0069109-510d-4452-bd53-43e2adaa6f55 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:37.620261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e830c-8a15-4c2b-9fa5-7905bb53c79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:37.621022 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e830c-8a15-4c2b-9fa5-7905bb53c79a admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:37.622310 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e830c-8a15-4c2b-9fa5-7905bb53c79a admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:37.622685 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e830c-8a15-4c2b-9fa5-7905bb53c79a admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:37.623668 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e830c-8a15-4c2b-9fa5-7905bb53c79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:37.626187 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e830c-8a15-4c2b-9fa5-7905bb53c79a admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:37.645709 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 849/1694] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:37.646776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e830c-8a15-4c2b-9fa5-7905bb53c79a admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:37.669506 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-fa4b985b-4b2d-4072-ade3-737cdc477498 None None] MFA Rules not processed for user `24bb6f31e87045f5b17f561b42edca6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:37.670978 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-fa4b985b-4b2d-4072-ade3-737cdc477498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:37.680361 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e830c-8a15-4c2b-9fa5-7905bb53c79a admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:37.692624 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb17c47-a6e2-4502-a2f7-86c7587ee50b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9ba6d33e8640ec8dcda9971f59c5dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:37.693382 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb17c47-a6e2-4502-a2f7-86c7587ee50b service placement] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:37.697358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb17c47-a6e2-4502-a2f7-86c7587ee50b service placement] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:37.697699 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb17c47-a6e2-4502-a2f7-86c7587ee50b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:37.700693 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-abb17c47-a6e2-4502-a2f7-86c7587ee50b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:37.735151 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb17c47-a6e2-4502-a2f7-86c7587ee50b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:37.736808 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb17c47-a6e2-4502-a2f7-86c7587ee50b service placement] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:37.750024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 850/1695] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:37.757483 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb17c47-a6e2-4502-a2f7-86c7587ee50b service placement] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:37.757483 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-abb17c47-a6e2-4502-a2f7-86c7587ee50b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:37.809319 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 846/1696] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 19:57:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:37.810406 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b985b-4b2d-4072-ade3-737cdc477498 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:37.827008 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b985b-4b2d-4072-ade3-737cdc477498 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:37.827951 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb17c47-a6e2-4502-a2f7-86c7587ee50b service placement] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:37.832296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31ea01-8215-4b1d-800e-d2ed0042aafb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:37.833266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31ea01-8215-4b1d-800e-d2ed0042aafb service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:37.833603 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31ea01-8215-4b1d-800e-d2ed0042aafb service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:37.833886 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31ea01-8215-4b1d-800e-d2ed0042aafb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:37.834226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2741cdf-2b84-46b3-a519-b0f33c1e2614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:37.835136 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2741cdf-2b84-46b3-a519-b0f33c1e2614 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:37.835427 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2741cdf-2b84-46b3-a519-b0f33c1e2614 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:37.835713 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2741cdf-2b84-46b3-a519-b0f33c1e2614 admin admin] PATH_INFO: `/v3/projects/367f2c521e234e38bb4054ef4777b690/users/2fd254ea419b43c1ac28fd1a941fd569/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:37.856675 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2741cdf-2b84-46b3-a519-b0f33c1e2614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=367f2c521e234e38bb4054ef4777b690, user_id=2fd254ea419b43c1ac28fd1a941fd569, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:37.859965 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2741cdf-2b84-46b3-a519-b0f33c1e2614 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:37.863833 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31ea01-8215-4b1d-800e-d2ed0042aafb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:37.865542 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31ea01-8215-4b1d-800e-d2ed0042aafb service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:37.896203 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 851/1697] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:37.898005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6eb27-8b56-476a-bcf8-8983508eab83 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:37.902794 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6eb27-8b56-476a-bcf8-8983508eab83 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:37.903250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6eb27-8b56-476a-bcf8-8983508eab83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:37.968423 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-dee6eb27-8b56-476a-bcf8-8983508eab83 None None] MFA Rules not processed for user `f343b816acdb4f87b7cc67b79ad3aba5`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:37.973235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-dee6eb27-8b56-476a-bcf8-8983508eab83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:37.982449 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:37.987289 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 847/1698] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:37 2022] PUT /identity/v3/projects/367f2c521e234e38bb4054ef4777b690/users/2fd254ea419b43c1ac28fd1a941fd569/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:37.988229 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2741cdf-2b84-46b3-a519-b0f33c1e2614 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:37.992352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e2741cdf-2b84-46b3-a519-b0f33c1e2614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:38.175559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2741cdf-2b84-46b3-a519-b0f33c1e2614 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:38.189263 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff98f6-a873-4458-beb9-33cec7a2a7cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:38.189263 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff98f6-a873-4458-beb9-33cec7a2a7cf service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:38.189263 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff98f6-a873-4458-beb9-33cec7a2a7cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:38.189263 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff98f6-a873-4458-beb9-33cec7a2a7cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:38.205767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff98f6-a873-4458-beb9-33cec7a2a7cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:38.209645 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff98f6-a873-4458-beb9-33cec7a2a7cf service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:38.224320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 852/1699] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:37 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:38.224320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429e53e-9325-4f0f-aa3b-76351db9ed3e None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:38.224320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429e53e-9325-4f0f-aa3b-76351db9ed3e None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:38.224320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429e53e-9325-4f0f-aa3b-76351db9ed3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:38.231946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 848/1700] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:38.233886 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff98f6-a873-4458-beb9-33cec7a2a7cf service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:38.235716 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-55ff98f6-a873-4458-beb9-33cec7a2a7cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:38.298609 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-0429e53e-9325-4f0f-aa3b-76351db9ed3e None None] MFA Rules not processed for user `2fd254ea419b43c1ac28fd1a941fd569`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:38.301844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-0429e53e-9325-4f0f-aa3b-76351db9ed3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:38.448386 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff98f6-a873-4458-beb9-33cec7a2a7cf service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:38.465246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055f44f-ae93-4ad2-8d9b-bfbade242bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:38.465246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055f44f-ae93-4ad2-8d9b-bfbade242bef admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:38.465246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055f44f-ae93-4ad2-8d9b-bfbade242bef admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:38.465246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055f44f-ae93-4ad2-8d9b-bfbade242bef admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:38.466341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055f44f-ae93-4ad2-8d9b-bfbade242bef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:38.471463 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055f44f-ae93-4ad2-8d9b-bfbade242bef admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:38.508753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 853/1701] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:38.513915 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429e53e-9325-4f0f-aa3b-76351db9ed3e None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:38.527757 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429e53e-9325-4f0f-aa3b-76351db9ed3e None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:38.532941 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bea417-7075-481e-a4f1-d26d412f68f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:38.533736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bea417-7075-481e-a4f1-d26d412f68f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:38.534086 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bea417-7075-481e-a4f1-d26d412f68f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:38.534372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bea417-7075-481e-a4f1-d26d412f68f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:38.535329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bea417-7075-481e-a4f1-d26d412f68f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:38.537724 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bea417-7075-481e-a4f1-d26d412f68f1 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:38.599133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 849/1702] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:38 2022] POST /identity/v3/projects => generated 405 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:38.603063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055f44f-ae93-4ad2-8d9b-bfbade242bef admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:38.707284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 854/1703] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:38 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:38.708554 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bea417-7075-481e-a4f1-d26d412f68f1 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:38.718694 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-59bea417-7075-481e-a4f1-d26d412f68f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:38.836665 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055f44f-ae93-4ad2-8d9b-bfbade242bef admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:38.920202 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bea417-7075-481e-a4f1-d26d412f68f1 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:38.931048 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940961bf-83c0-47a1-8f57-0f7e04713ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:38.938105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940961bf-83c0-47a1-8f57-0f7e04713ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:38.938105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940961bf-83c0-47a1-8f57-0f7e04713ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:38.938105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940961bf-83c0-47a1-8f57-0f7e04713ea7 admin admin] PATH_INFO: `/v3/users/15266dd9c4c343f8bdd8101905189922` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:38.943018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940961bf-83c0-47a1-8f57-0f7e04713ea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15266dd9c4c343f8bdd8101905189922)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:38.947648 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940961bf-83c0-47a1-8f57-0f7e04713ea7 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:38.992345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c551a1-ee2e-4503-9c84-661d2ff38101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:38.993057 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c551a1-ee2e-4503-9c84-661d2ff38101 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:38.993372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c551a1-ee2e-4503-9c84-661d2ff38101 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:38.993648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c551a1-ee2e-4503-9c84-661d2ff38101 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:38.994341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c551a1-ee2e-4503-9c84-661d2ff38101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:39.001588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c551a1-ee2e-4503-9c84-661d2ff38101 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:39.188885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 850/1704] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:38 2022] POST /identity/v3/users => generated 309 bytes in 586 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:57:39.190128 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c551a1-ee2e-4503-9c84-661d2ff38101 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:39.221771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c551a1-ee2e-4503-9c84-661d2ff38101 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:39.235932 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd479d59-d9e6-4417-9860-068194a25d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:39.238385 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd479d59-d9e6-4417-9860-068194a25d44 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:39.238773 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd479d59-d9e6-4417-9860-068194a25d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:39.239569 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd479d59-d9e6-4417-9860-068194a25d44 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:39.240039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd479d59-d9e6-4417-9860-068194a25d44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:39.242180 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd479d59-d9e6-4417-9860-068194a25d44 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:39.258176 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-940961bf-83c0-47a1-8f57-0f7e04713ea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15266dd9c4c343f8bdd8101905189922'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:39.277904 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-940961bf-83c0-47a1-8f57-0f7e04713ea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15266dd9c4c343f8bdd8101905189922'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:39.358466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-940961bf-83c0-47a1-8f57-0f7e04713ea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15266dd9c4c343f8bdd8101905189922'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:39.359541 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-940961bf-83c0-47a1-8f57-0f7e04713ea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15266dd9c4c343f8bdd8101905189922'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:39.370858 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 851/1705] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:39 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:39.372100 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd479d59-d9e6-4417-9860-068194a25d44 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:39.374170 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-940961bf-83c0-47a1-8f57-0f7e04713ea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15266dd9c4c343f8bdd8101905189922'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:39.375690 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-bd479d59-d9e6-4417-9860-068194a25d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:39.392716 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 855/1706] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:57:38 2022] DELETE /identity/v3/users/15266dd9c4c343f8bdd8101905189922 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:39.403185 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940961bf-83c0-47a1-8f57-0f7e04713ea7 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:39.403185 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-940961bf-83c0-47a1-8f57-0f7e04713ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:39.413187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd479d59-d9e6-4417-9860-068194a25d44 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:39.645648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2be60-e6e3-4924-a234-e4d429be93e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:39.645648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2be60-e6e3-4924-a234-e4d429be93e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:39.645648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2be60-e6e3-4924-a234-e4d429be93e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:39.645648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2be60-e6e3-4924-a234-e4d429be93e6 admin admin] PATH_INFO: `/v3/projects/bc4fd44ac401461192456626cab5125f` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:39.646650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2be60-e6e3-4924-a234-e4d429be93e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc4fd44ac401461192456626cab5125f)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:39.646650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2be60-e6e3-4924-a234-e4d429be93e6 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:39.646806 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940961bf-83c0-47a1-8f57-0f7e04713ea7 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:39.663114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d637a5-520d-42a9-8e69-080330e3f179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:39.663931 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d637a5-520d-42a9-8e69-080330e3f179 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:39.664283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d637a5-520d-42a9-8e69-080330e3f179 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:39.665435 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d637a5-520d-42a9-8e69-080330e3f179 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:39.666237 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d637a5-520d-42a9-8e69-080330e3f179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:39.670463 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d637a5-520d-42a9-8e69-080330e3f179 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:39.682519 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 856/1707] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:39.686853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d637a5-520d-42a9-8e69-080330e3f179 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:39.689014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-c1d637a5-520d-42a9-8e69-080330e3f179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:39.734372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d637a5-520d-42a9-8e69-080330e3f179 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:39.747096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34635b-de29-49a6-828d-bbea96006a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:39.761110 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34635b-de29-49a6-828d-bbea96006a7f admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:39.761432 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34635b-de29-49a6-828d-bbea96006a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:39.761721 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34635b-de29-49a6-828d-bbea96006a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:39.765732 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34635b-de29-49a6-828d-bbea96006a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:39.766321 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34635b-de29-49a6-828d-bbea96006a7f admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:39.796792 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 857/1708] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:39.801402 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b7497-99d7-4d16-96a7-9bc300cab054 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:39.801702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b7497-99d7-4d16-96a7-9bc300cab054 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:39.801979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b7497-99d7-4d16-96a7-9bc300cab054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:39.845218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-bb8b7497-99d7-4d16-96a7-9bc300cab054 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:39.846513 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-bb8b7497-99d7-4d16-96a7-9bc300cab054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:39.871387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 858/1709] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:39.873423 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b7497-99d7-4d16-96a7-9bc300cab054 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:39.900590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b7497-99d7-4d16-96a7-9bc300cab054 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:39.940589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb34efe-9f43-45fe-a015-adc352a86202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:39.940589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb34efe-9f43-45fe-a015-adc352a86202 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:39.940589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb34efe-9f43-45fe-a015-adc352a86202 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:39.940589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb34efe-9f43-45fe-a015-adc352a86202 admin admin] PATH_INFO: `/v3/projects/368842c3db6849418a9730c0d02f324e/users/099eb8db35594a65a0eb3f7aea5a840f/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:39.975380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ecb2be60-e6e3-4924-a234-e4d429be93e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc4fd44ac401461192456626cab5125f', 'request_id': 'req-ecb2be60-e6e3-4924-a234-e4d429be93e6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:39.994933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ecb2be60-e6e3-4924-a234-e4d429be93e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc4fd44ac401461192456626cab5125f', 'request_id': 'req-ecb2be60-e6e3-4924-a234-e4d429be93e6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:40.003466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb34efe-9f43-45fe-a015-adc352a86202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=368842c3db6849418a9730c0d02f324e, user_id=099eb8db35594a65a0eb3f7aea5a840f, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:40.006957 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb34efe-9f43-45fe-a015-adc352a86202 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:40.021339 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ecb2be60-e6e3-4924-a234-e4d429be93e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc4fd44ac401461192456626cab5125f', 'request_id': 'req-ecb2be60-e6e3-4924-a234-e4d429be93e6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:40.201403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ecb2be60-e6e3-4924-a234-e4d429be93e6 admin admin] The token cache is being invalidate because project bc4fd44ac401461192456626cab5125f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:57:40.201403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ecb2be60-e6e3-4924-a234-e4d429be93e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:40.201403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ecb2be60-e6e3-4924-a234-e4d429be93e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:40.201403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 852/1710] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:57:39 2022] DELETE /identity/v3/projects/bc4fd44ac401461192456626cab5125f => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:40.201403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2be60-e6e3-4924-a234-e4d429be93e6 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:40.204020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 859/1711] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:39 2022] PUT /identity/v3/projects/368842c3db6849418a9730c0d02f324e/users/099eb8db35594a65a0eb3f7aea5a840f/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:40.205262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb34efe-9f43-45fe-a015-adc352a86202 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:40.207172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ddb34efe-9f43-45fe-a015-adc352a86202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:40.211447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ecb2be60-e6e3-4924-a234-e4d429be93e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:40.294547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb34efe-9f43-45fe-a015-adc352a86202 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:40.298212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2be60-e6e3-4924-a234-e4d429be93e6 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:40.300276 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7dfdd-0ae3-494e-b61c-83f0368b009e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:40.301496 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7dfdd-0ae3-494e-b61c-83f0368b009e service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:40.301785 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7dfdd-0ae3-494e-b61c-83f0368b009e service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:40.302064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7dfdd-0ae3-494e-b61c-83f0368b009e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:40.304398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-08e7dfdd-0ae3-494e-b61c-83f0368b009e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:40.389795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7dfdd-0ae3-494e-b61c-83f0368b009e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:40.391765 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7dfdd-0ae3-494e-b61c-83f0368b009e service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:40.398210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389ea63-ef22-4721-a500-f8b95f02f12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:40.399851 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389ea63-ef22-4721-a500-f8b95f02f12c admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:40.401046 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389ea63-ef22-4721-a500-f8b95f02f12c admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:40.401046 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389ea63-ef22-4721-a500-f8b95f02f12c admin admin] PATH_INFO: `/v3/projects/7d815918f6824a32928a33a3cf93ca61/users/b213216c4f5140f18e4aeb061b2e067c/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:40.418322 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 860/1712] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:40.419613 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7dfdd-0ae3-494e-b61c-83f0368b009e service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:40.421084 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-08e7dfdd-0ae3-494e-b61c-83f0368b009e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:40.426553 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389ea63-ef22-4721-a500-f8b95f02f12c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d815918f6824a32928a33a3cf93ca61, user_id=b213216c4f5140f18e4aeb061b2e067c, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:40.429612 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389ea63-ef22-4721-a500-f8b95f02f12c admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:40.436273 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7dfdd-0ae3-494e-b61c-83f0368b009e service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:40.445607 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a5807-784f-483f-a75c-3d3198d67c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:40.446515 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a5807-784f-483f-a75c-3d3198d67c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:40.446801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a5807-784f-483f-a75c-3d3198d67c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:40.447080 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a5807-784f-483f-a75c-3d3198d67c29 admin admin] PATH_INFO: `/v3/users/f231aa758a4047dd86a8174649edea71` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:40.448325 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a5807-784f-483f-a75c-3d3198d67c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f231aa758a4047dd86a8174649edea71)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:40.450460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a5807-784f-483f-a75c-3d3198d67c29 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:40.573226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 853/1713] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:40 2022] PUT /identity/v3/projects/7d815918f6824a32928a33a3cf93ca61/users/b213216c4f5140f18e4aeb061b2e067c/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:40.573872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389ea63-ef22-4721-a500-f8b95f02f12c admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:40.579881 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-1389ea63-ef22-4721-a500-f8b95f02f12c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:40.683080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389ea63-ef22-4721-a500-f8b95f02f12c admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:40.688809 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa86771-2d6c-4806-907b-ca3bca918f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:40.689498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa86771-2d6c-4806-907b-ca3bca918f65 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:40.689806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa86771-2d6c-4806-907b-ca3bca918f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:40.690076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa86771-2d6c-4806-907b-ca3bca918f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:40.690942 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa86771-2d6c-4806-907b-ca3bca918f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:40.692671 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa86771-2d6c-4806-907b-ca3bca918f65 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:40.704042 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 854/1714] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:40.705437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86bc26-57a5-4a48-a12c-fbc7aa866c09 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:40.705736 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86bc26-57a5-4a48-a12c-fbc7aa866c09 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:40.706021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86bc26-57a5-4a48-a12c-fbc7aa866c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:40.731337 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-dd86bc26-57a5-4a48-a12c-fbc7aa866c09 None None] MFA Rules not processed for user `073ea72b0441442ebfbbf045eecee2b6`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:40.732862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-dd86bc26-57a5-4a48-a12c-fbc7aa866c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:40.819631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 855/1715] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:40.824852 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86bc26-57a5-4a48-a12c-fbc7aa866c09 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:40.868102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86bc26-57a5-4a48-a12c-fbc7aa866c09 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:40.869922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d12a5807-784f-483f-a75c-3d3198d67c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f231aa758a4047dd86a8174649edea71'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:40.889892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dd29d-46b8-42c7-9276-2740962a4b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:40.890692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dd29d-46b8-42c7-9276-2740962a4b41 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:40.890981 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dd29d-46b8-42c7-9276-2740962a4b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:40.891260 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dd29d-46b8-42c7-9276-2740962a4b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:40.892606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dd29d-46b8-42c7-9276-2740962a4b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:40.905355 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dd29d-46b8-42c7-9276-2740962a4b41 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:40.920774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 856/1716] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:40.922051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dd29d-46b8-42c7-9276-2740962a4b41 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:40.945088 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d12a5807-784f-483f-a75c-3d3198d67c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f231aa758a4047dd86a8174649edea71'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:40.991772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dd29d-46b8-42c7-9276-2740962a4b41 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:41.026118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854803a-aa3b-4f40-920a-4263ea961863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:41.027473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854803a-aa3b-4f40-920a-4263ea961863 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:41.028081 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854803a-aa3b-4f40-920a-4263ea961863 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:41.028658 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854803a-aa3b-4f40-920a-4263ea961863 admin admin] PATH_INFO: `/v3/projects/368842c3db6849418a9730c0d02f324e/users/099eb8db35594a65a0eb3f7aea5a840f/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:41.036774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854803a-aa3b-4f40-920a-4263ea961863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=368842c3db6849418a9730c0d02f324e, user_id=099eb8db35594a65a0eb3f7aea5a840f, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:41.039532 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854803a-aa3b-4f40-920a-4263ea961863 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:41.094867 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 857/1717] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:40 2022] PUT /identity/v3/projects/368842c3db6849418a9730c0d02f324e/users/099eb8db35594a65a0eb3f7aea5a840f/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:41.098550 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854803a-aa3b-4f40-920a-4263ea961863 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:41.107236 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d12a5807-784f-483f-a75c-3d3198d67c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f231aa758a4047dd86a8174649edea71'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:41.108350 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d12a5807-784f-483f-a75c-3d3198d67c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f231aa758a4047dd86a8174649edea71'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:41.124761 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d12a5807-784f-483f-a75c-3d3198d67c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f231aa758a4047dd86a8174649edea71'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:41.152576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 861/1718] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:57:40 2022] DELETE /identity/v3/users/f231aa758a4047dd86a8174649edea71 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:41.220777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854803a-aa3b-4f40-920a-4263ea961863 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:41.360459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073613b5-3154-4f68-bec2-10f1f920aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:41.361422 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073613b5-3154-4f68-bec2-10f1f920aea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:41.361720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073613b5-3154-4f68-bec2-10f1f920aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:41.362005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073613b5-3154-4f68-bec2-10f1f920aea8 admin admin] PATH_INFO: `/v3/projects/7d815918f6824a32928a33a3cf93ca61/users/b213216c4f5140f18e4aeb061b2e067c/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:41.368232 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073613b5-3154-4f68-bec2-10f1f920aea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d815918f6824a32928a33a3cf93ca61, user_id=b213216c4f5140f18e4aeb061b2e067c, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:41.381657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073613b5-3154-4f68-bec2-10f1f920aea8 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:41.418735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 858/1719] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:41 2022] PUT /identity/v3/projects/7d815918f6824a32928a33a3cf93ca61/users/b213216c4f5140f18e4aeb061b2e067c/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:41.420254 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d8cf6-8dc1-40f2-b8b9-fbb8f228151d None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:41.420710 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d8cf6-8dc1-40f2-b8b9-fbb8f228151d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:41.420804 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d8cf6-8dc1-40f2-b8b9-fbb8f228151d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:41.466943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:41.490266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-532d8cf6-8dc1-40f2-b8b9-fbb8f228151d None None] MFA Rules not processed for user `b213216c4f5140f18e4aeb061b2e067c`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:41.492817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-532d8cf6-8dc1-40f2-b8b9-fbb8f228151d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:41.802951 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 862/1720] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:57:41.817964 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073613b5-3154-4f68-bec2-10f1f920aea8 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:41.820099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-073613b5-3154-4f68-bec2-10f1f920aea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:41.939027 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073613b5-3154-4f68-bec2-10f1f920aea8 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:41.943963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097c374-9de5-4c7a-8af4-4944001e3a68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:41.946118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097c374-9de5-4c7a-8af4-4944001e3a68 service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:41.946118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097c374-9de5-4c7a-8af4-4944001e3a68 service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:41.946118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097c374-9de5-4c7a-8af4-4944001e3a68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:41.959807 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097c374-9de5-4c7a-8af4-4944001e3a68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:41.961891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097c374-9de5-4c7a-8af4-4944001e3a68 service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:41.980166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 859/1721] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:42.038347 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d8cf6-8dc1-40f2-b8b9-fbb8f228151d None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:42.039863 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-532d8cf6-8dc1-40f2-b8b9-fbb8f228151d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:42.052597 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097c374-9de5-4c7a-8af4-4944001e3a68 service cinder] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:42.054729 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7097c374-9de5-4c7a-8af4-4944001e3a68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:42.165543 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d8cf6-8dc1-40f2-b8b9-fbb8f228151d None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:42.179432 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952694f-ebb4-410b-b6f1-e7dd87628080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:42.186466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952694f-ebb4-410b-b6f1-e7dd87628080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:42.186466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952694f-ebb4-410b-b6f1-e7dd87628080 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:42.186466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952694f-ebb4-410b-b6f1-e7dd87628080 admin admin] PATH_INFO: `/v3/projects/cfe0b05993dd4b26b3fefba611516ca1` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:42.188312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952694f-ebb4-410b-b6f1-e7dd87628080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfe0b05993dd4b26b3fefba611516ca1)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:42.194436 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097c374-9de5-4c7a-8af4-4944001e3a68 service cinder] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:42.196212 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952694f-ebb4-410b-b6f1-e7dd87628080 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:42.203077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2dabf-70bc-47d3-8164-7519d9ed02be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:42.204202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2dabf-70bc-47d3-8164-7519d9ed02be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:42.206280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2dabf-70bc-47d3-8164-7519d9ed02be admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:42.206952 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2dabf-70bc-47d3-8164-7519d9ed02be admin admin] PATH_INFO: `/v3/projects/53dcd65496bd4871bfdb5236efd49635` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:42.209640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2dabf-70bc-47d3-8164-7519d9ed02be admin admin] RBAC: Authorizing `identity:delete_project(project_id=53dcd65496bd4871bfdb5236efd49635)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:42.218195 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2dabf-70bc-47d3-8164-7519d9ed02be admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:42.404669 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d952694f-ebb4-410b-b6f1-e7dd87628080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe0b05993dd4b26b3fefba611516ca1', 'request_id': 'req-d952694f-ebb4-410b-b6f1-e7dd87628080'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:42.412338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9ad2dabf-70bc-47d3-8164-7519d9ed02be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53dcd65496bd4871bfdb5236efd49635', 'request_id': 'req-9ad2dabf-70bc-47d3-8164-7519d9ed02be'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:42.414254 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d952694f-ebb4-410b-b6f1-e7dd87628080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe0b05993dd4b26b3fefba611516ca1', 'request_id': 'req-d952694f-ebb4-410b-b6f1-e7dd87628080'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:42.419238 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9ad2dabf-70bc-47d3-8164-7519d9ed02be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53dcd65496bd4871bfdb5236efd49635', 'request_id': 'req-9ad2dabf-70bc-47d3-8164-7519d9ed02be'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:42.420417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d952694f-ebb4-410b-b6f1-e7dd87628080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe0b05993dd4b26b3fefba611516ca1', 'request_id': 'req-d952694f-ebb4-410b-b6f1-e7dd87628080'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:42.427441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9ad2dabf-70bc-47d3-8164-7519d9ed02be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53dcd65496bd4871bfdb5236efd49635', 'request_id': 'req-9ad2dabf-70bc-47d3-8164-7519d9ed02be'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:42.553729 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d952694f-ebb4-410b-b6f1-e7dd87628080 admin admin] The token cache is being invalidate because project cfe0b05993dd4b26b3fefba611516ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:57:42.554028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d952694f-ebb4-410b-b6f1-e7dd87628080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:42.556248 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d952694f-ebb4-410b-b6f1-e7dd87628080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:42.558785 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 863/1722] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:57:42 2022] DELETE /identity/v3/projects/cfe0b05993dd4b26b3fefba611516ca1 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:57:42.566170 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952694f-ebb4-410b-b6f1-e7dd87628080 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:42.577063 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d952694f-ebb4-410b-b6f1-e7dd87628080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:42.640289 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9ad2dabf-70bc-47d3-8164-7519d9ed02be admin admin] The token cache is being invalidate because project 53dcd65496bd4871bfdb5236efd49635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:57:42.645037 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9ad2dabf-70bc-47d3-8164-7519d9ed02be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:42.645037 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9ad2dabf-70bc-47d3-8164-7519d9ed02be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:42.648102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 860/1723] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:57:42 2022] DELETE /identity/v3/projects/53dcd65496bd4871bfdb5236efd49635 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:57:42.649644 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3cd76-300a-4eb9-aed6-99fd9ca8553a None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:42.654838 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3cd76-300a-4eb9-aed6-99fd9ca8553a None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:42.656921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3cd76-300a-4eb9-aed6-99fd9ca8553a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:42.716611 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-f8f3cd76-300a-4eb9-aed6-99fd9ca8553a None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:42.720952 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f8f3cd76-300a-4eb9-aed6-99fd9ca8553a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:42.743903 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952694f-ebb4-410b-b6f1-e7dd87628080 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:42.748592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 861/1724] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:42.749273 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171b4f8-b022-42bc-a449-5eb161716e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:42.749922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc3bbd-fb6a-4e96-91e1-97ae39cc1388 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:42.750223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc3bbd-fb6a-4e96-91e1-97ae39cc1388 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:42.750444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171b4f8-b022-42bc-a449-5eb161716e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:42.750660 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc3bbd-fb6a-4e96-91e1-97ae39cc1388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:42.750827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171b4f8-b022-42bc-a449-5eb161716e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:42.751201 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171b4f8-b022-42bc-a449-5eb161716e87 admin admin] PATH_INFO: `/v3/users/fc0b902e74f4437daa3d8d51da57c5e4` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:42.752520 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171b4f8-b022-42bc-a449-5eb161716e87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc0b902e74f4437daa3d8d51da57c5e4)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:42.755180 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171b4f8-b022-42bc-a449-5eb161716e87 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:42.793724 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-facc3bbd-fb6a-4e96-91e1-97ae39cc1388 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:42.795091 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-facc3bbd-fb6a-4e96-91e1-97ae39cc1388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:42.804958 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 862/1725] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:42.809122 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc3bbd-fb6a-4e96-91e1-97ae39cc1388 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:42.818512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc3bbd-fb6a-4e96-91e1-97ae39cc1388 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:42.823816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ced40c-d8cf-4685-8270-3ea1f34d60af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:42.824769 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ced40c-d8cf-4685-8270-3ea1f34d60af admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:42.825062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ced40c-d8cf-4685-8270-3ea1f34d60af admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:42.825415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ced40c-d8cf-4685-8270-3ea1f34d60af admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:42.826158 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ced40c-d8cf-4685-8270-3ea1f34d60af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:57:42.826487 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ced40c-d8cf-4685-8270-3ea1f34d60af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:42.828132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ced40c-d8cf-4685-8270-3ea1f34d60af admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:42.845290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 863/1726] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:57:42.848678 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ced40c-d8cf-4685-8270-3ea1f34d60af admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:42.859088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ced40c-d8cf-4685-8270-3ea1f34d60af admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:42.864301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26289a-87d1-4cc5-97b8-2c9c21237c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:42.868002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26289a-87d1-4cc5-97b8-2c9c21237c5b admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:42.868002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26289a-87d1-4cc5-97b8-2c9c21237c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:42.868002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26289a-87d1-4cc5-97b8-2c9c21237c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:42.868002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26289a-87d1-4cc5-97b8-2c9c21237c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:42.868647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26289a-87d1-4cc5-97b8-2c9c21237c5b admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:43.068655 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 864/1727] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:42 2022] POST /identity/v3/projects => generated 379 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:43.072849 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26289a-87d1-4cc5-97b8-2c9c21237c5b admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:43.161317 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26289a-87d1-4cc5-97b8-2c9c21237c5b admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:43.168965 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443e611-1e4d-46ff-87b7-2bb7d3aea2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:43.170043 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443e611-1e4d-46ff-87b7-2bb7d3aea2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:43.170623 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443e611-1e4d-46ff-87b7-2bb7d3aea2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:43.170840 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443e611-1e4d-46ff-87b7-2bb7d3aea2e8 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:43.171667 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443e611-1e4d-46ff-87b7-2bb7d3aea2e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:43.172746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1171b4f8-b022-42bc-a449-5eb161716e87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc0b902e74f4437daa3d8d51da57c5e4'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:43.174085 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443e611-1e4d-46ff-87b7-2bb7d3aea2e8 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:43.209669 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1171b4f8-b022-42bc-a449-5eb161716e87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc0b902e74f4437daa3d8d51da57c5e4'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:43.357772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 865/1728] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:43 2022] POST /identity/v3/users => generated 290 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:57:43.358961 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443e611-1e4d-46ff-87b7-2bb7d3aea2e8 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:43.372628 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443e611-1e4d-46ff-87b7-2bb7d3aea2e8 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:43.378974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1581b-0822-4c91-91f0-05c701c5aa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:43.382971 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1581b-0822-4c91-91f0-05c701c5aa20 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:43.382971 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1581b-0822-4c91-91f0-05c701c5aa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:43.382971 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1581b-0822-4c91-91f0-05c701c5aa20 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:43.382971 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1581b-0822-4c91-91f0-05c701c5aa20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:43.385106 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1581b-0822-4c91-91f0-05c701c5aa20 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:43.389033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1171b4f8-b022-42bc-a449-5eb161716e87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc0b902e74f4437daa3d8d51da57c5e4'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:43.389910 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1171b4f8-b022-42bc-a449-5eb161716e87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc0b902e74f4437daa3d8d51da57c5e4'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:43.407631 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1171b4f8-b022-42bc-a449-5eb161716e87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc0b902e74f4437daa3d8d51da57c5e4'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:43.409815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 866/1729] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:43.413777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1581b-0822-4c91-91f0-05c701c5aa20 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:43.416071 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-2ac1581b-0822-4c91-91f0-05c701c5aa20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:43.429234 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 864/1730] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:57:42 2022] DELETE /identity/v3/users/fc0b902e74f4437daa3d8d51da57c5e4 => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:43.431860 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1581b-0822-4c91-91f0-05c701c5aa20 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:43.516677 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bdbe4-83f0-4d81-8baf-de7da4686366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:43.517492 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bdbe4-83f0-4d81-8baf-de7da4686366 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:43.517789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bdbe4-83f0-4d81-8baf-de7da4686366 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:43.518168 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bdbe4-83f0-4d81-8baf-de7da4686366 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:43.519112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bdbe4-83f0-4d81-8baf-de7da4686366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:43.520547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bdbe4-83f0-4d81-8baf-de7da4686366 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:43.544831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 867/1731] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:57:43.546451 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171b4f8-b022-42bc-a449-5eb161716e87 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:43.561392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171b4f8-b022-42bc-a449-5eb161716e87 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:43.565418 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0503690-a00f-4b39-8dbc-6e6c64e499f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:43.567669 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0503690-a00f-4b39-8dbc-6e6c64e499f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:43.568555 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0503690-a00f-4b39-8dbc-6e6c64e499f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:43.568941 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0503690-a00f-4b39-8dbc-6e6c64e499f8 admin admin] PATH_INFO: `/v3/projects/7ae11807421044a496e6ae7f078fba9b/users/1b9ba7fa323c4c869ae1c92d3e745838/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:43.583101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:43.603188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0503690-a00f-4b39-8dbc-6e6c64e499f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae11807421044a496e6ae7f078fba9b, user_id=1b9ba7fa323c4c869ae1c92d3e745838, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:43.608392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0503690-a00f-4b39-8dbc-6e6c64e499f8 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:43.784766 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 865/1732] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:43 2022] PUT /identity/v3/projects/7ae11807421044a496e6ae7f078fba9b/users/1b9ba7fa323c4c869ae1c92d3e745838/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:43.811848 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965452f-dad0-498e-ba5b-912bed837d42 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:43.813056 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965452f-dad0-498e-ba5b-912bed837d42 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:43.813398 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965452f-dad0-498e-ba5b-912bed837d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:43.882975 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0503690-a00f-4b39-8dbc-6e6c64e499f8 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:43.889960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e0503690-a00f-4b39-8dbc-6e6c64e499f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:43.924443 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-3965452f-dad0-498e-ba5b-912bed837d42 None None] MFA Rules not processed for user `1b9ba7fa323c4c869ae1c92d3e745838`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:43.924443 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-3965452f-dad0-498e-ba5b-912bed837d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:44.168001 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 868/1733] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:44.172443 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965452f-dad0-498e-ba5b-912bed837d42 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:44.175993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0503690-a00f-4b39-8dbc-6e6c64e499f8 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:44.195196 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63353a9-38e5-4109-aa6b-3ff9b19ac05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:44.196202 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63353a9-38e5-4109-aa6b-3ff9b19ac05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:44.196366 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63353a9-38e5-4109-aa6b-3ff9b19ac05c admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:44.196807 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63353a9-38e5-4109-aa6b-3ff9b19ac05c admin admin] PATH_INFO: `/v3/users/2fd254ea419b43c1ac28fd1a941fd569` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:44.198308 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63353a9-38e5-4109-aa6b-3ff9b19ac05c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fd254ea419b43c1ac28fd1a941fd569)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:44.200273 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63353a9-38e5-4109-aa6b-3ff9b19ac05c admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:44.209614 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965452f-dad0-498e-ba5b-912bed837d42 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:44.224228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac7f3f-3783-4fa5-8ca5-c4b528f3ed7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:44.224892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac7f3f-3783-4fa5-8ca5-c4b528f3ed7c admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:44.225193 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac7f3f-3783-4fa5-8ca5-c4b528f3ed7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:44.225475 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac7f3f-3783-4fa5-8ca5-c4b528f3ed7c admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:44.228494 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac7f3f-3783-4fa5-8ca5-c4b528f3ed7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:44.234150 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac7f3f-3783-4fa5-8ca5-c4b528f3ed7c admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:44.426547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 869/1734] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:44 2022] POST /identity/v3/projects => generated 381 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:44.428739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16908e1-9d1a-436f-a6b7-230c3a7393ea None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:44.429047 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16908e1-9d1a-436f-a6b7-230c3a7393ea None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:44.429587 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16908e1-9d1a-436f-a6b7-230c3a7393ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:44.478860 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-e16908e1-9d1a-436f-a6b7-230c3a7393ea None None] MFA Rules not processed for user `099eb8db35594a65a0eb3f7aea5a840f`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:44.481577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e16908e1-9d1a-436f-a6b7-230c3a7393ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:44.559550 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f63353a9-38e5-4109-aa6b-3ff9b19ac05c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fd254ea419b43c1ac28fd1a941fd569'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:44.569311 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 870/1735] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:44 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:44.571630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314a4eb-d785-40d2-b024-65e5dc83281d None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:44.572118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314a4eb-d785-40d2-b024-65e5dc83281d None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:44.573088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314a4eb-d785-40d2-b024-65e5dc83281d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:44.577696 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f63353a9-38e5-4109-aa6b-3ff9b19ac05c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fd254ea419b43c1ac28fd1a941fd569'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:44.596000 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-6314a4eb-d785-40d2-b024-65e5dc83281d None None] MFA Rules not processed for user `fec6c1cbf48a44f9922bd82e714861c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:44.598045 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-6314a4eb-d785-40d2-b024-65e5dc83281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:44.680378 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 871/1736] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 19:57:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:44.682003 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314a4eb-d785-40d2-b024-65e5dc83281d None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:44.759622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314a4eb-d785-40d2-b024-65e5dc83281d None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:44.765273 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957de744-ef27-466f-9947-383528740dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:44.765972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957de744-ef27-466f-9947-383528740dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:44.766256 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957de744-ef27-466f-9947-383528740dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:44.766534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957de744-ef27-466f-9947-383528740dc5 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:44.767266 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957de744-ef27-466f-9947-383528740dc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:44.769973 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957de744-ef27-466f-9947-383528740dc5 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:44.824736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f63353a9-38e5-4109-aa6b-3ff9b19ac05c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fd254ea419b43c1ac28fd1a941fd569'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:44.828514 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f63353a9-38e5-4109-aa6b-3ff9b19ac05c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fd254ea419b43c1ac28fd1a941fd569'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:44.845121 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f63353a9-38e5-4109-aa6b-3ff9b19ac05c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fd254ea419b43c1ac28fd1a941fd569'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:44.853547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 866/1737] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:57:43 2022] DELETE /identity/v3/users/2fd254ea419b43c1ac28fd1a941fd569 => generated 0 bytes in 973 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:44.858217 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef0592-0129-4c53-8cb1-e536e12fb2ae None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:44.858582 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef0592-0129-4c53-8cb1-e536e12fb2ae None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:44.858930 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef0592-0129-4c53-8cb1-e536e12fb2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:44.881125 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-09ef0592-0129-4c53-8cb1-e536e12fb2ae None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:44.881823 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-09ef0592-0129-4c53-8cb1-e536e12fb2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:44.974611 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 867/1738] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:57:44.981226 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef0592-0129-4c53-8cb1-e536e12fb2ae None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:44.984600 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-09ef0592-0129-4c53-8cb1-e536e12fb2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:45.013976 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef0592-0129-4c53-8cb1-e536e12fb2ae None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:45.030027 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf2274-c04e-4906-9023-0f5b9861bc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:45.031070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf2274-c04e-4906-9023-0f5b9861bc49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:45.031418 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf2274-c04e-4906-9023-0f5b9861bc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:45.031785 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf2274-c04e-4906-9023-0f5b9861bc49 admin admin] PATH_INFO: `/v3/projects/aa7e9bc4d6e0424c9d420d554f12a01c` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:45.033112 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf2274-c04e-4906-9023-0f5b9861bc49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa7e9bc4d6e0424c9d420d554f12a01c)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:45.035498 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf2274-c04e-4906-9023-0f5b9861bc49 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:45.099528 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 872/1739] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:44 2022] POST /identity/v3/users => generated 297 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:45.100502 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957de744-ef27-466f-9947-383528740dc5 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:45.102258 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-957de744-ef27-466f-9947-383528740dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:45.166414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957de744-ef27-466f-9947-383528740dc5 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:45.251023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5baf2274-c04e-4906-9023-0f5b9861bc49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa7e9bc4d6e0424c9d420d554f12a01c', 'request_id': 'req-5baf2274-c04e-4906-9023-0f5b9861bc49'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:45.251253 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9abd7-bb95-473d-a623-265d0208d865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:45.251999 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9abd7-bb95-473d-a623-265d0208d865 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:45.252116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9abd7-bb95-473d-a623-265d0208d865 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:45.252315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9abd7-bb95-473d-a623-265d0208d865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:45.264072 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5baf2274-c04e-4906-9023-0f5b9861bc49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa7e9bc4d6e0424c9d420d554f12a01c', 'request_id': 'req-5baf2274-c04e-4906-9023-0f5b9861bc49'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:45.270899 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5baf2274-c04e-4906-9023-0f5b9861bc49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa7e9bc4d6e0424c9d420d554f12a01c', 'request_id': 'req-5baf2274-c04e-4906-9023-0f5b9861bc49'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:45.275216 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9abd7-bb95-473d-a623-265d0208d865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:45.278754 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9abd7-bb95-473d-a623-265d0208d865 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:45.297416 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 873/1740] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:45.312221 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9abd7-bb95-473d-a623-265d0208d865 service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:45.315005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-a4b9abd7-bb95-473d-a623-265d0208d865 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:45.361657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9abd7-bb95-473d-a623-265d0208d865 service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:45.371805 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5baf2274-c04e-4906-9023-0f5b9861bc49 admin admin] The token cache is being invalidate because project aa7e9bc4d6e0424c9d420d554f12a01c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:57:45.372092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5baf2274-c04e-4906-9023-0f5b9861bc49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:45.374048 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5baf2274-c04e-4906-9023-0f5b9861bc49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:45.376753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 868/1741] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:57:44 2022] DELETE /identity/v3/projects/aa7e9bc4d6e0424c9d420d554f12a01c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:45.377868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf2274-c04e-4906-9023-0f5b9861bc49 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:45.381029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-5baf2274-c04e-4906-9023-0f5b9861bc49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:45.453580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:45.508081 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51716556-5d76-422c-8800-cd9d768d3c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:45.508999 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51716556-5d76-422c-8800-cd9d768d3c19 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:45.509589 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51716556-5d76-422c-8800-cd9d768d3c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:45.509980 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51716556-5d76-422c-8800-cd9d768d3c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:45.510848 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51716556-5d76-422c-8800-cd9d768d3c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:45.513455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51716556-5d76-422c-8800-cd9d768d3c19 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:45.529926 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 874/1742] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:45.536921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b076305-2539-4503-809e-fca43ccddb13 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:45.537378 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b076305-2539-4503-809e-fca43ccddb13 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:45.538012 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b076305-2539-4503-809e-fca43ccddb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:45.561209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-7b076305-2539-4503-809e-fca43ccddb13 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:45.562697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7b076305-2539-4503-809e-fca43ccddb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:45.564610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf2274-c04e-4906-9023-0f5b9861bc49 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:45.577773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63809825-3f92-4399-995b-17cc7c15ee62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc53095a45e4136b37fb6e4e677eff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:45.578443 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63809825-3f92-4399-995b-17cc7c15ee62 service swift] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:45.579266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63809825-3f92-4399-995b-17cc7c15ee62 service swift] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:45.579985 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63809825-3f92-4399-995b-17cc7c15ee62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:45.584514 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-63809825-3f92-4399-995b-17cc7c15ee62 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:45.606072 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 875/1743] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:45.606072 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b076305-2539-4503-809e-fca43ccddb13 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:45.606072 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7b076305-2539-4503-809e-fca43ccddb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:45.624707 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b076305-2539-4503-809e-fca43ccddb13 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:45.690998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cf673-4c4e-4fa5-9e03-d9a5b5b0c44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:45.690998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cf673-4c4e-4fa5-9e03-d9a5b5b0c44f admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:45.690998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cf673-4c4e-4fa5-9e03-d9a5b5b0c44f admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:45.690998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cf673-4c4e-4fa5-9e03-d9a5b5b0c44f admin admin] PATH_INFO: `/v3/projects/445e3391cc2044d1aaa39183e3d3ddcf/users/2d82f138937c44fba87d142384682705/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:45.691963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cf673-4c4e-4fa5-9e03-d9a5b5b0c44f admin admin] RBAC: Authorizing `identity:create_grant(project_id=445e3391cc2044d1aaa39183e3d3ddcf, user_id=2d82f138937c44fba87d142384682705, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:45.691963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cf673-4c4e-4fa5-9e03-d9a5b5b0c44f admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:45.750983 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63809825-3f92-4399-995b-17cc7c15ee62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:45.754900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63809825-3f92-4399-995b-17cc7c15ee62 service swift] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:45.768485 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 869/1744] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 19:57:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 19:57:45.773703 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619983bd-e079-41f7-9ac5-3746a346d94d None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:45.774383 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619983bd-e079-41f7-9ac5-3746a346d94d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:45.774787 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619983bd-e079-41f7-9ac5-3746a346d94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:45.806716 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-619983bd-e079-41f7-9ac5-3746a346d94d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:45.811047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-619983bd-e079-41f7-9ac5-3746a346d94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:45.815349 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 876/1745] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:45 2022] PUT /identity/v3/projects/445e3391cc2044d1aaa39183e3d3ddcf/users/2d82f138937c44fba87d142384682705/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:45.819472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cf673-4c4e-4fa5-9e03-d9a5b5b0c44f admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:45.919737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 870/1746] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:45.924057 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619983bd-e079-41f7-9ac5-3746a346d94d None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:45.947961 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619983bd-e079-41f7-9ac5-3746a346d94d None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:45.962746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd3105-0696-4d5d-b3ab-817a21440b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:45.964610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd3105-0696-4d5d-b3ab-817a21440b00 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:45.964898 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd3105-0696-4d5d-b3ab-817a21440b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:45.966405 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd3105-0696-4d5d-b3ab-817a21440b00 admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:45.967356 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd3105-0696-4d5d-b3ab-817a21440b00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:57:45.967671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd3105-0696-4d5d-b3ab-817a21440b00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:45.974031 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd3105-0696-4d5d-b3ab-817a21440b00 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:45.989096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cf673-4c4e-4fa5-9e03-d9a5b5b0c44f admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:46.000261 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620741d8-b9ea-4a41-ac6f-81a5e3aa3845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:46.000961 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620741d8-b9ea-4a41-ac6f-81a5e3aa3845 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:46.001271 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620741d8-b9ea-4a41-ac6f-81a5e3aa3845 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:46.002783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620741d8-b9ea-4a41-ac6f-81a5e3aa3845 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:46.003589 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620741d8-b9ea-4a41-ac6f-81a5e3aa3845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:46.008441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 871/1747] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:57:46.008623 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620741d8-b9ea-4a41-ac6f-81a5e3aa3845 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:46.009659 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd3105-0696-4d5d-b3ab-817a21440b00 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:46.026315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 877/1748] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:46.027959 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620741d8-b9ea-4a41-ac6f-81a5e3aa3845 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:46.042053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620741d8-b9ea-4a41-ac6f-81a5e3aa3845 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:46.042515 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd3105-0696-4d5d-b3ab-817a21440b00 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:46.052620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7d1f6-ba4e-4c8c-b4fa-f1c1853c225d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:46.060477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c8e9c-22b3-4166-b065-8bc26d2bdf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:46.061004 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7d1f6-ba4e-4c8c-b4fa-f1c1853c225d admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:46.061221 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c8e9c-22b3-4166-b065-8bc26d2bdf49 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:46.061337 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7d1f6-ba4e-4c8c-b4fa-f1c1853c225d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:46.061501 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c8e9c-22b3-4166-b065-8bc26d2bdf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:46.061652 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7d1f6-ba4e-4c8c-b4fa-f1c1853c225d admin admin] PATH_INFO: `/v3/projects/445e3391cc2044d1aaa39183e3d3ddcf/users/2d82f138937c44fba87d142384682705/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:46.061976 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c8e9c-22b3-4166-b065-8bc26d2bdf49 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:46.062786 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c8e9c-22b3-4166-b065-8bc26d2bdf49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:46.064901 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c8e9c-22b3-4166-b065-8bc26d2bdf49 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:46.069260 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7d1f6-ba4e-4c8c-b4fa-f1c1853c225d admin admin] RBAC: Authorizing `identity:create_grant(project_id=445e3391cc2044d1aaa39183e3d3ddcf, user_id=2d82f138937c44fba87d142384682705, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:46.072112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7d1f6-ba4e-4c8c-b4fa-f1c1853c225d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:46.109306 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 878/1749] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:46 2022] PUT /identity/v3/projects/445e3391cc2044d1aaa39183e3d3ddcf/users/2d82f138937c44fba87d142384682705/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:57:46.117228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74371c6-5761-467b-ba94-174f70c69fe5 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:46.117530 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74371c6-5761-467b-ba94-174f70c69fe5 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:46.117812 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74371c6-5761-467b-ba94-174f70c69fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:46.202304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-e74371c6-5761-467b-ba94-174f70c69fe5 None None] MFA Rules not processed for user `2d82f138937c44fba87d142384682705`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:46.203638 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e74371c6-5761-467b-ba94-174f70c69fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:46.241199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 872/1750] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:46 2022] POST /identity/v3/projects => generated 393 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:46.248090 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c00c0-7de1-45cd-8994-4f648f0a40dc None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:46.248596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c00c0-7de1-45cd-8994-4f648f0a40dc None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:46.252366 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c00c0-7de1-45cd-8994-4f648f0a40dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:46.288527 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-837c00c0-7de1-45cd-8994-4f648f0a40dc None None] MFA Rules not processed for user `24bb6f31e87045f5b17f561b42edca6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:46.290495 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-837c00c0-7de1-45cd-8994-4f648f0a40dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:46.347953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 879/1751] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:57:46.348962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74371c6-5761-467b-ba94-174f70c69fe5 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:46.399265 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 873/1752] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Jun 23 19:57:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:46.400072 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c00c0-7de1-45cd-8994-4f648f0a40dc None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:46.414125 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-837c00c0-7de1-45cd-8994-4f648f0a40dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:46.465225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74371c6-5761-467b-ba94-174f70c69fe5 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:46.561899 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c00c0-7de1-45cd-8994-4f648f0a40dc None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:46.574090 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997af91-d0ef-4ba7-80ea-40a5349369b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:46.575270 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997af91-d0ef-4ba7-80ea-40a5349369b8 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:46.575561 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997af91-d0ef-4ba7-80ea-40a5349369b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:46.575841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997af91-d0ef-4ba7-80ea-40a5349369b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:46.576330 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0da70-4685-4b1e-b251-66930713b779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:46.580200 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0da70-4685-4b1e-b251-66930713b779 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:46.580898 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0da70-4685-4b1e-b251-66930713b779 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:46.581556 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0da70-4685-4b1e-b251-66930713b779 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:46.582578 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0da70-4685-4b1e-b251-66930713b779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:46.586444 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0da70-4685-4b1e-b251-66930713b779 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:46.685460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997af91-d0ef-4ba7-80ea-40a5349369b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:46.687949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997af91-d0ef-4ba7-80ea-40a5349369b8 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:46.714222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 874/1753] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:46.717283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e35dd-f469-4e23-95c2-838546f0b183 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:46.717580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e35dd-f469-4e23-95c2-838546f0b183 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:46.717870 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e35dd-f469-4e23-95c2-838546f0b183 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:46.726126 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 875/1754] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 19:57:46 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:57:46.727009 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e35dd-f469-4e23-95c2-838546f0b183 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:46.732179 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d92e35dd-f469-4e23-95c2-838546f0b183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:46.772586 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e35dd-f469-4e23-95c2-838546f0b183 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:46.781509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff2a48-54f0-4525-b03d-d0246134c42b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:46.786023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff2a48-54f0-4525-b03d-d0246134c42b service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:46.786353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff2a48-54f0-4525-b03d-d0246134c42b service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:46.787997 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff2a48-54f0-4525-b03d-d0246134c42b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:46.826175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff2a48-54f0-4525-b03d-d0246134c42b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:46.829630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff2a48-54f0-4525-b03d-d0246134c42b service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:46.860324 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 876/1756] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:46.862089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207491d-1449-4ee3-a71e-ffec74a80154 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:46.862547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207491d-1449-4ee3-a71e-ffec74a80154 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:46.863579 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207491d-1449-4ee3-a71e-ffec74a80154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:46.864854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 880/1755] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:46 2022] POST /identity/v3/users => generated 297 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:46.865984 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0da70-4685-4b1e-b251-66930713b779 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:46.901141 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0da70-4685-4b1e-b251-66930713b779 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:46.907515 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793e5dc-4c90-4131-9b1c-04c63dd09c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:46.908267 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793e5dc-4c90-4131-9b1c-04c63dd09c91 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:46.908618 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793e5dc-4c90-4131-9b1c-04c63dd09c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:46.908961 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793e5dc-4c90-4131-9b1c-04c63dd09c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:46.910570 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793e5dc-4c90-4131-9b1c-04c63dd09c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:46.914926 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793e5dc-4c90-4131-9b1c-04c63dd09c91 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:46.935586 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-b207491d-1449-4ee3-a71e-ffec74a80154 None None] MFA Rules not processed for user `7e9ba6d33e8640ec8dcda9971f59c5dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:46.936861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-b207491d-1449-4ee3-a71e-ffec74a80154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:46.956068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 881/1757] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:46.960892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793e5dc-4c90-4131-9b1c-04c63dd09c91 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:46.993452 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793e5dc-4c90-4131-9b1c-04c63dd09c91 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:46.997997 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd7316-efa4-44a5-be2d-2dd39547b7c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:46.998165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd7316-efa4-44a5-be2d-2dd39547b7c6 service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:47.011785 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd7316-efa4-44a5-be2d-2dd39547b7c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:47.012420 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd7316-efa4-44a5-be2d-2dd39547b7c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:47.018674 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-fdbd7316-efa4-44a5-be2d-2dd39547b7c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:47.112108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 877/1758] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 19:57:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:47.114036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207491d-1449-4ee3-a71e-ffec74a80154 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:47.145439 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207491d-1449-4ee3-a71e-ffec74a80154 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:47.156701 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659e376-b9bd-4745-839c-28b36de2f0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:47.157418 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659e376-b9bd-4745-839c-28b36de2f0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:47.157707 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659e376-b9bd-4745-839c-28b36de2f0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:47.157987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659e376-b9bd-4745-839c-28b36de2f0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:47.159143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659e376-b9bd-4745-839c-28b36de2f0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:47.164481 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659e376-b9bd-4745-839c-28b36de2f0f5 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:47.172039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd7316-efa4-44a5-be2d-2dd39547b7c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:47.178274 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd7316-efa4-44a5-be2d-2dd39547b7c6 service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:47.202987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 882/1759] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:47.204155 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd7316-efa4-44a5-be2d-2dd39547b7c6 service cinder] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:47.206682 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-fdbd7316-efa4-44a5-be2d-2dd39547b7c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:47.206896 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 878/1760] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:47.210524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659e376-b9bd-4745-839c-28b36de2f0f5 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:47.245147 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd7316-efa4-44a5-be2d-2dd39547b7c6 service cinder] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:47.258784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538fcc9-0e3e-4402-b301-edd1e9bf0b5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9ba6d33e8640ec8dcda9971f59c5dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:47.259461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538fcc9-0e3e-4402-b301-edd1e9bf0b5e service placement] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:47.259747 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538fcc9-0e3e-4402-b301-edd1e9bf0b5e service placement] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:47.260781 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538fcc9-0e3e-4402-b301-edd1e9bf0b5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:47.265213 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659e376-b9bd-4745-839c-28b36de2f0f5 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:47.278734 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c7b45-9242-4424-b3a9-9aaf063cde4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:47.280027 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c7b45-9242-4424-b3a9-9aaf063cde4a admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:47.280528 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c7b45-9242-4424-b3a9-9aaf063cde4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:47.281030 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c7b45-9242-4424-b3a9-9aaf063cde4a admin admin] PATH_INFO: `/v3/projects/344daaaba3dc447dbb642f4b206b4973/users/9120d2563cfc462fa0a772798ddcb972/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:47.291202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538fcc9-0e3e-4402-b301-edd1e9bf0b5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:47.297147 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538fcc9-0e3e-4402-b301-edd1e9bf0b5e service placement] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:47.322787 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c7b45-9242-4424-b3a9-9aaf063cde4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=344daaaba3dc447dbb642f4b206b4973, user_id=9120d2563cfc462fa0a772798ddcb972, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:47.328141 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c7b45-9242-4424-b3a9-9aaf063cde4a admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:47.336915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 883/1761] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:47.601304 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 879/1762] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:47 2022] PUT /identity/v3/projects/344daaaba3dc447dbb642f4b206b4973/users/9120d2563cfc462fa0a772798ddcb972/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:47.603562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630d669-c46b-4003-8c98-f33339684c59 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:47.603979 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630d669-c46b-4003-8c98-f33339684c59 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:47.604185 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630d669-c46b-4003-8c98-f33339684c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:47.632553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c7b45-9242-4424-b3a9-9aaf063cde4a admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:47.638094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-9e4c7b45-9242-4424-b3a9-9aaf063cde4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:47.660969 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-0630d669-c46b-4003-8c98-f33339684c59 None None] MFA Rules not processed for user `9120d2563cfc462fa0a772798ddcb972`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:47.678957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0630d669-c46b-4003-8c98-f33339684c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:47.831029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c7b45-9242-4424-b3a9-9aaf063cde4a admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:47.845090 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e97baa-7145-4e89-94ee-9ec87412425e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:47.848174 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e97baa-7145-4e89-94ee-9ec87412425e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:47.848888 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e97baa-7145-4e89-94ee-9ec87412425e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:47.849547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e97baa-7145-4e89-94ee-9ec87412425e admin admin] PATH_INFO: `/v3/projects/367f2c521e234e38bb4054ef4777b690` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:47.851872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e97baa-7145-4e89-94ee-9ec87412425e admin admin] RBAC: Authorizing `identity:delete_project(project_id=367f2c521e234e38bb4054ef4777b690)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:47.854827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e97baa-7145-4e89-94ee-9ec87412425e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:47.890004 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 884/1763] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:57:47.899863 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630d669-c46b-4003-8c98-f33339684c59 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:47.917071 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630d669-c46b-4003-8c98-f33339684c59 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:47.925094 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0559ac7-bdbc-44de-b3f8-e50dae243980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:47.925094 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0559ac7-bdbc-44de-b3f8-e50dae243980 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:47.925094 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0559ac7-bdbc-44de-b3f8-e50dae243980 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:47.925094 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0559ac7-bdbc-44de-b3f8-e50dae243980 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:47.926150 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0559ac7-bdbc-44de-b3f8-e50dae243980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:47.926907 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0559ac7-bdbc-44de-b3f8-e50dae243980 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:47.956001 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:48.277649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 885/1764] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:47 2022] POST /identity/v3/projects => generated 393 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:48.284169 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0559ac7-bdbc-44de-b3f8-e50dae243980 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:48.306767 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f0e97baa-7145-4e89-94ee-9ec87412425e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '367f2c521e234e38bb4054ef4777b690', 'request_id': 'req-f0e97baa-7145-4e89-94ee-9ec87412425e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:48.324808 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f0e97baa-7145-4e89-94ee-9ec87412425e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '367f2c521e234e38bb4054ef4777b690', 'request_id': 'req-f0e97baa-7145-4e89-94ee-9ec87412425e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:48.401753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f0e97baa-7145-4e89-94ee-9ec87412425e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '367f2c521e234e38bb4054ef4777b690', 'request_id': 'req-f0e97baa-7145-4e89-94ee-9ec87412425e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:48.402542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0559ac7-bdbc-44de-b3f8-e50dae243980 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:48.416458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1fa90-b05e-4448-a9f9-620f057da712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:48.417472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1fa90-b05e-4448-a9f9-620f057da712 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:48.417905 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1fa90-b05e-4448-a9f9-620f057da712 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:48.418340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1fa90-b05e-4448-a9f9-620f057da712 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:48.419129 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1fa90-b05e-4448-a9f9-620f057da712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:48.421095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1fa90-b05e-4448-a9f9-620f057da712 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:48.576920 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f0e97baa-7145-4e89-94ee-9ec87412425e admin admin] The token cache is being invalidate because project 367f2c521e234e38bb4054ef4777b690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:57:48.578942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f0e97baa-7145-4e89-94ee-9ec87412425e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:48.580068 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f0e97baa-7145-4e89-94ee-9ec87412425e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:48.580386 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 886/1765] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:48 2022] POST /identity/v3/users => generated 303 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:48.585955 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1fa90-b05e-4448-a9f9-620f057da712 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:48.587528 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 880/1766] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:57:47 2022] DELETE /identity/v3/projects/367f2c521e234e38bb4054ef4777b690 => generated 0 bytes in 957 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:48.599121 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-6dc1fa90-b05e-4448-a9f9-620f057da712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:48.600619 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e97baa-7145-4e89-94ee-9ec87412425e admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:48.606085 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f0e97baa-7145-4e89-94ee-9ec87412425e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:48.650243 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1fa90-b05e-4448-a9f9-620f057da712 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:48.668605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b628a-f257-409f-9722-835a30a1ad77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:48.669608 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b628a-f257-409f-9722-835a30a1ad77 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:48.672343 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b628a-f257-409f-9722-835a30a1ad77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:48.674706 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b628a-f257-409f-9722-835a30a1ad77 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:48.675947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b628a-f257-409f-9722-835a30a1ad77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:48.685017 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b628a-f257-409f-9722-835a30a1ad77 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:48.713685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 887/1767] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:48.717945 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b628a-f257-409f-9722-835a30a1ad77 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:48.734804 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b628a-f257-409f-9722-835a30a1ad77 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:48.755807 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd4594-7e57-4bdb-88b0-e083c3303f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:48.756732 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd4594-7e57-4bdb-88b0-e083c3303f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:48.757023 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd4594-7e57-4bdb-88b0-e083c3303f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:48.757388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd4594-7e57-4bdb-88b0-e083c3303f6e admin admin] PATH_INFO: `/v3/projects/59991fbead804873994cf5bbfb2c8875/users/5b96f749bafe4e2c97b88a323f4aa21b/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:48.787093 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd4594-7e57-4bdb-88b0-e083c3303f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=59991fbead804873994cf5bbfb2c8875, user_id=5b96f749bafe4e2c97b88a323f4aa21b, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:48.789853 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd4594-7e57-4bdb-88b0-e083c3303f6e admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:48.850143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e97baa-7145-4e89-94ee-9ec87412425e admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:48.855967 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292162c8-810e-4109-b06e-d4a4f65d149c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:48.861636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292162c8-810e-4109-b06e-d4a4f65d149c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:48.861636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292162c8-810e-4109-b06e-d4a4f65d149c admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:48.861636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292162c8-810e-4109-b06e-d4a4f65d149c admin admin] PATH_INFO: `/v3/users/b213216c4f5140f18e4aeb061b2e067c` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:48.861636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292162c8-810e-4109-b06e-d4a4f65d149c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b213216c4f5140f18e4aeb061b2e067c)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:48.861636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292162c8-810e-4109-b06e-d4a4f65d149c admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:49.016711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 888/1768] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:48 2022] PUT /identity/v3/projects/59991fbead804873994cf5bbfb2c8875/users/5b96f749bafe4e2c97b88a323f4aa21b/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:49.024543 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd4594-7e57-4bdb-88b0-e083c3303f6e admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:49.155802 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd4594-7e57-4bdb-88b0-e083c3303f6e admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:49.168258 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122ed69-88a3-45c8-aae1-2a37b5078fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:49.169880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122ed69-88a3-45c8-aae1-2a37b5078fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:49.170589 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122ed69-88a3-45c8-aae1-2a37b5078fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:49.170950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122ed69-88a3-45c8-aae1-2a37b5078fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:49.173215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122ed69-88a3-45c8-aae1-2a37b5078fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:49.195502 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122ed69-88a3-45c8-aae1-2a37b5078fd4 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:49.223255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 889/1769] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:57:49.228950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122ed69-88a3-45c8-aae1-2a37b5078fd4 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:49.249242 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122ed69-88a3-45c8-aae1-2a37b5078fd4 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:49.264711 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-292162c8-810e-4109-b06e-d4a4f65d149c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b213216c4f5140f18e4aeb061b2e067c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:49.266877 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a800c27-0bcf-41ef-877d-8d32c4651778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:49.267918 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a800c27-0bcf-41ef-877d-8d32c4651778 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:49.268311 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a800c27-0bcf-41ef-877d-8d32c4651778 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:49.268638 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a800c27-0bcf-41ef-877d-8d32c4651778 admin admin] PATH_INFO: `/v3/projects/59991fbead804873994cf5bbfb2c8875/users/5b96f749bafe4e2c97b88a323f4aa21b/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:49.274781 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a800c27-0bcf-41ef-877d-8d32c4651778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59991fbead804873994cf5bbfb2c8875, user_id=5b96f749bafe4e2c97b88a323f4aa21b, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:49.287578 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a800c27-0bcf-41ef-877d-8d32c4651778 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:49.319465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 890/1770] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:49 2022] PUT /identity/v3/projects/59991fbead804873994cf5bbfb2c8875/users/5b96f749bafe4e2c97b88a323f4aa21b/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:57:49.321471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc44f-c60d-4d31-91b9-e1eb72878e88 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:49.321818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc44f-c60d-4d31-91b9-e1eb72878e88 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:49.322159 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc44f-c60d-4d31-91b9-e1eb72878e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:49.340279 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-292162c8-810e-4109-b06e-d4a4f65d149c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b213216c4f5140f18e4aeb061b2e067c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:49.385182 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-f18cc44f-c60d-4d31-91b9-e1eb72878e88 None None] MFA Rules not processed for user `5b96f749bafe4e2c97b88a323f4aa21b`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:49.386768 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f18cc44f-c60d-4d31-91b9-e1eb72878e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:49.475809 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-292162c8-810e-4109-b06e-d4a4f65d149c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b213216c4f5140f18e4aeb061b2e067c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:49.476830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-292162c8-810e-4109-b06e-d4a4f65d149c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b213216c4f5140f18e4aeb061b2e067c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:49.491606 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-292162c8-810e-4109-b06e-d4a4f65d149c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b213216c4f5140f18e4aeb061b2e067c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:49.510745 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 891/1771] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:57:49.514009 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 881/1772] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:57:48 2022] DELETE /identity/v3/users/b213216c4f5140f18e4aeb061b2e067c => generated 0 bytes in 914 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:49.527358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1b6bb-69a3-40b5-a79d-61144c451205 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:49.527358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1b6bb-69a3-40b5-a79d-61144c451205 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:49.527358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1b6bb-69a3-40b5-a79d-61144c451205 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:49.527358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 892/1773] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 19:57:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:57:49.529111 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292162c8-810e-4109-b06e-d4a4f65d149c admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:49.533383 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-292162c8-810e-4109-b06e-d4a4f65d149c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:49.628977 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292162c8-810e-4109-b06e-d4a4f65d149c admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:49.640025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b39b54-013b-4277-aeae-2bc1458c3acf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:49.641200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b39b54-013b-4277-aeae-2bc1458c3acf service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:49.642005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b39b54-013b-4277-aeae-2bc1458c3acf service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:49.642624 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b39b54-013b-4277-aeae-2bc1458c3acf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:49.653196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b92e3-ce0c-4db4-b97d-e0fd268123cb None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:49.653755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b92e3-ce0c-4db4-b97d-e0fd268123cb None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:49.653872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b92e3-ce0c-4db4-b97d-e0fd268123cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:49.703452 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-c53b92e3-ce0c-4db4-b97d-e0fd268123cb None None] MFA Rules not processed for user `7e9ba6d33e8640ec8dcda9971f59c5dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:49.703685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c53b92e3-ce0c-4db4-b97d-e0fd268123cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:49.798693 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b39b54-013b-4277-aeae-2bc1458c3acf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:49.801460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b39b54-013b-4277-aeae-2bc1458c3acf service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:49.850397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 882/1774] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:49.889484 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 893/1775] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 19:57:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:57:50.004728 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b39b54-013b-4277-aeae-2bc1458c3acf service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:50.004728 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-b2b39b54-013b-4277-aeae-2bc1458c3acf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:50.004728 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b39b54-013b-4277-aeae-2bc1458c3acf service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:50.006288 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b51f8-12c2-4aa2-b27a-55c1de7a7517 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9ba6d33e8640ec8dcda9971f59c5dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:50.006288 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b51f8-12c2-4aa2-b27a-55c1de7a7517 service placement] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:50.006288 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b51f8-12c2-4aa2-b27a-55c1de7a7517 service placement] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:50.006288 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b51f8-12c2-4aa2-b27a-55c1de7a7517 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:50.006641 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b51f8-12c2-4aa2-b27a-55c1de7a7517 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:50.006641 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b51f8-12c2-4aa2-b27a-55c1de7a7517 service placement] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:50.006641 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 883/1776] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:50.006840 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b92e3-ce0c-4db4-b97d-e0fd268123cb None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:50.018346 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b92e3-ce0c-4db4-b97d-e0fd268123cb None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:50.022726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc1f10-7b45-44a0-be0c-0bc677f86d7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:50.023615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc1f10-7b45-44a0-be0c-0bc677f86d7e service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:50.023710 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc1f10-7b45-44a0-be0c-0bc677f86d7e service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:50.024017 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc1f10-7b45-44a0-be0c-0bc677f86d7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:50.026043 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-1ddc1f10-7b45-44a0-be0c-0bc677f86d7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:50.151146 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc1f10-7b45-44a0-be0c-0bc677f86d7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:50.153701 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc1f10-7b45-44a0-be0c-0bc677f86d7e service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:50.196780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 894/1777] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:50.224392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b51f8-12c2-4aa2-b27a-55c1de7a7517 service placement] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:50.225981 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-8c8b51f8-12c2-4aa2-b27a-55c1de7a7517 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:50.355378 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90d1a2-34a2-4544-a824-31b1aeb41aaf None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:50.355806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90d1a2-34a2-4544-a824-31b1aeb41aaf None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:50.356225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90d1a2-34a2-4544-a824-31b1aeb41aaf None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:50.358602 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 895/1778] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 19:57:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:57:50.437500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b51f8-12c2-4aa2-b27a-55c1de7a7517 service placement] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:50.457681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8149e-4b20-410a-b123-3c0e69598ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:50.462499 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8149e-4b20-410a-b123-3c0e69598ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:50.462499 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8149e-4b20-410a-b123-3c0e69598ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:50.462499 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8149e-4b20-410a-b123-3c0e69598ce0 admin admin] PATH_INFO: `/v3/users/f343b816acdb4f87b7cc67b79ad3aba5` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:50.467992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8149e-4b20-410a-b123-3c0e69598ce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f343b816acdb4f87b7cc67b79ad3aba5)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:50.475678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8149e-4b20-410a-b123-3c0e69598ce0 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:50.537835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe2841-598a-43fd-8210-0159c5667daf None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:50.539576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe2841-598a-43fd-8210-0159c5667daf None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:50.544080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe2841-598a-43fd-8210-0159c5667daf None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:50.547170 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 896/1779] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 19:57:50 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 19:57:50.569577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15077b-91fe-4dce-b054-36cea986c55a None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:50.570593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15077b-91fe-4dce-b054-36cea986c55a None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:50.571002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15077b-91fe-4dce-b054-36cea986c55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:50.608539 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-0e15077b-91fe-4dce-b054-36cea986c55a None None] MFA Rules not processed for user `83bff5cd7782423eaa0bc5b29b208ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:50.612797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0e15077b-91fe-4dce-b054-36cea986c55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:50.852919 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 897/1780] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 19:57:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:50.855057 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba21993-46ad-48b3-8333-6bcbf0ed8b89 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:50.855327 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-47b8149e-4b20-410a-b123-3c0e69598ce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f343b816acdb4f87b7cc67b79ad3aba5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:50.857680 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba21993-46ad-48b3-8333-6bcbf0ed8b89 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:50.859094 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba21993-46ad-48b3-8333-6bcbf0ed8b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:50.910232 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-47b8149e-4b20-410a-b123-3c0e69598ce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f343b816acdb4f87b7cc67b79ad3aba5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:50.944005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-fba21993-46ad-48b3-8333-6bcbf0ed8b89 None None] MFA Rules not processed for user `83bff5cd7782423eaa0bc5b29b208ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:50.948923 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-fba21993-46ad-48b3-8333-6bcbf0ed8b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:50.966631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 898/1781] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 19:57:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:51.268910 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-47b8149e-4b20-410a-b123-3c0e69598ce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f343b816acdb4f87b7cc67b79ad3aba5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:51.268910 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-47b8149e-4b20-410a-b123-3c0e69598ce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f343b816acdb4f87b7cc67b79ad3aba5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:51.293990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-47b8149e-4b20-410a-b123-3c0e69598ce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f343b816acdb4f87b7cc67b79ad3aba5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:51.300239 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba21993-46ad-48b3-8333-6bcbf0ed8b89 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:51.302704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-fba21993-46ad-48b3-8333-6bcbf0ed8b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:51.324342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 884/1782] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:57:50 2022] DELETE /identity/v3/users/f343b816acdb4f87b7cc67b79ad3aba5 => generated 0 bytes in 1089 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:51.327732 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba21993-46ad-48b3-8333-6bcbf0ed8b89 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:51.447062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ae757-f2f3-42cd-95df-1f1878de5358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:51.447062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ae757-f2f3-42cd-95df-1f1878de5358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:51.447062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ae757-f2f3-42cd-95df-1f1878de5358 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:51.447062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ae757-f2f3-42cd-95df-1f1878de5358 admin admin] PATH_INFO: `/v3/users/cd42fe903b954cdd8986800d3b089cfb` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:51.447563 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ae757-f2f3-42cd-95df-1f1878de5358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd42fe903b954cdd8986800d3b089cfb)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:51.455466 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ae757-f2f3-42cd-95df-1f1878de5358 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:51.473318 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8149e-4b20-410a-b123-3c0e69598ce0 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:51.475148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-47b8149e-4b20-410a-b123-3c0e69598ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:51.580112 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8149e-4b20-410a-b123-3c0e69598ce0 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:51.587289 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09634d76-07b2-432d-a0cc-736426f53e1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:51.589863 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09634d76-07b2-432d-a0cc-736426f53e1f service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:51.589863 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09634d76-07b2-432d-a0cc-736426f53e1f service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:51.589863 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09634d76-07b2-432d-a0cc-736426f53e1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:51.590593 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-09634d76-07b2-432d-a0cc-736426f53e1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:51.608167 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09634d76-07b2-432d-a0cc-736426f53e1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:51.619656 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09634d76-07b2-432d-a0cc-736426f53e1f service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:51.659384 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 885/1783] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:57:51.662693 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09634d76-07b2-432d-a0cc-736426f53e1f service nova] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:51.666468 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-09634d76-07b2-432d-a0cc-736426f53e1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:51.726872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09634d76-07b2-432d-a0cc-736426f53e1f service nova] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:51.726872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531c570-8e0f-4255-bfb4-1e3494274932 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:51.726872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531c570-8e0f-4255-bfb4-1e3494274932 service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:51.726872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531c570-8e0f-4255-bfb4-1e3494274932 service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:51.727551 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531c570-8e0f-4255-bfb4-1e3494274932 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:51.727551 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-4531c570-8e0f-4255-bfb4-1e3494274932 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:51.727551 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531c570-8e0f-4255-bfb4-1e3494274932 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:51.727551 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531c570-8e0f-4255-bfb4-1e3494274932 service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:51.736744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 886/1784] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:51.914853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:51.938299 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-841ae757-f2f3-42cd-95df-1f1878de5358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd42fe903b954cdd8986800d3b089cfb'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:51.964332 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-841ae757-f2f3-42cd-95df-1f1878de5358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd42fe903b954cdd8986800d3b089cfb'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:52.607759 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-841ae757-f2f3-42cd-95df-1f1878de5358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd42fe903b954cdd8986800d3b089cfb'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:52.607759 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-841ae757-f2f3-42cd-95df-1f1878de5358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd42fe903b954cdd8986800d3b089cfb'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:52.607759 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-841ae757-f2f3-42cd-95df-1f1878de5358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd42fe903b954cdd8986800d3b089cfb'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:52.607759 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 899/1785] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:57:51 2022] DELETE /identity/v3/users/cd42fe903b954cdd8986800d3b089cfb => generated 0 bytes in 1275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:52.613394 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0d4ec-0f2e-49d2-bc3c-ddd7a5e97048 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:52.614027 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0d4ec-0f2e-49d2-bc3c-ddd7a5e97048 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:52.614556 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0d4ec-0f2e-49d2-bc3c-ddd7a5e97048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:52.653894 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-9be0d4ec-0f2e-49d2-bc3c-ddd7a5e97048 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:52.658080 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-9be0d4ec-0f2e-49d2-bc3c-ddd7a5e97048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:52.754270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:52.763635 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ae757-f2f3-42cd-95df-1f1878de5358 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:52.765960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-841ae757-f2f3-42cd-95df-1f1878de5358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:52.856971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 887/1786] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:52.856971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0d4ec-0f2e-49d2-bc3c-ddd7a5e97048 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:52.856971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-9be0d4ec-0f2e-49d2-bc3c-ddd7a5e97048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:52.876150 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0d4ec-0f2e-49d2-bc3c-ddd7a5e97048 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:52.904888 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7f09c-d6b5-414e-a6cb-b5eb0737ec34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:52.905431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7f09c-d6b5-414e-a6cb-b5eb0737ec34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:52.905715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7f09c-d6b5-414e-a6cb-b5eb0737ec34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:52.905990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7f09c-d6b5-414e-a6cb-b5eb0737ec34 admin admin] PATH_INFO: `/v3/projects/7c6885d3fd534ca5b03732f0dcbce9cb` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:52.922283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7f09c-d6b5-414e-a6cb-b5eb0737ec34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c6885d3fd534ca5b03732f0dcbce9cb)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:52.928245 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7f09c-d6b5-414e-a6cb-b5eb0737ec34 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:53.006673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ae757-f2f3-42cd-95df-1f1878de5358 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:53.024089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f17123-4b6d-4b5c-9774-b7d2d3934a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:53.028684 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f17123-4b6d-4b5c-9774-b7d2d3934a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:53.029145 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f17123-4b6d-4b5c-9774-b7d2d3934a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:53.029888 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f17123-4b6d-4b5c-9774-b7d2d3934a38 admin admin] PATH_INFO: `/v3/projects/7d815918f6824a32928a33a3cf93ca61` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:53.031931 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f17123-4b6d-4b5c-9774-b7d2d3934a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d815918f6824a32928a33a3cf93ca61)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:53.039546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f17123-4b6d-4b5c-9774-b7d2d3934a38 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:53.529797 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5de7f09c-d6b5-414e-a6cb-b5eb0737ec34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c6885d3fd534ca5b03732f0dcbce9cb', 'request_id': 'req-5de7f09c-d6b5-414e-a6cb-b5eb0737ec34'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:53.542141 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5de7f09c-d6b5-414e-a6cb-b5eb0737ec34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c6885d3fd534ca5b03732f0dcbce9cb', 'request_id': 'req-5de7f09c-d6b5-414e-a6cb-b5eb0737ec34'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:53.550080 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5de7f09c-d6b5-414e-a6cb-b5eb0737ec34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c6885d3fd534ca5b03732f0dcbce9cb', 'request_id': 'req-5de7f09c-d6b5-414e-a6cb-b5eb0737ec34'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:53.837541 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-31f17123-4b6d-4b5c-9774-b7d2d3934a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d815918f6824a32928a33a3cf93ca61', 'request_id': 'req-31f17123-4b6d-4b5c-9774-b7d2d3934a38'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:53.837717 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5de7f09c-d6b5-414e-a6cb-b5eb0737ec34 admin admin] The token cache is being invalidate because project 7c6885d3fd534ca5b03732f0dcbce9cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:57:53.837814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5de7f09c-d6b5-414e-a6cb-b5eb0737ec34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:53.840042 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5de7f09c-d6b5-414e-a6cb-b5eb0737ec34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:53.842763 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 888/1787] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:57:52 2022] DELETE /identity/v3/projects/7c6885d3fd534ca5b03732f0dcbce9cb => generated 0 bytes in 1003 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:53.844197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7f09c-d6b5-414e-a6cb-b5eb0737ec34 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:53.846025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-5de7f09c-d6b5-414e-a6cb-b5eb0737ec34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:53.868366 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-31f17123-4b6d-4b5c-9774-b7d2d3934a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d815918f6824a32928a33a3cf93ca61', 'request_id': 'req-31f17123-4b6d-4b5c-9774-b7d2d3934a38'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:54.018768 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-31f17123-4b6d-4b5c-9774-b7d2d3934a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d815918f6824a32928a33a3cf93ca61', 'request_id': 'req-31f17123-4b6d-4b5c-9774-b7d2d3934a38'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:54.031808 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7f09c-d6b5-414e-a6cb-b5eb0737ec34 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:54.031808 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cc470-91ab-4141-bfd8-11117d38503a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:54.031808 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cc470-91ab-4141-bfd8-11117d38503a service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:54.031808 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cc470-91ab-4141-bfd8-11117d38503a service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:54.032925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cc470-91ab-4141-bfd8-11117d38503a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:54.032925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-489cc470-91ab-4141-bfd8-11117d38503a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:54.121730 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cc470-91ab-4141-bfd8-11117d38503a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:54.123326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cc470-91ab-4141-bfd8-11117d38503a service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:54.151726 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 889/1788] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:54.154070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cc470-91ab-4141-bfd8-11117d38503a service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:54.158147 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-489cc470-91ab-4141-bfd8-11117d38503a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:54.189060 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cc470-91ab-4141-bfd8-11117d38503a service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:54.202190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb223a-7df3-4415-b14c-8df4f67d86b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:54.203306 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb223a-7df3-4415-b14c-8df4f67d86b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:54.203679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb223a-7df3-4415-b14c-8df4f67d86b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:54.204421 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb223a-7df3-4415-b14c-8df4f67d86b3 admin admin] PATH_INFO: `/v3/users/099eb8db35594a65a0eb3f7aea5a840f` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:54.207171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb223a-7df3-4415-b14c-8df4f67d86b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=099eb8db35594a65a0eb3f7aea5a840f)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:54.212373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb223a-7df3-4415-b14c-8df4f67d86b3 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:54.250734 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-31f17123-4b6d-4b5c-9774-b7d2d3934a38 admin admin] The token cache is being invalidate because project 7d815918f6824a32928a33a3cf93ca61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:57:54.251041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-31f17123-4b6d-4b5c-9774-b7d2d3934a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:54.294580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-31f17123-4b6d-4b5c-9774-b7d2d3934a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:54.294580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 900/1789] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:57:52 2022] DELETE /identity/v3/projects/7d815918f6824a32928a33a3cf93ca61 => generated 0 bytes in 1528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:57:54.299658 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5abb2-158a-4ede-b40d-15d1272519a4 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:54.304604 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5abb2-158a-4ede-b40d-15d1272519a4 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:54.305267 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5abb2-158a-4ede-b40d-15d1272519a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:54.331008 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-08c5abb2-158a-4ede-b40d-15d1272519a4 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:54.333590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-08c5abb2-158a-4ede-b40d-15d1272519a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:54.349685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 901/1790] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:54.359081 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771588b7-429e-4837-ae53-042b8c07d67c None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:54.363266 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771588b7-429e-4837-ae53-042b8c07d67c None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:54.364060 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771588b7-429e-4837-ae53-042b8c07d67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:54.395741 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-771588b7-429e-4837-ae53-042b8c07d67c None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:54.401636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-771588b7-429e-4837-ae53-042b8c07d67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:54.411775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 902/1791] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:54.416743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771588b7-429e-4837-ae53-042b8c07d67c None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:54.427105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771588b7-429e-4837-ae53-042b8c07d67c None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:54.433087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416be27-c773-481f-a653-6c1f3649d0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:54.434123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416be27-c773-481f-a653-6c1f3649d0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:54.435462 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416be27-c773-481f-a653-6c1f3649d0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:54.436195 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416be27-c773-481f-a653-6c1f3649d0f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:54.437225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416be27-c773-481f-a653-6c1f3649d0f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:57:54.437754 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416be27-c773-481f-a653-6c1f3649d0f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:54.439617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416be27-c773-481f-a653-6c1f3649d0f8 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:54.465222 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 903/1792] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:57:54.471051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416be27-c773-481f-a653-6c1f3649d0f8 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:54.499508 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416be27-c773-481f-a653-6c1f3649d0f8 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:54.505797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250464e0-884a-439e-b499-74376e17c307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:54.506639 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250464e0-884a-439e-b499-74376e17c307 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:54.508369 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250464e0-884a-439e-b499-74376e17c307 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:54.508369 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250464e0-884a-439e-b499-74376e17c307 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:54.508369 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250464e0-884a-439e-b499-74376e17c307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:54.510399 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250464e0-884a-439e-b499-74376e17c307 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:54.815636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 904/1793] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:54 2022] POST /identity/v3/projects => generated 369 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:54.821314 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250464e0-884a-439e-b499-74376e17c307 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:55.005905 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250464e0-884a-439e-b499-74376e17c307 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:55.020233 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8cc5c-c20d-41fb-b2cf-9706d144ebb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:55.020930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8cc5c-c20d-41fb-b2cf-9706d144ebb7 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:55.021149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8cc5c-c20d-41fb-b2cf-9706d144ebb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:55.021460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8cc5c-c20d-41fb-b2cf-9706d144ebb7 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:55.022173 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8cc5c-c20d-41fb-b2cf-9706d144ebb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:55.024199 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8cc5c-c20d-41fb-b2cf-9706d144ebb7 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:55.151310 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-3cbb223a-7df3-4415-b14c-8df4f67d86b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '099eb8db35594a65a0eb3f7aea5a840f'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:55.179514 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-3cbb223a-7df3-4415-b14c-8df4f67d86b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '099eb8db35594a65a0eb3f7aea5a840f'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:55.236500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 905/1794] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:54 2022] POST /identity/v3/users => generated 285 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:57:55.240821 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8cc5c-c20d-41fb-b2cf-9706d144ebb7 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:55.243780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-1cb8cc5c-c20d-41fb-b2cf-9706d144ebb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:55.270473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8cc5c-c20d-41fb-b2cf-9706d144ebb7 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:55.276170 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87434cb2-7ed4-4888-b261-a7b01f17ebec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:55.277125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87434cb2-7ed4-4888-b261-a7b01f17ebec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:55.277450 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87434cb2-7ed4-4888-b261-a7b01f17ebec admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:55.277764 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87434cb2-7ed4-4888-b261-a7b01f17ebec admin admin] PATH_INFO: `/v3/users/1b9ba7fa323c4c869ae1c92d3e745838` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:55.279079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87434cb2-7ed4-4888-b261-a7b01f17ebec admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9ba7fa323c4c869ae1c92d3e745838)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:55.281062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87434cb2-7ed4-4888-b261-a7b01f17ebec admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:55.306648 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-3cbb223a-7df3-4415-b14c-8df4f67d86b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '099eb8db35594a65a0eb3f7aea5a840f'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:55.306648 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-3cbb223a-7df3-4415-b14c-8df4f67d86b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '099eb8db35594a65a0eb3f7aea5a840f'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:55.306648 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:57:55.306648 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-3cbb223a-7df3-4415-b14c-8df4f67d86b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '099eb8db35594a65a0eb3f7aea5a840f'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:55.309898 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 890/1795] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:57:54 2022] DELETE /identity/v3/users/099eb8db35594a65a0eb3f7aea5a840f => generated 0 bytes in 1158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:55.310646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb223a-7df3-4415-b14c-8df4f67d86b3 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:55.317562 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-3cbb223a-7df3-4415-b14c-8df4f67d86b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:55.410333 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb223a-7df3-4415-b14c-8df4f67d86b3 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:55.415476 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f525355-dae4-4b00-9fb2-e762387bcd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:55.416438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f525355-dae4-4b00-9fb2-e762387bcd5e admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:55.416826 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f525355-dae4-4b00-9fb2-e762387bcd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:55.417284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f525355-dae4-4b00-9fb2-e762387bcd5e admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:55.418247 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f525355-dae4-4b00-9fb2-e762387bcd5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:55.420251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f525355-dae4-4b00-9fb2-e762387bcd5e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:55.432785 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 891/1796] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:55.436769 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f525355-dae4-4b00-9fb2-e762387bcd5e admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:55.452149 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f525355-dae4-4b00-9fb2-e762387bcd5e admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:55.475768 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0325e-1b8c-4697-9ac9-0a4851b0d2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:55.476636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0325e-1b8c-4697-9ac9-0a4851b0d2fb admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:55.476995 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0325e-1b8c-4697-9ac9-0a4851b0d2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:55.477612 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0325e-1b8c-4697-9ac9-0a4851b0d2fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:55.478883 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0325e-1b8c-4697-9ac9-0a4851b0d2fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:55.480769 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0325e-1b8c-4697-9ac9-0a4851b0d2fb admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:55.512833 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 892/1797] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:57:55.513860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0325e-1b8c-4697-9ac9-0a4851b0d2fb admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:55.515676 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-75c0325e-1b8c-4697-9ac9-0a4851b0d2fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:55.539636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0325e-1b8c-4697-9ac9-0a4851b0d2fb admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:55.548699 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ff6f7-848d-4c03-82e7-3067fc6a24ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:55.549661 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ff6f7-848d-4c03-82e7-3067fc6a24ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:55.550081 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ff6f7-848d-4c03-82e7-3067fc6a24ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:55.550390 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ff6f7-848d-4c03-82e7-3067fc6a24ff admin admin] PATH_INFO: `/v3/projects/8fc9f5b486bb4dbca78f5be25775ab2c` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:55.551845 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ff6f7-848d-4c03-82e7-3067fc6a24ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fc9f5b486bb4dbca78f5be25775ab2c)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:55.555094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ff6f7-848d-4c03-82e7-3067fc6a24ff admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:55.870236 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-87434cb2-7ed4-4888-b261-a7b01f17ebec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9ba7fa323c4c869ae1c92d3e745838'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:55.902399 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-87434cb2-7ed4-4888-b261-a7b01f17ebec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9ba7fa323c4c869ae1c92d3e745838'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:55.907829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-349ff6f7-848d-4c03-82e7-3067fc6a24ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fc9f5b486bb4dbca78f5be25775ab2c', 'request_id': 'req-349ff6f7-848d-4c03-82e7-3067fc6a24ff'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:55.919528 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-349ff6f7-848d-4c03-82e7-3067fc6a24ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fc9f5b486bb4dbca78f5be25775ab2c', 'request_id': 'req-349ff6f7-848d-4c03-82e7-3067fc6a24ff'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:55.925742 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-349ff6f7-848d-4c03-82e7-3067fc6a24ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fc9f5b486bb4dbca78f5be25775ab2c', 'request_id': 'req-349ff6f7-848d-4c03-82e7-3067fc6a24ff'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:56.114890 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-87434cb2-7ed4-4888-b261-a7b01f17ebec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9ba7fa323c4c869ae1c92d3e745838'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:56.115513 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-87434cb2-7ed4-4888-b261-a7b01f17ebec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9ba7fa323c4c869ae1c92d3e745838'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:56.125985 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-87434cb2-7ed4-4888-b261-a7b01f17ebec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9ba7fa323c4c869ae1c92d3e745838'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:56.129671 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 906/1798] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:57:55 2022] DELETE /identity/v3/users/1b9ba7fa323c4c869ae1c92d3e745838 => generated 0 bytes in 893 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:56.130445 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87434cb2-7ed4-4888-b261-a7b01f17ebec admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:56.132031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-87434cb2-7ed4-4888-b261-a7b01f17ebec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:56.187391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-349ff6f7-848d-4c03-82e7-3067fc6a24ff admin admin] The token cache is being invalidate because project 8fc9f5b486bb4dbca78f5be25775ab2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:57:56.188775 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-349ff6f7-848d-4c03-82e7-3067fc6a24ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:56.189397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-349ff6f7-848d-4c03-82e7-3067fc6a24ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:56.194314 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 893/1799] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:57:55 2022] DELETE /identity/v3/projects/8fc9f5b486bb4dbca78f5be25775ab2c => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:56.195218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ff6f7-848d-4c03-82e7-3067fc6a24ff admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:56.197632 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-349ff6f7-848d-4c03-82e7-3067fc6a24ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:56.212376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87434cb2-7ed4-4888-b261-a7b01f17ebec admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:56.217807 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd4f8d-7237-4def-ae9b-ec8d63095a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:56.218716 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd4f8d-7237-4def-ae9b-ec8d63095a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:56.219002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd4f8d-7237-4def-ae9b-ec8d63095a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:56.219281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd4f8d-7237-4def-ae9b-ec8d63095a74 admin admin] PATH_INFO: `/v3/projects/ba3fa9ccaedf4d11939afae1acfc9117/users/1109c2a87f694995ba83d7392df4e9f2/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:56.235286 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd4f8d-7237-4def-ae9b-ec8d63095a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3fa9ccaedf4d11939afae1acfc9117, user_id=1109c2a87f694995ba83d7392df4e9f2, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:56.238871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd4f8d-7237-4def-ae9b-ec8d63095a74 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:56.289922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ff6f7-848d-4c03-82e7-3067fc6a24ff admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:56.295704 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98580c54-1ca3-4564-9dbe-d0785e5d61e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:56.296634 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98580c54-1ca3-4564-9dbe-d0785e5d61e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:56.296919 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98580c54-1ca3-4564-9dbe-d0785e5d61e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:56.297224 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98580c54-1ca3-4564-9dbe-d0785e5d61e0 admin admin] PATH_INFO: `/v3/projects/368842c3db6849418a9730c0d02f324e` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:56.298424 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98580c54-1ca3-4564-9dbe-d0785e5d61e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=368842c3db6849418a9730c0d02f324e)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:56.301248 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98580c54-1ca3-4564-9dbe-d0785e5d61e0 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:56.419703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 907/1800] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:56 2022] PUT /identity/v3/projects/ba3fa9ccaedf4d11939afae1acfc9117/users/1109c2a87f694995ba83d7392df4e9f2/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:56.421338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451888e-79fc-4fd3-8029-809e6e8ca6cf None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:56.421662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451888e-79fc-4fd3-8029-809e6e8ca6cf None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:56.421950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451888e-79fc-4fd3-8029-809e6e8ca6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:56.442283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-a451888e-79fc-4fd3-8029-809e6e8ca6cf None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:56.448818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-a451888e-79fc-4fd3-8029-809e6e8ca6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:56.457588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-98580c54-1ca3-4564-9dbe-d0785e5d61e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '368842c3db6849418a9730c0d02f324e', 'request_id': 'req-98580c54-1ca3-4564-9dbe-d0785e5d61e0'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:56.465563 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-98580c54-1ca3-4564-9dbe-d0785e5d61e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '368842c3db6849418a9730c0d02f324e', 'request_id': 'req-98580c54-1ca3-4564-9dbe-d0785e5d61e0'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:56.472143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-98580c54-1ca3-4564-9dbe-d0785e5d61e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '368842c3db6849418a9730c0d02f324e', 'request_id': 'req-98580c54-1ca3-4564-9dbe-d0785e5d61e0'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:56.514800 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 908/1801] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:56.515626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451888e-79fc-4fd3-8029-809e6e8ca6cf None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:56.516889 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-a451888e-79fc-4fd3-8029-809e6e8ca6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:56.529013 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451888e-79fc-4fd3-8029-809e6e8ca6cf None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:56.533588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c04fc6-fc9e-4acc-b296-c65169fe9681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:56.534544 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c04fc6-fc9e-4acc-b296-c65169fe9681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:56.534832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c04fc6-fc9e-4acc-b296-c65169fe9681 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:56.535111 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c04fc6-fc9e-4acc-b296-c65169fe9681 admin admin] PATH_INFO: `/v3/users/d61662572baa4e36b3cf8df34300e2c6` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:56.536319 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c04fc6-fc9e-4acc-b296-c65169fe9681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d61662572baa4e36b3cf8df34300e2c6)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:56.538279 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c04fc6-fc9e-4acc-b296-c65169fe9681 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:56.649439 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-98580c54-1ca3-4564-9dbe-d0785e5d61e0 admin admin] The token cache is being invalidate because project 368842c3db6849418a9730c0d02f324e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:57:56.660861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-98580c54-1ca3-4564-9dbe-d0785e5d61e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:56.660861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-98580c54-1ca3-4564-9dbe-d0785e5d61e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:56.660861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 894/1802] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:57:56 2022] DELETE /identity/v3/projects/368842c3db6849418a9730c0d02f324e => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:56.660861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c784941-1477-4955-ac5c-aa1bb53d21d2 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:56.660861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c784941-1477-4955-ac5c-aa1bb53d21d2 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:56.660861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c784941-1477-4955-ac5c-aa1bb53d21d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:56.680437 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-1c784941-1477-4955-ac5c-aa1bb53d21d2 None None] MFA Rules not processed for user `1109c2a87f694995ba83d7392df4e9f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:56.681711 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-1c784941-1477-4955-ac5c-aa1bb53d21d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:56.745358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 895/1803] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:56.757661 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c784941-1477-4955-ac5c-aa1bb53d21d2 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:56.757661 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-1c784941-1477-4955-ac5c-aa1bb53d21d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:56.805847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c784941-1477-4955-ac5c-aa1bb53d21d2 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:56.809530 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455d977-5756-4d58-b0ad-cc0a13179e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:56.810218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455d977-5756-4d58-b0ad-cc0a13179e5c service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:56.810504 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455d977-5756-4d58-b0ad-cc0a13179e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:56.810783 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455d977-5756-4d58-b0ad-cc0a13179e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:56.812581 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-6455d977-5756-4d58-b0ad-cc0a13179e5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:56.825440 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455d977-5756-4d58-b0ad-cc0a13179e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:56.826860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455d977-5756-4d58-b0ad-cc0a13179e5c service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:56.851916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 896/1804] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:56.851916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba0614-38b1-4614-853e-7069194a9452 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:56.851916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba0614-38b1-4614-853e-7069194a9452 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:56.851916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba0614-38b1-4614-853e-7069194a9452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:56.857758 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-d6ba0614-38b1-4614-853e-7069194a9452 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:56.858968 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d6ba0614-38b1-4614-853e-7069194a9452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:56.869610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 897/1805] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:56.870432 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba0614-38b1-4614-853e-7069194a9452 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:56.871711 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d6ba0614-38b1-4614-853e-7069194a9452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:56.891382 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba0614-38b1-4614-853e-7069194a9452 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:56.902244 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dac88c-c368-4d82-8a4d-b3f679e923a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:56.903233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dac88c-c368-4d82-8a4d-b3f679e923a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:56.903517 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dac88c-c368-4d82-8a4d-b3f679e923a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:56.904082 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dac88c-c368-4d82-8a4d-b3f679e923a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:56.905302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dac88c-c368-4d82-8a4d-b3f679e923a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:56.906768 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dac88c-c368-4d82-8a4d-b3f679e923a5 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:56.933247 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-21c04fc6-fc9e-4acc-b296-c65169fe9681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd61662572baa4e36b3cf8df34300e2c6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:56.948439 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-21c04fc6-fc9e-4acc-b296-c65169fe9681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd61662572baa4e36b3cf8df34300e2c6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:57.057605 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 898/1806] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:56 2022] POST /identity/v3/projects => generated 365 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:57.059034 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b324b9-5703-476b-a48c-5805aae7b92a None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:57.059414 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b324b9-5703-476b-a48c-5805aae7b92a None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:57.059892 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b324b9-5703-476b-a48c-5805aae7b92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:57.080147 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-d1b324b9-5703-476b-a48c-5805aae7b92a None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:57.081923 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d1b324b9-5703-476b-a48c-5805aae7b92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:57.091930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-21c04fc6-fc9e-4acc-b296-c65169fe9681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd61662572baa4e36b3cf8df34300e2c6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:57.092556 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-21c04fc6-fc9e-4acc-b296-c65169fe9681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd61662572baa4e36b3cf8df34300e2c6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:57.101903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-21c04fc6-fc9e-4acc-b296-c65169fe9681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd61662572baa4e36b3cf8df34300e2c6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:57.110381 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 909/1807] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:57:56 2022] DELETE /identity/v3/users/d61662572baa4e36b3cf8df34300e2c6 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:57.111491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c04fc6-fc9e-4acc-b296-c65169fe9681 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:57.113616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-21c04fc6-fc9e-4acc-b296-c65169fe9681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:57.165613 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 899/1808] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:57.169518 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b324b9-5703-476b-a48c-5805aae7b92a None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:57.185056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b324b9-5703-476b-a48c-5805aae7b92a None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:57.198330 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c04fc6-fc9e-4acc-b296-c65169fe9681 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:57.203403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f36ed0-4ff1-4e0f-96e9-37919d6f1e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:57.204092 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f36ed0-4ff1-4e0f-96e9-37919d6f1e5d admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:57.204363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f36ed0-4ff1-4e0f-96e9-37919d6f1e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:57.204648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f36ed0-4ff1-4e0f-96e9-37919d6f1e5d admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:57.205386 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f36ed0-4ff1-4e0f-96e9-37919d6f1e5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:57.208024 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f36ed0-4ff1-4e0f-96e9-37919d6f1e5d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:57.256577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c52e2-f96a-404d-85fa-8b0afc48c7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:57.263039 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c52e2-f96a-404d-85fa-8b0afc48c7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:57.263039 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c52e2-f96a-404d-85fa-8b0afc48c7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:57.263039 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c52e2-f96a-404d-85fa-8b0afc48c7d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:57.263039 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c52e2-f96a-404d-85fa-8b0afc48c7d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:57:57.263039 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c52e2-f96a-404d-85fa-8b0afc48c7d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:57.263039 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c52e2-f96a-404d-85fa-8b0afc48c7d8 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:57.276755 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 900/1809] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:57:57.281320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c52e2-f96a-404d-85fa-8b0afc48c7d8 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:57.293249 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c52e2-f96a-404d-85fa-8b0afc48c7d8 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:57.299871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 910/1810] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:57 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:57.300708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49632d3-6091-4a48-8bc1-1caf6c577bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:57.301664 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49632d3-6091-4a48-8bc1-1caf6c577bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:57.302049 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49632d3-6091-4a48-8bc1-1caf6c577bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:57.302414 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49632d3-6091-4a48-8bc1-1caf6c577bc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:57.303187 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49632d3-6091-4a48-8bc1-1caf6c577bc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:57.304195 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f36ed0-4ff1-4e0f-96e9-37919d6f1e5d admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:57.305327 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49632d3-6091-4a48-8bc1-1caf6c577bc5 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:57.316820 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f36ed0-4ff1-4e0f-96e9-37919d6f1e5d admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:57.322265 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ac426-31a7-4cd5-8787-25cb62125f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:57.323448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ac426-31a7-4cd5-8787-25cb62125f50 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:57.323953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ac426-31a7-4cd5-8787-25cb62125f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:57.324456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ac426-31a7-4cd5-8787-25cb62125f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:57.325478 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ac426-31a7-4cd5-8787-25cb62125f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:57.327625 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ac426-31a7-4cd5-8787-25cb62125f50 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:57.344324 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 911/1811] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:57.349409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ac426-31a7-4cd5-8787-25cb62125f50 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:57.357184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ac426-31a7-4cd5-8787-25cb62125f50 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:57.374705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015c432-0c07-4a02-8514-7d306fa78f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:57.377824 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015c432-0c07-4a02-8514-7d306fa78f8d admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:57.377824 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015c432-0c07-4a02-8514-7d306fa78f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:57.377824 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015c432-0c07-4a02-8514-7d306fa78f8d admin admin] PATH_INFO: `/v3/projects/b960d2b8d1b24269bfb99cb6f486f7dc/users/09fdddbd093e4435912d48f33c2d4cf1/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:57.401960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015c432-0c07-4a02-8514-7d306fa78f8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b960d2b8d1b24269bfb99cb6f486f7dc, user_id=09fdddbd093e4435912d48f33c2d4cf1, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:57.406372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015c432-0c07-4a02-8514-7d306fa78f8d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:57.416246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 901/1812] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:57 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:57.417884 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49632d3-6091-4a48-8bc1-1caf6c577bc5 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:57.507061 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49632d3-6091-4a48-8bc1-1caf6c577bc5 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:57.512002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfd61f-c0fd-4ddd-b8c5-3b90ac49566e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:57.512867 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfd61f-c0fd-4ddd-b8c5-3b90ac49566e admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:57.513202 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfd61f-c0fd-4ddd-b8c5-3b90ac49566e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:57.513496 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfd61f-c0fd-4ddd-b8c5-3b90ac49566e admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:57.514691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfd61f-c0fd-4ddd-b8c5-3b90ac49566e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:57.516801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfd61f-c0fd-4ddd-b8c5-3b90ac49566e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:57.555944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 912/1813] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:57 2022] PUT /identity/v3/projects/b960d2b8d1b24269bfb99cb6f486f7dc/users/09fdddbd093e4435912d48f33c2d4cf1/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:57.560097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015c432-0c07-4a02-8514-7d306fa78f8d admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:57.636741 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015c432-0c07-4a02-8514-7d306fa78f8d admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:57.643186 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1625689-7632-4874-87c6-81786a071051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:57.644166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1625689-7632-4874-87c6-81786a071051 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:57.644559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1625689-7632-4874-87c6-81786a071051 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:57.644969 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1625689-7632-4874-87c6-81786a071051 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:57.645869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1625689-7632-4874-87c6-81786a071051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:57.647764 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1625689-7632-4874-87c6-81786a071051 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:57.652546 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 902/1814] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:57 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:57:57.660476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 913/1815] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:57:57.662925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfd61f-c0fd-4ddd-b8c5-3b90ac49566e admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:57.664380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1625689-7632-4874-87c6-81786a071051 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:57.676291 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1625689-7632-4874-87c6-81786a071051 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:57.678451 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfd61f-c0fd-4ddd-b8c5-3b90ac49566e admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:57.683512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd15964-03b6-402e-b2bb-3b6ae0bb1ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:57.683684 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ff798-6d03-4a1f-b948-b7255abc7ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:57.684224 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd15964-03b6-402e-b2bb-3b6ae0bb1ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:57.684666 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd15964-03b6-402e-b2bb-3b6ae0bb1ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:57.685083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ff798-6d03-4a1f-b948-b7255abc7ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:57.705761 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd15964-03b6-402e-b2bb-3b6ae0bb1ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:57.705997 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ff798-6d03-4a1f-b948-b7255abc7ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:57.705997 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ff798-6d03-4a1f-b948-b7255abc7ac9 admin admin] PATH_INFO: `/v3/projects/b960d2b8d1b24269bfb99cb6f486f7dc/users/09fdddbd093e4435912d48f33c2d4cf1/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:57.706155 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd15964-03b6-402e-b2bb-3b6ae0bb1ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:57.706155 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd15964-03b6-402e-b2bb-3b6ae0bb1ac1 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:57.706332 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ff798-6d03-4a1f-b948-b7255abc7ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b960d2b8d1b24269bfb99cb6f486f7dc, user_id=09fdddbd093e4435912d48f33c2d4cf1, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:57.706332 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ff798-6d03-4a1f-b948-b7255abc7ac9 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:57.706530 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 903/1816] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:57.706608 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 914/1817] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:57 2022] PUT /identity/v3/projects/b960d2b8d1b24269bfb99cb6f486f7dc/users/09fdddbd093e4435912d48f33c2d4cf1/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:57.706813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd15964-03b6-402e-b2bb-3b6ae0bb1ac1 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:57.714077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce66d0-f085-4e55-ad8e-8852077e75a8 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:57.714375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce66d0-f085-4e55-ad8e-8852077e75a8 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:57.714662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce66d0-f085-4e55-ad8e-8852077e75a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:57.718131 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd15964-03b6-402e-b2bb-3b6ae0bb1ac1 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:57.761131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-2cce66d0-f085-4e55-ad8e-8852077e75a8 None None] MFA Rules not processed for user `09fdddbd093e4435912d48f33c2d4cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:57.770811 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-2cce66d0-f085-4e55-ad8e-8852077e75a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:57.804197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a53e7b-033b-4bec-80a5-a93b565f27d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:57.804873 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a53e7b-033b-4bec-80a5-a93b565f27d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:57.805317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a53e7b-033b-4bec-80a5-a93b565f27d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:57.805607 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a53e7b-033b-4bec-80a5-a93b565f27d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:57.806337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a53e7b-033b-4bec-80a5-a93b565f27d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:57.807970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a53e7b-033b-4bec-80a5-a93b565f27d9 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:57.818505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 904/1818] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:57.819302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a53e7b-033b-4bec-80a5-a93b565f27d9 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:57.823114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e1a53e7b-033b-4bec-80a5-a93b565f27d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:57.836587 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a53e7b-033b-4bec-80a5-a93b565f27d9 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:57.841737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699680d3-dca4-45a7-aad8-0bd134914beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:57.845274 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699680d3-dca4-45a7-aad8-0bd134914beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:57.845274 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699680d3-dca4-45a7-aad8-0bd134914beb admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:57.845274 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699680d3-dca4-45a7-aad8-0bd134914beb admin admin] PATH_INFO: `/v3/projects/7ae11807421044a496e6ae7f078fba9b` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:57.845274 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699680d3-dca4-45a7-aad8-0bd134914beb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ae11807421044a496e6ae7f078fba9b)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:57.846314 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699680d3-dca4-45a7-aad8-0bd134914beb admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:57.850352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 915/1819] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:57:57.851183 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce66d0-f085-4e55-ad8e-8852077e75a8 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:57.861872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce66d0-f085-4e55-ad8e-8852077e75a8 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:57.866641 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4dbcba-f275-468b-b911-a2c460673410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:57.867548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dbcba-f275-468b-b911-a2c460673410 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:57.867843 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dbcba-f275-468b-b911-a2c460673410 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:57.868133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dbcba-f275-468b-b911-a2c460673410 admin admin] PATH_INFO: `/v3/projects/cdfc3fdcc33a46ec99fd82a900a7f796/users/877c1ed322d644f7909ed0293f0eddd5/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:57.883273 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4dbcba-f275-468b-b911-a2c460673410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfc3fdcc33a46ec99fd82a900a7f796, user_id=877c1ed322d644f7909ed0293f0eddd5, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:57.885981 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4dbcba-f275-468b-b911-a2c460673410 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:58.069020 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 916/1820] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:57 2022] PUT /identity/v3/projects/cdfc3fdcc33a46ec99fd82a900a7f796/users/877c1ed322d644f7909ed0293f0eddd5/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:58.069996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4dbcba-f275-468b-b911-a2c460673410 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:58.078007 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-6b4dbcba-f275-468b-b911-a2c460673410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:58.093922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-699680d3-dca4-45a7-aad8-0bd134914beb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ae11807421044a496e6ae7f078fba9b', 'request_id': 'req-699680d3-dca4-45a7-aad8-0bd134914beb'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:58.106444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-699680d3-dca4-45a7-aad8-0bd134914beb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ae11807421044a496e6ae7f078fba9b', 'request_id': 'req-699680d3-dca4-45a7-aad8-0bd134914beb'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:58.108000 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-699680d3-dca4-45a7-aad8-0bd134914beb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ae11807421044a496e6ae7f078fba9b', 'request_id': 'req-699680d3-dca4-45a7-aad8-0bd134914beb'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:58.164212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4dbcba-f275-468b-b911-a2c460673410 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:58.203641 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-699680d3-dca4-45a7-aad8-0bd134914beb admin admin] The token cache is being invalidate because project 7ae11807421044a496e6ae7f078fba9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:57:58.203943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-699680d3-dca4-45a7-aad8-0bd134914beb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:58.204771 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-699680d3-dca4-45a7-aad8-0bd134914beb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:58.207280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 905/1821] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:57:57 2022] DELETE /identity/v3/projects/7ae11807421044a496e6ae7f078fba9b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:58.208114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699680d3-dca4-45a7-aad8-0bd134914beb admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:58.209590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-699680d3-dca4-45a7-aad8-0bd134914beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:58.216917 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e56968-c369-47b9-a15d-22f248ec204d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:58.217659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e56968-c369-47b9-a15d-22f248ec204d service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:58.217910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e56968-c369-47b9-a15d-22f248ec204d service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:58.218195 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e56968-c369-47b9-a15d-22f248ec204d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:58.220526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-11e56968-c369-47b9-a15d-22f248ec204d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:58.291907 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699680d3-dca4-45a7-aad8-0bd134914beb admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:58.301477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778b11e-89a3-4427-a39f-6f1b8beb1f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:58.301477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778b11e-89a3-4427-a39f-6f1b8beb1f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:58.301477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778b11e-89a3-4427-a39f-6f1b8beb1f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:58.301477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778b11e-89a3-4427-a39f-6f1b8beb1f9e admin admin] PATH_INFO: `/v3/projects/a4714a14d0874a1d99d9f92e0967ac49` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:58.302235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778b11e-89a3-4427-a39f-6f1b8beb1f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4714a14d0874a1d99d9f92e0967ac49)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:58.304573 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778b11e-89a3-4427-a39f-6f1b8beb1f9e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:58.307484 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e56968-c369-47b9-a15d-22f248ec204d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:58.308934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e56968-c369-47b9-a15d-22f248ec204d service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:58.320409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 917/1822] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:58.322101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4df77b-7070-4c9f-9d98-07f2298648a8 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:58.324340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4df77b-7070-4c9f-9d98-07f2298648a8 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:58.324340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4df77b-7070-4c9f-9d98-07f2298648a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:58.352034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-0e4df77b-7070-4c9f-9d98-07f2298648a8 None None] MFA Rules not processed for user `877c1ed322d644f7909ed0293f0eddd5`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:58.353445 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0e4df77b-7070-4c9f-9d98-07f2298648a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:58.419721 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 918/1823] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:58.422666 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4df77b-7070-4c9f-9d98-07f2298648a8 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:58.424471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0e4df77b-7070-4c9f-9d98-07f2298648a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:58.428533 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f778b11e-89a3-4427-a39f-6f1b8beb1f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4714a14d0874a1d99d9f92e0967ac49', 'request_id': 'req-f778b11e-89a3-4427-a39f-6f1b8beb1f9e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:58.435112 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f778b11e-89a3-4427-a39f-6f1b8beb1f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4714a14d0874a1d99d9f92e0967ac49', 'request_id': 'req-f778b11e-89a3-4427-a39f-6f1b8beb1f9e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:58.442222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f778b11e-89a3-4427-a39f-6f1b8beb1f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4714a14d0874a1d99d9f92e0967ac49', 'request_id': 'req-f778b11e-89a3-4427-a39f-6f1b8beb1f9e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:58.448570 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4df77b-7070-4c9f-9d98-07f2298648a8 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:58.506075 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d164d5-ef5c-4829-b7fd-30ea8a6bfabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:58.506949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d164d5-ef5c-4829-b7fd-30ea8a6bfabf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:58.507237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d164d5-ef5c-4829-b7fd-30ea8a6bfabf admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:58.507516 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d164d5-ef5c-4829-b7fd-30ea8a6bfabf admin admin] PATH_INFO: `/v3/users/2d82f138937c44fba87d142384682705` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:58.508709 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d164d5-ef5c-4829-b7fd-30ea8a6bfabf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d82f138937c44fba87d142384682705)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:58.510671 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d164d5-ef5c-4829-b7fd-30ea8a6bfabf admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:58.588246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f778b11e-89a3-4427-a39f-6f1b8beb1f9e admin admin] The token cache is being invalidate because project a4714a14d0874a1d99d9f92e0967ac49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:57:58.588646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f778b11e-89a3-4427-a39f-6f1b8beb1f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:58.589457 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f778b11e-89a3-4427-a39f-6f1b8beb1f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:58.591072 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 906/1824] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:57:58 2022] DELETE /identity/v3/projects/a4714a14d0874a1d99d9f92e0967ac49 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:58.594720 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778b11e-89a3-4427-a39f-6f1b8beb1f9e admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:58.595526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f778b11e-89a3-4427-a39f-6f1b8beb1f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:58.608731 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778b11e-89a3-4427-a39f-6f1b8beb1f9e admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:58.615371 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538abf95-2fe8-4d61-a914-37983bcdce38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:58.616029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538abf95-2fe8-4d61-a914-37983bcdce38 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:58.616311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538abf95-2fe8-4d61-a914-37983bcdce38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:58.616588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538abf95-2fe8-4d61-a914-37983bcdce38 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:58.617312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538abf95-2fe8-4d61-a914-37983bcdce38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:58.619228 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538abf95-2fe8-4d61-a914-37983bcdce38 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:58.792449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 907/1825] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:58 2022] POST /identity/v3/projects => generated 371 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:58.795697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9c362-192b-4fd5-a2ba-33131201033b None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:58.795697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9c362-192b-4fd5-a2ba-33131201033b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:58.795697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9c362-192b-4fd5-a2ba-33131201033b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:58.800736 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-85d164d5-ef5c-4829-b7fd-30ea8a6bfabf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d82f138937c44fba87d142384682705'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:58.813513 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-f4c9c362-192b-4fd5-a2ba-33131201033b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:58.813954 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-85d164d5-ef5c-4829-b7fd-30ea8a6bfabf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d82f138937c44fba87d142384682705'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:58.814868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f4c9c362-192b-4fd5-a2ba-33131201033b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:58.881413 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 908/1826] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:58.882508 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9c362-192b-4fd5-a2ba-33131201033b None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:58.895805 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-85d164d5-ef5c-4829-b7fd-30ea8a6bfabf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d82f138937c44fba87d142384682705'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:58.896853 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-85d164d5-ef5c-4829-b7fd-30ea8a6bfabf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d82f138937c44fba87d142384682705'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:58.897224 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9c362-192b-4fd5-a2ba-33131201033b None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:58.902029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96d4a0-12a6-433b-8cc5-a17e46772356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:58.904744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96d4a0-12a6-433b-8cc5-a17e46772356 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:58.904744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96d4a0-12a6-433b-8cc5-a17e46772356 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:58.904744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96d4a0-12a6-433b-8cc5-a17e46772356 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:58.904744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96d4a0-12a6-433b-8cc5-a17e46772356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:58.905907 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96d4a0-12a6-433b-8cc5-a17e46772356 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:58.908344 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-85d164d5-ef5c-4829-b7fd-30ea8a6bfabf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d82f138937c44fba87d142384682705'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:57:58.914805 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 919/1827] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:57:58 2022] DELETE /identity/v3/users/2d82f138937c44fba87d142384682705 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:58.916093 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacd876-ef18-4069-999b-cbe47accfc18 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:58.916385 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacd876-ef18-4069-999b-cbe47accfc18 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:58.916666 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacd876-ef18-4069-999b-cbe47accfc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:58.935203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-bdacd876-ef18-4069-999b-cbe47accfc18 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:58.936474 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-bdacd876-ef18-4069-999b-cbe47accfc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:59.004987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 920/1828] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:59.008822 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacd876-ef18-4069-999b-cbe47accfc18 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:59.020381 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacd876-ef18-4069-999b-cbe47accfc18 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:59.036115 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333fc00-77ff-4849-8f05-7f006c2fd417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:59.036957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333fc00-77ff-4849-8f05-7f006c2fd417 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:59.037318 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333fc00-77ff-4849-8f05-7f006c2fd417 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:59.037610 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333fc00-77ff-4849-8f05-7f006c2fd417 admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:59.039324 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333fc00-77ff-4849-8f05-7f006c2fd417 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:57:59.039762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333fc00-77ff-4849-8f05-7f006c2fd417 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:59.041790 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333fc00-77ff-4849-8f05-7f006c2fd417 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:59.044478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 909/1829] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:58 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:59.045447 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96d4a0-12a6-433b-8cc5-a17e46772356 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:59.053062 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-4f96d4a0-12a6-433b-8cc5-a17e46772356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:59.065580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 921/1830] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:57:59.069786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333fc00-77ff-4849-8f05-7f006c2fd417 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:59.076722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96d4a0-12a6-433b-8cc5-a17e46772356 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:59.084154 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333fc00-77ff-4849-8f05-7f006c2fd417 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:59.095171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4d1f1-92fe-490d-83af-9aa524916152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:59.096004 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4d1f1-92fe-490d-83af-9aa524916152 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:59.096123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4d1f1-92fe-490d-83af-9aa524916152 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:59.096409 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4d1f1-92fe-490d-83af-9aa524916152 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:59.097697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4d1f1-92fe-490d-83af-9aa524916152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:59.097822 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d196f4-607b-420e-a07c-cf337c0ff5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:59.098788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d196f4-607b-420e-a07c-cf337c0ff5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:59.099276 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d196f4-607b-420e-a07c-cf337c0ff5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:59.099388 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4d1f1-92fe-490d-83af-9aa524916152 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:59.099914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d196f4-607b-420e-a07c-cf337c0ff5b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:59.101240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d196f4-607b-420e-a07c-cf337c0ff5b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:59.103582 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d196f4-607b-420e-a07c-cf337c0ff5b4 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:59.133908 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 910/1831] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:59.138185 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4d1f1-92fe-490d-83af-9aa524916152 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:59.148421 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4d1f1-92fe-490d-83af-9aa524916152 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:59.153681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d460ae1-33db-4ddf-a2a4-cb2306d9362b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:59.154591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d460ae1-33db-4ddf-a2a4-cb2306d9362b admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:59.155110 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d460ae1-33db-4ddf-a2a4-cb2306d9362b admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:59.155399 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d460ae1-33db-4ddf-a2a4-cb2306d9362b admin admin] PATH_INFO: `/v3/projects/1b0bee5b728842f497538891a27bd6e8/users/4bf1c37e4191412d8873536edfbbe5e6/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:59.191741 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d460ae1-33db-4ddf-a2a4-cb2306d9362b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0bee5b728842f497538891a27bd6e8, user_id=4bf1c37e4191412d8873536edfbbe5e6, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:59.196950 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d460ae1-33db-4ddf-a2a4-cb2306d9362b admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:59.293098 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 922/1832] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:57:59 2022] POST /identity/v3/projects => generated 365 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:59.297287 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d196f4-607b-420e-a07c-cf337c0ff5b4 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:59.360533 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 911/1833] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:59 2022] PUT /identity/v3/projects/1b0bee5b728842f497538891a27bd6e8/users/4bf1c37e4191412d8873536edfbbe5e6/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:57:59.365322 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d460ae1-33db-4ddf-a2a4-cb2306d9362b admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:59.408093 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d196f4-607b-420e-a07c-cf337c0ff5b4 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:59.484644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d460ae1-33db-4ddf-a2a4-cb2306d9362b admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:59.491546 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd69d7-218a-4c34-b408-108f8c541323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:59.492621 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd69d7-218a-4c34-b408-108f8c541323 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:59.492918 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd69d7-218a-4c34-b408-108f8c541323 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:59.493309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd69d7-218a-4c34-b408-108f8c541323 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:59.494137 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd69d7-218a-4c34-b408-108f8c541323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:59.495868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd69d7-218a-4c34-b408-108f8c541323 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:59.501136 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfcbc7-8910-47bb-b2cf-f009e45d7814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:59.502262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfcbc7-8910-47bb-b2cf-f009e45d7814 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:59.505555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfcbc7-8910-47bb-b2cf-f009e45d7814 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:59.505959 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfcbc7-8910-47bb-b2cf-f009e45d7814 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:59.506786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfcbc7-8910-47bb-b2cf-f009e45d7814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:59.508379 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 912/1834] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:59.512531 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd69d7-218a-4c34-b408-108f8c541323 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:59.512676 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfcbc7-8910-47bb-b2cf-f009e45d7814 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:59.526144 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd69d7-218a-4c34-b408-108f8c541323 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:59.531825 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c5247-3e41-4ff5-a048-a760dc1d39f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:59.532526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c5247-3e41-4ff5-a048-a760dc1d39f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:59.532816 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c5247-3e41-4ff5-a048-a760dc1d39f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:59.533094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c5247-3e41-4ff5-a048-a760dc1d39f7 admin admin] PATH_INFO: `/v3/projects/1b0bee5b728842f497538891a27bd6e8/users/4bf1c37e4191412d8873536edfbbe5e6/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:59.536114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c5247-3e41-4ff5-a048-a760dc1d39f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0bee5b728842f497538891a27bd6e8, user_id=4bf1c37e4191412d8873536edfbbe5e6, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:59.540006 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c5247-3e41-4ff5-a048-a760dc1d39f7 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:59.567306 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 913/1835] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:59 2022] PUT /identity/v3/projects/1b0bee5b728842f497538891a27bd6e8/users/4bf1c37e4191412d8873536edfbbe5e6/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:57:59.582163 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa58b4-be95-4ec0-83e2-457c5bd5a510 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:59.583116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa58b4-be95-4ec0-83e2-457c5bd5a510 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:59.583974 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa58b4-be95-4ec0-83e2-457c5bd5a510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:59.619196 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-50fa58b4-be95-4ec0-83e2-457c5bd5a510 None None] MFA Rules not processed for user `4bf1c37e4191412d8873536edfbbe5e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:59.620540 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-50fa58b4-be95-4ec0-83e2-457c5bd5a510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:59.625782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 923/1836] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:57:59 2022] POST /identity/v3/users => generated 283 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:57:59.632947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfcbc7-8910-47bb-b2cf-f009e45d7814 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:59.652192 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfcbc7-8910-47bb-b2cf-f009e45d7814 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:59.724386 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9f302-0623-439e-b2ea-8e60b60acc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:59.725464 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9f302-0623-439e-b2ea-8e60b60acc68 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:59.725827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9f302-0623-439e-b2ea-8e60b60acc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:59.726173 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9f302-0623-439e-b2ea-8e60b60acc68 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:59.727014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9f302-0623-439e-b2ea-8e60b60acc68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:59.728707 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9f302-0623-439e-b2ea-8e60b60acc68 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:59.736631 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 914/1837] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:57:59.743172 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 924/1838] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:57:59.748954 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa58b4-be95-4ec0-83e2-457c5bd5a510 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:59.754768 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9f302-0623-439e-b2ea-8e60b60acc68 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:59.756774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-b0e9f302-0623-439e-b2ea-8e60b60acc68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:59.758612 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa58b4-be95-4ec0-83e2-457c5bd5a510 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:59.763620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a28c6-e2eb-4981-ac17-1ad6b19a7522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:59.764238 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a28c6-e2eb-4981-ac17-1ad6b19a7522 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:59.764527 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a28c6-e2eb-4981-ac17-1ad6b19a7522 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:59.764809 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a28c6-e2eb-4981-ac17-1ad6b19a7522 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:59.765605 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a28c6-e2eb-4981-ac17-1ad6b19a7522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:59.767250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a28c6-e2eb-4981-ac17-1ad6b19a7522 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:59.778651 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 915/1839] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:57:59.782691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a28c6-e2eb-4981-ac17-1ad6b19a7522 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:59.792622 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a28c6-e2eb-4981-ac17-1ad6b19a7522 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:59.798023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0075d-7f4a-47ca-9643-ad78f227677c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:59.799448 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0075d-7f4a-47ca-9643-ad78f227677c admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:59.799448 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0075d-7f4a-47ca-9643-ad78f227677c admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:59.799448 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0075d-7f4a-47ca-9643-ad78f227677c admin admin] PATH_INFO: `/v3/projects/81a6569b3e4c425a80e8987b02b8a304/users/956c85d1e4d2444d9477bf1214562ba6/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:59.815575 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0075d-7f4a-47ca-9643-ad78f227677c admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a6569b3e4c425a80e8987b02b8a304, user_id=956c85d1e4d2444d9477bf1214562ba6, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:59.819183 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0075d-7f4a-47ca-9643-ad78f227677c admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:59.824088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9f302-0623-439e-b2ea-8e60b60acc68 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:59.828365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc503c5-5bf5-4e27-a2ba-6079c7d3b3bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:59.828680 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc503c5-5bf5-4e27-a2ba-6079c7d3b3bd service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:59.828976 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc503c5-5bf5-4e27-a2ba-6079c7d3b3bd service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:59.829317 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc503c5-5bf5-4e27-a2ba-6079c7d3b3bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:59.840135 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc503c5-5bf5-4e27-a2ba-6079c7d3b3bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:59.841914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc503c5-5bf5-4e27-a2ba-6079c7d3b3bd service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:59.852633 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 925/1840] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:57:59 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:57:59.853467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc503c5-5bf5-4e27-a2ba-6079c7d3b3bd service cinder] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:57:59.854768 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-5cc503c5-5bf5-4e27-a2ba-6079c7d3b3bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:57:59.870541 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc503c5-5bf5-4e27-a2ba-6079c7d3b3bd service cinder] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:57:59.885978 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfd2cf-40fa-42f2-82b4-816608c5e4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:57:59.886887 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfd2cf-40fa-42f2-82b4-816608c5e4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:59.887181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfd2cf-40fa-42f2-82b4-816608c5e4be admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:59.887468 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfd2cf-40fa-42f2-82b4-816608c5e4be admin admin] PATH_INFO: `/v3/projects/445e3391cc2044d1aaa39183e3d3ddcf` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:59.888692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfd2cf-40fa-42f2-82b4-816608c5e4be admin admin] RBAC: Authorizing `identity:delete_project(project_id=445e3391cc2044d1aaa39183e3d3ddcf)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:57:59.890685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfd2cf-40fa-42f2-82b4-816608c5e4be admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:57:59.908532 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 916/1841] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:57:59 2022] PUT /identity/v3/projects/81a6569b3e4c425a80e8987b02b8a304/users/956c85d1e4d2444d9477bf1214562ba6/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:57:59.917099 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4b355-43aa-42f0-86a5-df195178e697 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:57:59.917685 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4b355-43aa-42f0-86a5-df195178e697 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:57:59.918250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4b355-43aa-42f0-86a5-df195178e697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:57:59.948810 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-7af4b355-43aa-42f0-86a5-df195178e697 None None] MFA Rules not processed for user `956c85d1e4d2444d9477bf1214562ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:57:59.950103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-7af4b355-43aa-42f0-86a5-df195178e697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:00.021051 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 917/1842] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:57:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:58:00.021606 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4b355-43aa-42f0-86a5-df195178e697 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:00.022897 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-7af4b355-43aa-42f0-86a5-df195178e697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:00.052830 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f9dfd2cf-40fa-42f2-82b4-816608c5e4be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '445e3391cc2044d1aaa39183e3d3ddcf', 'request_id': 'req-f9dfd2cf-40fa-42f2-82b4-816608c5e4be'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:00.059411 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f9dfd2cf-40fa-42f2-82b4-816608c5e4be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '445e3391cc2044d1aaa39183e3d3ddcf', 'request_id': 'req-f9dfd2cf-40fa-42f2-82b4-816608c5e4be'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:00.066696 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f9dfd2cf-40fa-42f2-82b4-816608c5e4be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '445e3391cc2044d1aaa39183e3d3ddcf', 'request_id': 'req-f9dfd2cf-40fa-42f2-82b4-816608c5e4be'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:00.096460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4b355-43aa-42f0-86a5-df195178e697 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:00.101270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:00.129885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f9dfd2cf-40fa-42f2-82b4-816608c5e4be admin admin] The token cache is being invalidate because project 445e3391cc2044d1aaa39183e3d3ddcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:00.130312 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f9dfd2cf-40fa-42f2-82b4-816608c5e4be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:00.135640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f9dfd2cf-40fa-42f2-82b4-816608c5e4be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:00.137593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 926/1843] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:57:59 2022] DELETE /identity/v3/projects/445e3391cc2044d1aaa39183e3d3ddcf => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:00.138250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfd2cf-40fa-42f2-82b4-816608c5e4be admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:00.139850 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f9dfd2cf-40fa-42f2-82b4-816608c5e4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:00.158268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbf23a-5eff-43d6-9d8c-a139f2aa9e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:00.159182 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbf23a-5eff-43d6-9d8c-a139f2aa9e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:00.159534 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbf23a-5eff-43d6-9d8c-a139f2aa9e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:00.160434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbf23a-5eff-43d6-9d8c-a139f2aa9e77 admin admin] PATH_INFO: `/v3/users/9120d2563cfc462fa0a772798ddcb972` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:00.161701 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fbf23a-5eff-43d6-9d8c-a139f2aa9e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9120d2563cfc462fa0a772798ddcb972)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:00.163664 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fbf23a-5eff-43d6-9d8c-a139f2aa9e77 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:00.212426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfd2cf-40fa-42f2-82b4-816608c5e4be admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:00.217999 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eefd50-2ddc-4899-94a7-60dbb61df3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:00.218697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eefd50-2ddc-4899-94a7-60dbb61df3ce admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:00.218987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eefd50-2ddc-4899-94a7-60dbb61df3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:00.219271 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eefd50-2ddc-4899-94a7-60dbb61df3ce admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:00.219963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eefd50-2ddc-4899-94a7-60dbb61df3ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:00.222785 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eefd50-2ddc-4899-94a7-60dbb61df3ce admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:00.352738 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 927/1844] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:00 2022] POST /identity/v3/projects => generated 361 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:00.354077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fe396-d348-4011-b028-e291bdd122b4 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:00.354539 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fe396-d348-4011-b028-e291bdd122b4 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:00.354640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fe396-d348-4011-b028-e291bdd122b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:00.360002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-63fbf23a-5eff-43d6-9d8c-a139f2aa9e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9120d2563cfc462fa0a772798ddcb972'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:00.373013 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-63fbf23a-5eff-43d6-9d8c-a139f2aa9e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9120d2563cfc462fa0a772798ddcb972'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:00.373657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-0c9fe396-d348-4011-b028-e291bdd122b4 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:00.375022 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0c9fe396-d348-4011-b028-e291bdd122b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:00.435134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 928/1845] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:00.436107 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fe396-d348-4011-b028-e291bdd122b4 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:00.437445 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0c9fe396-d348-4011-b028-e291bdd122b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:00.468926 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-63fbf23a-5eff-43d6-9d8c-a139f2aa9e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9120d2563cfc462fa0a772798ddcb972'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:00.469683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-63fbf23a-5eff-43d6-9d8c-a139f2aa9e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9120d2563cfc462fa0a772798ddcb972'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:00.477631 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-63fbf23a-5eff-43d6-9d8c-a139f2aa9e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9120d2563cfc462fa0a772798ddcb972'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:00.487073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 918/1846] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:00 2022] DELETE /identity/v3/users/9120d2563cfc462fa0a772798ddcb972 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:00.488038 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbf23a-5eff-43d6-9d8c-a139f2aa9e77 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:00.489750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-63fbf23a-5eff-43d6-9d8c-a139f2aa9e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:00.526353 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fe396-d348-4011-b028-e291bdd122b4 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:00.563790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbf23a-5eff-43d6-9d8c-a139f2aa9e77 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:00.569229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c3e11-563c-4043-845f-43673198a33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:00.569858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c3e11-563c-4043-845f-43673198a33c admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:00.570216 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c3e11-563c-4043-845f-43673198a33c admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:00.570449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c3e11-563c-4043-845f-43673198a33c admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:00.571118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c3e11-563c-4043-845f-43673198a33c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:00.573037 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c3e11-563c-4043-845f-43673198a33c admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:00.585878 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9950f83-be3e-4c59-9696-7200514af16a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:00.586315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9950f83-be3e-4c59-9696-7200514af16a service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:00.586608 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9950f83-be3e-4c59-9696-7200514af16a service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:00.586893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9950f83-be3e-4c59-9696-7200514af16a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:00.588750 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e9950f83-be3e-4c59-9696-7200514af16a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:00.661741 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9950f83-be3e-4c59-9696-7200514af16a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:00.663262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9950f83-be3e-4c59-9696-7200514af16a service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:00.674383 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 929/1848] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:00.677293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096386c9-26da-4b67-a4d4-6d0b63d20d8a None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:00.677632 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096386c9-26da-4b67-a4d4-6d0b63d20d8a None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:00.677927 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096386c9-26da-4b67-a4d4-6d0b63d20d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:00.682734 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 919/1848] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:00 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:00.684183 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c256ec-1c7a-4795-803b-96c5356f2da6 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:00.684481 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c256ec-1c7a-4795-803b-96c5356f2da6 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:00.684768 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c256ec-1c7a-4795-803b-96c5356f2da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:00.705786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-096386c9-26da-4b67-a4d4-6d0b63d20d8a None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:00.707606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-096386c9-26da-4b67-a4d4-6d0b63d20d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:00.713674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-43c256ec-1c7a-4795-803b-96c5356f2da6 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:00.715868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-43c256ec-1c7a-4795-803b-96c5356f2da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:00.716581 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 930/1849] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:00.717497 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096386c9-26da-4b67-a4d4-6d0b63d20d8a None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:00.728191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096386c9-26da-4b67-a4d4-6d0b63d20d8a None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:00.733776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 920/1850] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:00.733946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ddc10-2c36-458f-85aa-c3964fef0d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:00.734832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ddc10-2c36-458f-85aa-c3964fef0d9d admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:00.735273 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ddc10-2c36-458f-85aa-c3964fef0d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:00.735398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c256ec-1c7a-4795-803b-96c5356f2da6 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:00.735938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ddc10-2c36-458f-85aa-c3964fef0d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:00.736871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ddc10-2c36-458f-85aa-c3964fef0d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:00.739096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ddc10-2c36-458f-85aa-c3964fef0d9d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:00.751545 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 931/1851] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:00.752606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ddc10-2c36-458f-85aa-c3964fef0d9d admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:00.756615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-6f0ddc10-2c36-458f-85aa-c3964fef0d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:00.762787 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c256ec-1c7a-4795-803b-96c5356f2da6 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:00.769350 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23aa8d-270b-48a6-8c2e-771fffd70a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:00.769956 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23aa8d-270b-48a6-8c2e-771fffd70a81 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:00.770305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23aa8d-270b-48a6-8c2e-771fffd70a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:00.770665 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23aa8d-270b-48a6-8c2e-771fffd70a81 admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:00.771781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23aa8d-270b-48a6-8c2e-771fffd70a81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:58:00.772070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23aa8d-270b-48a6-8c2e-771fffd70a81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:00.773935 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23aa8d-270b-48a6-8c2e-771fffd70a81 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:00.787722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 921/1852] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:58:00.788472 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23aa8d-270b-48a6-8c2e-771fffd70a81 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:00.801486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23aa8d-270b-48a6-8c2e-771fffd70a81 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:00.806448 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d766090-0013-4f7b-a82b-84aab98c8691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:00.807563 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d766090-0013-4f7b-a82b-84aab98c8691 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:00.807883 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d766090-0013-4f7b-a82b-84aab98c8691 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:00.813765 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d766090-0013-4f7b-a82b-84aab98c8691 admin admin] PATH_INFO: `/v3/projects/3d5387b90c1e43adaf67d7f59603ec46/users/bfe923c46e354697a1758a766a1ae98c/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:00.823686 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d766090-0013-4f7b-a82b-84aab98c8691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d5387b90c1e43adaf67d7f59603ec46, user_id=bfe923c46e354697a1758a766a1ae98c, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:00.826374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d766090-0013-4f7b-a82b-84aab98c8691 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:00.843799 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ddc10-2c36-458f-85aa-c3964fef0d9d admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:00.848035 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cd6fd-29dd-4b3e-bf30-58e575285a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:00.848689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cd6fd-29dd-4b3e-bf30-58e575285a7d service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:00.849003 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cd6fd-29dd-4b3e-bf30-58e575285a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:00.849311 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cd6fd-29dd-4b3e-bf30-58e575285a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:00.858723 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cd6fd-29dd-4b3e-bf30-58e575285a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:00.860166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cd6fd-29dd-4b3e-bf30-58e575285a7d service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:00.869856 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 932/1853] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:00.870636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cd6fd-29dd-4b3e-bf30-58e575285a7d service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:00.881394 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cd6fd-29dd-4b3e-bf30-58e575285a7d service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:00.886396 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3f9e2-b6e2-4efe-9edf-5bc0a3f15608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:00.887066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3f9e2-b6e2-4efe-9edf-5bc0a3f15608 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:00.887353 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3f9e2-b6e2-4efe-9edf-5bc0a3f15608 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:00.887637 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3f9e2-b6e2-4efe-9edf-5bc0a3f15608 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:00.888338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3f9e2-b6e2-4efe-9edf-5bc0a3f15608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:00.890391 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3f9e2-b6e2-4efe-9edf-5bc0a3f15608 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:00.962911 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:00.973526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 922/1854] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:00 2022] PUT /identity/v3/projects/3d5387b90c1e43adaf67d7f59603ec46/users/bfe923c46e354697a1758a766a1ae98c/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:00.987805 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d766090-0013-4f7b-a82b-84aab98c8691 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:01.013118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 933/1855] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:00 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:01.017093 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3f9e2-b6e2-4efe-9edf-5bc0a3f15608 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:01.064858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d766090-0013-4f7b-a82b-84aab98c8691 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:01.106374 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3f9e2-b6e2-4efe-9edf-5bc0a3f15608 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:01.111588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52730be-b573-4e14-af0a-4db623bcce9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:01.112707 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52730be-b573-4e14-af0a-4db623bcce9a admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:01.113140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52730be-b573-4e14-af0a-4db623bcce9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:01.113884 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52730be-b573-4e14-af0a-4db623bcce9a admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:01.114729 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52730be-b573-4e14-af0a-4db623bcce9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:01.116954 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52730be-b573-4e14-af0a-4db623bcce9a admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:01.151519 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d9dc6-d07b-4e3c-97bf-c0a263df697d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:01.152327 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d9dc6-d07b-4e3c-97bf-c0a263df697d admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:01.152680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d9dc6-d07b-4e3c-97bf-c0a263df697d admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:01.153074 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d9dc6-d07b-4e3c-97bf-c0a263df697d admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:01.154814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d9dc6-d07b-4e3c-97bf-c0a263df697d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:01.156673 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d9dc6-d07b-4e3c-97bf-c0a263df697d admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:01.169421 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 923/1856] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:01.179175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d9dc6-d07b-4e3c-97bf-c0a263df697d admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:01.201096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d9dc6-d07b-4e3c-97bf-c0a263df697d admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:01.208458 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20372644-777c-4d4b-9f25-989e7da3dc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:01.209613 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20372644-777c-4d4b-9f25-989e7da3dc56 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:01.209892 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20372644-777c-4d4b-9f25-989e7da3dc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:01.210279 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20372644-777c-4d4b-9f25-989e7da3dc56 admin admin] PATH_INFO: `/v3/projects/3d5387b90c1e43adaf67d7f59603ec46/users/bfe923c46e354697a1758a766a1ae98c/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:01.212831 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20372644-777c-4d4b-9f25-989e7da3dc56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d5387b90c1e43adaf67d7f59603ec46, user_id=bfe923c46e354697a1758a766a1ae98c, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:01.216698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20372644-777c-4d4b-9f25-989e7da3dc56 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:01.240833 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 924/1857] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:01 2022] PUT /identity/v3/projects/3d5387b90c1e43adaf67d7f59603ec46/users/bfe923c46e354697a1758a766a1ae98c/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:01.240974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 934/1858] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:01 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:58:01.252600 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52730be-b573-4e14-af0a-4db623bcce9a admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:01.253112 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4614fe3-f589-4315-a4eb-a8cd2527487d None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:01.253973 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4614fe3-f589-4315-a4eb-a8cd2527487d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:01.254237 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4614fe3-f589-4315-a4eb-a8cd2527487d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:01.270311 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52730be-b573-4e14-af0a-4db623bcce9a admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:01.304409 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-c4614fe3-f589-4315-a4eb-a8cd2527487d None None] MFA Rules not processed for user `bfe923c46e354697a1758a766a1ae98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:01.306895 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-c4614fe3-f589-4315-a4eb-a8cd2527487d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:01.352224 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5fccc-3e1f-457a-86a8-2be04459e875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:01.353089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5fccc-3e1f-457a-86a8-2be04459e875 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:01.353788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5fccc-3e1f-457a-86a8-2be04459e875 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:01.354082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5fccc-3e1f-457a-86a8-2be04459e875 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:01.355124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5fccc-3e1f-457a-86a8-2be04459e875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:01.356813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5fccc-3e1f-457a-86a8-2be04459e875 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:01.378909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 935/1859] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:01.379874 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5fccc-3e1f-457a-86a8-2be04459e875 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:01.390541 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5fccc-3e1f-457a-86a8-2be04459e875 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:01.395296 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdec423-9927-43c9-a1b4-f91d2d6badb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:01.395962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdec423-9927-43c9-a1b4-f91d2d6badb6 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:01.396250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdec423-9927-43c9-a1b4-f91d2d6badb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:01.396532 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdec423-9927-43c9-a1b4-f91d2d6badb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:01.397308 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdec423-9927-43c9-a1b4-f91d2d6badb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:01.398680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 925/1860] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:01 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:01.399164 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdec423-9927-43c9-a1b4-f91d2d6badb6 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:01.410683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 936/1861] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:01.411332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4614fe3-f589-4315-a4eb-a8cd2527487d None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:01.412694 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-c4614fe3-f589-4315-a4eb-a8cd2527487d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:01.414742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdec423-9927-43c9-a1b4-f91d2d6badb6 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:01.424503 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdec423-9927-43c9-a1b4-f91d2d6badb6 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:01.429823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a535eac-ff80-4a2a-a673-347612c60afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:01.430773 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a535eac-ff80-4a2a-a673-347612c60afa admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:01.431062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a535eac-ff80-4a2a-a673-347612c60afa admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:01.431346 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a535eac-ff80-4a2a-a673-347612c60afa admin admin] PATH_INFO: `/v3/projects/adbf8fec90a347cf96eb6aa36b987063/users/517ba9b2511a4992b77d3c77280e9903/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:01.446522 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a535eac-ff80-4a2a-a673-347612c60afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=adbf8fec90a347cf96eb6aa36b987063, user_id=517ba9b2511a4992b77d3c77280e9903, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:01.449291 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a535eac-ff80-4a2a-a673-347612c60afa admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:01.469378 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4614fe3-f589-4315-a4eb-a8cd2527487d None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:01.473774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea429bc-b663-4e72-b0ad-7102a4876af3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:01.474423 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea429bc-b663-4e72-b0ad-7102a4876af3 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:01.474713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea429bc-b663-4e72-b0ad-7102a4876af3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:01.474994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea429bc-b663-4e72-b0ad-7102a4876af3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:01.484100 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea429bc-b663-4e72-b0ad-7102a4876af3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:01.485652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea429bc-b663-4e72-b0ad-7102a4876af3 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:01.496106 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 926/1862] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:01 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:58:01.541467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea429bc-b663-4e72-b0ad-7102a4876af3 service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:01.543112 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-5ea429bc-b663-4e72-b0ad-7102a4876af3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:01.558445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea429bc-b663-4e72-b0ad-7102a4876af3 service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:01.563452 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd016c-a826-4715-b72e-f7edfeeb90bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:01.564543 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd016c-a826-4715-b72e-f7edfeeb90bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:01.564793 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd016c-a826-4715-b72e-f7edfeeb90bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:01.565077 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd016c-a826-4715-b72e-f7edfeeb90bc admin admin] PATH_INFO: `/v3/projects/344daaaba3dc447dbb642f4b206b4973` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:01.566984 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd016c-a826-4715-b72e-f7edfeeb90bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=344daaaba3dc447dbb642f4b206b4973)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:01.568862 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd016c-a826-4715-b72e-f7edfeeb90bc admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:01.577398 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 937/1863] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:01 2022] PUT /identity/v3/projects/adbf8fec90a347cf96eb6aa36b987063/users/517ba9b2511a4992b77d3c77280e9903/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:58:01.589467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cbace-f530-4b93-932d-e088bc12c7f9 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:01.589774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cbace-f530-4b93-932d-e088bc12c7f9 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:01.590068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cbace-f530-4b93-932d-e088bc12c7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:01.622618 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-b88cbace-f530-4b93-932d-e088bc12c7f9 None None] MFA Rules not processed for user `517ba9b2511a4992b77d3c77280e9903`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:01.623978 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-b88cbace-f530-4b93-932d-e088bc12c7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:01.732812 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 938/1864] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:58:01.737250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cbace-f530-4b93-932d-e088bc12c7f9 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:01.794381 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6dcd016c-a826-4715-b72e-f7edfeeb90bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '344daaaba3dc447dbb642f4b206b4973', 'request_id': 'req-6dcd016c-a826-4715-b72e-f7edfeeb90bc'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:01.803948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6dcd016c-a826-4715-b72e-f7edfeeb90bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '344daaaba3dc447dbb642f4b206b4973', 'request_id': 'req-6dcd016c-a826-4715-b72e-f7edfeeb90bc'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:01.833217 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6dcd016c-a826-4715-b72e-f7edfeeb90bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '344daaaba3dc447dbb642f4b206b4973', 'request_id': 'req-6dcd016c-a826-4715-b72e-f7edfeeb90bc'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:01.858333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cbace-f530-4b93-932d-e088bc12c7f9 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:01.935828 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e59d0-df64-4146-9161-d7c0ccb004fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:01.936503 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e59d0-df64-4146-9161-d7c0ccb004fa admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:01.945671 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e59d0-df64-4146-9161-d7c0ccb004fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:01.945671 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e59d0-df64-4146-9161-d7c0ccb004fa admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:01.945671 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e59d0-df64-4146-9161-d7c0ccb004fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:01.945671 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e59d0-df64-4146-9161-d7c0ccb004fa admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:01.983813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6dcd016c-a826-4715-b72e-f7edfeeb90bc admin admin] The token cache is being invalidate because project 344daaaba3dc447dbb642f4b206b4973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:01.984247 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6dcd016c-a826-4715-b72e-f7edfeeb90bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:01.985085 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6dcd016c-a826-4715-b72e-f7edfeeb90bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:01.990571 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 927/1865] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:01 2022] DELETE /identity/v3/projects/344daaaba3dc447dbb642f4b206b4973 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:58:01.990571 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd016c-a826-4715-b72e-f7edfeeb90bc admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:01.994761 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-6dcd016c-a826-4715-b72e-f7edfeeb90bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:02.059252 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd016c-a826-4715-b72e-f7edfeeb90bc admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:02.062379 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f86c4-d3c3-4644-b57b-0dfd12b033c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:02.063035 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f86c4-d3c3-4644-b57b-0dfd12b033c5 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:02.063329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f86c4-d3c3-4644-b57b-0dfd12b033c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:02.063612 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f86c4-d3c3-4644-b57b-0dfd12b033c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:02.065657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-9c2f86c4-d3c3-4644-b57b-0dfd12b033c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:02.109756 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 939/1866] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:01 2022] POST /identity/v3/projects => generated 377 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:58:02.109756 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e59d0-df64-4146-9161-d7c0ccb004fa admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:02.111085 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f45e59d0-df64-4146-9161-d7c0ccb004fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:02.136800 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f86c4-d3c3-4644-b57b-0dfd12b033c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:02.138808 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f86c4-d3c3-4644-b57b-0dfd12b033c5 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:02.149146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 928/1867] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:02.149962 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f86c4-d3c3-4644-b57b-0dfd12b033c5 service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:02.151686 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-9c2f86c4-d3c3-4644-b57b-0dfd12b033c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:02.167961 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f86c4-d3c3-4644-b57b-0dfd12b033c5 service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:02.183417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e59d0-df64-4146-9161-d7c0ccb004fa admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:02.198871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c39523-8993-468b-b248-2cea9126bb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:02.200420 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c39523-8993-468b-b248-2cea9126bb74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:02.200922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c39523-8993-468b-b248-2cea9126bb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:02.201315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c39523-8993-468b-b248-2cea9126bb74 admin admin] PATH_INFO: `/v3/users/5b96f749bafe4e2c97b88a323f4aa21b` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:02.203349 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c39523-8993-468b-b248-2cea9126bb74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b96f749bafe4e2c97b88a323f4aa21b)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:02.205394 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c39523-8993-468b-b248-2cea9126bb74 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:02.240307 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d66e7-f33e-48ab-b80e-a52ae3918dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:02.241002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d66e7-f33e-48ab-b80e-a52ae3918dcc admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:02.241324 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d66e7-f33e-48ab-b80e-a52ae3918dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:02.241636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d66e7-f33e-48ab-b80e-a52ae3918dcc admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:02.242346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d66e7-f33e-48ab-b80e-a52ae3918dcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:02.244312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d66e7-f33e-48ab-b80e-a52ae3918dcc admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:02.377714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 929/1868] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:02 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:02.379289 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d66e7-f33e-48ab-b80e-a52ae3918dcc admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:02.381061 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-769d66e7-f33e-48ab-b80e-a52ae3918dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:02.393131 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d66e7-f33e-48ab-b80e-a52ae3918dcc admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:02.398984 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf0771-7533-4070-ac93-fce982ac048c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:02.400587 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf0771-7533-4070-ac93-fce982ac048c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:02.404979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf0771-7533-4070-ac93-fce982ac048c admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:02.404979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf0771-7533-4070-ac93-fce982ac048c admin admin] PATH_INFO: `/v3/users/1109c2a87f694995ba83d7392df4e9f2` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:02.404979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf0771-7533-4070-ac93-fce982ac048c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1109c2a87f694995ba83d7392df4e9f2)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:02.404979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf0771-7533-4070-ac93-fce982ac048c admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:02.507003 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d7c39523-8993-468b-b248-2cea9126bb74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b96f749bafe4e2c97b88a323f4aa21b'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:02.525965 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d7c39523-8993-468b-b248-2cea9126bb74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b96f749bafe4e2c97b88a323f4aa21b'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:02.621401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d7c39523-8993-468b-b248-2cea9126bb74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b96f749bafe4e2c97b88a323f4aa21b'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:02.621951 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d7c39523-8993-468b-b248-2cea9126bb74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b96f749bafe4e2c97b88a323f4aa21b'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:02.629467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d7c39523-8993-468b-b248-2cea9126bb74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b96f749bafe4e2c97b88a323f4aa21b'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:02.635231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 940/1869] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:02 2022] DELETE /identity/v3/users/5b96f749bafe4e2c97b88a323f4aa21b => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:02.636078 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c39523-8993-468b-b248-2cea9126bb74 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:02.637542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d7c39523-8993-468b-b248-2cea9126bb74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:02.671819 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9bbf0771-7533-4070-ac93-fce982ac048c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1109c2a87f694995ba83d7392df4e9f2'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:02.686815 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9bbf0771-7533-4070-ac93-fce982ac048c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1109c2a87f694995ba83d7392df4e9f2'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:02.710683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c39523-8993-468b-b248-2cea9126bb74 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:02.715341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25915e7-4e29-4ad8-a65f-c41d31029df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:02.716009 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25915e7-4e29-4ad8-a65f-c41d31029df7 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:02.716550 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25915e7-4e29-4ad8-a65f-c41d31029df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:02.716829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25915e7-4e29-4ad8-a65f-c41d31029df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:02.717585 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25915e7-4e29-4ad8-a65f-c41d31029df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:02.719201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25915e7-4e29-4ad8-a65f-c41d31029df7 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:02.730015 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 941/1870] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:02.734630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25915e7-4e29-4ad8-a65f-c41d31029df7 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:02.745751 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25915e7-4e29-4ad8-a65f-c41d31029df7 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:02.750514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5def5-0575-44d1-8b93-e6e6b9263ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:02.751190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5def5-0575-44d1-8b93-e6e6b9263ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:02.751482 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5def5-0575-44d1-8b93-e6e6b9263ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:02.751788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5def5-0575-44d1-8b93-e6e6b9263ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:02.752517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5def5-0575-44d1-8b93-e6e6b9263ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:02.754489 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5def5-0575-44d1-8b93-e6e6b9263ad8 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:02.764475 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 942/1871] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:58:02.774788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5def5-0575-44d1-8b93-e6e6b9263ad8 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:02.784369 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5def5-0575-44d1-8b93-e6e6b9263ad8 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:02.789763 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73070806-e842-43f2-93ec-0361b00128d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:02.790643 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73070806-e842-43f2-93ec-0361b00128d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:02.790933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73070806-e842-43f2-93ec-0361b00128d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:02.791216 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73070806-e842-43f2-93ec-0361b00128d5 admin admin] PATH_INFO: `/v3/projects/7bf8e901451749068474acac3ea660c4/users/961d9a08d9dd4582a41f8f6fd7ec7fda/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:02.801698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9bbf0771-7533-4070-ac93-fce982ac048c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1109c2a87f694995ba83d7392df4e9f2'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:02.802507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9bbf0771-7533-4070-ac93-fce982ac048c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1109c2a87f694995ba83d7392df4e9f2'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:02.807703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73070806-e842-43f2-93ec-0361b00128d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf8e901451749068474acac3ea660c4, user_id=961d9a08d9dd4582a41f8f6fd7ec7fda, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:02.810388 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9bbf0771-7533-4070-ac93-fce982ac048c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1109c2a87f694995ba83d7392df4e9f2'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:02.810527 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73070806-e842-43f2-93ec-0361b00128d5 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:02.817186 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 930/1872] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:02 2022] DELETE /identity/v3/users/1109c2a87f694995ba83d7392df4e9f2 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:02.821845 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f1da2-9cc5-497a-9a86-72ad12b582a3 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:02.822235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f1da2-9cc5-497a-9a86-72ad12b582a3 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:02.822611 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f1da2-9cc5-497a-9a86-72ad12b582a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:02.839439 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-8e2f1da2-9cc5-497a-9a86-72ad12b582a3 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:02.840713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-8e2f1da2-9cc5-497a-9a86-72ad12b582a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:02.903551 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 943/1873] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:02 2022] PUT /identity/v3/projects/7bf8e901451749068474acac3ea660c4/users/961d9a08d9dd4582a41f8f6fd7ec7fda/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:58:02.915566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 931/1874] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:02.916161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9eacd-4826-4d63-93c5-83eb53b2f7e9 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:02.916460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9eacd-4826-4d63-93c5-83eb53b2f7e9 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:02.916746 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9eacd-4826-4d63-93c5-83eb53b2f7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:02.924022 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f1da2-9cc5-497a-9a86-72ad12b582a3 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:02.927559 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-8e2f1da2-9cc5-497a-9a86-72ad12b582a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:02.949528 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-caa9eacd-4826-4d63-93c5-83eb53b2f7e9 None None] MFA Rules not processed for user `961d9a08d9dd4582a41f8f6fd7ec7fda`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:02.950917 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-caa9eacd-4826-4d63-93c5-83eb53b2f7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:03.059782 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f1da2-9cc5-497a-9a86-72ad12b582a3 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:03.066121 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 944/1875] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:03.070876 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9eacd-4826-4d63-93c5-83eb53b2f7e9 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:03.072374 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-caa9eacd-4826-4d63-93c5-83eb53b2f7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:03.143469 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc139a-9b64-45a7-a4ef-538dad6c2718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:03.146239 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc139a-9b64-45a7-a4ef-538dad6c2718 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:03.146554 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc139a-9b64-45a7-a4ef-538dad6c2718 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:03.146818 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc139a-9b64-45a7-a4ef-538dad6c2718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:03.162688 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc139a-9b64-45a7-a4ef-538dad6c2718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:03.164165 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc139a-9b64-45a7-a4ef-538dad6c2718 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:03.189620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 932/1876] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:58:03.192112 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc139a-9b64-45a7-a4ef-538dad6c2718 service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:03.194925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-86bc139a-9b64-45a7-a4ef-538dad6c2718 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:03.208246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9eacd-4826-4d63-93c5-83eb53b2f7e9 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:03.225539 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7072db-dc11-4433-803c-7995c4dafd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:03.226579 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc139a-9b64-45a7-a4ef-538dad6c2718 service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:03.229854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7072db-dc11-4433-803c-7995c4dafd32 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:03.229854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7072db-dc11-4433-803c-7995c4dafd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:03.230050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7072db-dc11-4433-803c-7995c4dafd32 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:03.233062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7072db-dc11-4433-803c-7995c4dafd32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:03.238244 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453de31-d810-4e3f-a5c2-41bd9c967c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:03.240147 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453de31-d810-4e3f-a5c2-41bd9c967c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:03.240678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453de31-d810-4e3f-a5c2-41bd9c967c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:03.241064 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7072db-dc11-4433-803c-7995c4dafd32 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:03.241613 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453de31-d810-4e3f-a5c2-41bd9c967c3b admin admin] PATH_INFO: `/v3/projects/59991fbead804873994cf5bbfb2c8875` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:03.243337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453de31-d810-4e3f-a5c2-41bd9c967c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=59991fbead804873994cf5bbfb2c8875)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:03.245857 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453de31-d810-4e3f-a5c2-41bd9c967c3b admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:03.284536 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:03.386343 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 945/1877] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:03 2022] POST /identity/v3/projects => generated 377 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:58:03.390085 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7072db-dc11-4433-803c-7995c4dafd32 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:03.436709 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b453de31-d810-4e3f-a5c2-41bd9c967c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59991fbead804873994cf5bbfb2c8875', 'request_id': 'req-b453de31-d810-4e3f-a5c2-41bd9c967c3b'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:03.444486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b453de31-d810-4e3f-a5c2-41bd9c967c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59991fbead804873994cf5bbfb2c8875', 'request_id': 'req-b453de31-d810-4e3f-a5c2-41bd9c967c3b'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:03.450928 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b453de31-d810-4e3f-a5c2-41bd9c967c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59991fbead804873994cf5bbfb2c8875', 'request_id': 'req-b453de31-d810-4e3f-a5c2-41bd9c967c3b'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:03.477790 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7072db-dc11-4433-803c-7995c4dafd32 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:03.546483 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cc373-5488-437a-bc75-845b7338776e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:03.547351 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cc373-5488-437a-bc75-845b7338776e admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:03.547646 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cc373-5488-437a-bc75-845b7338776e admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:03.547933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cc373-5488-437a-bc75-845b7338776e admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:03.548638 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cc373-5488-437a-bc75-845b7338776e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:03.550710 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cc373-5488-437a-bc75-845b7338776e admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:03.574832 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b453de31-d810-4e3f-a5c2-41bd9c967c3b admin admin] The token cache is being invalidate because project 59991fbead804873994cf5bbfb2c8875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:03.575300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b453de31-d810-4e3f-a5c2-41bd9c967c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:03.576049 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b453de31-d810-4e3f-a5c2-41bd9c967c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:03.577746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 933/1878] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:03 2022] DELETE /identity/v3/projects/59991fbead804873994cf5bbfb2c8875 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:03.583775 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580835e-6a1c-4c0c-ba9a-91db9dd7873c None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:03.584146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580835e-6a1c-4c0c-ba9a-91db9dd7873c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:03.584492 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580835e-6a1c-4c0c-ba9a-91db9dd7873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:03.604052 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-9580835e-6a1c-4c0c-ba9a-91db9dd7873c None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:03.605413 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-9580835e-6a1c-4c0c-ba9a-91db9dd7873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:03.615410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 934/1879] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:03.625994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee47476-a1fa-4983-b23f-611246915636 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:03.626417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee47476-a1fa-4983-b23f-611246915636 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:03.627776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee47476-a1fa-4983-b23f-611246915636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:03.652245 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-cee47476-a1fa-4983-b23f-611246915636 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:03.653583 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-cee47476-a1fa-4983-b23f-611246915636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:03.657788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 946/1880] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:03 2022] POST /identity/v3/users => generated 295 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:58:03.661749 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cc373-5488-437a-bc75-845b7338776e admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:03.665965 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-824cc373-5488-437a-bc75-845b7338776e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:03.678768 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cc373-5488-437a-bc75-845b7338776e admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:03.680104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 935/1881] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:03.684385 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee47476-a1fa-4983-b23f-611246915636 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:03.687419 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff4ded-ed7f-4945-b2c9-421e1af63fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:03.688131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff4ded-ed7f-4945-b2c9-421e1af63fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:03.688431 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff4ded-ed7f-4945-b2c9-421e1af63fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:03.688719 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff4ded-ed7f-4945-b2c9-421e1af63fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:03.689979 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff4ded-ed7f-4945-b2c9-421e1af63fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:03.692049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff4ded-ed7f-4945-b2c9-421e1af63fd1 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:03.696594 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee47476-a1fa-4983-b23f-611246915636 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:03.702498 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd4d4d-ce3d-4b90-8337-8abdf5e23f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:03.703413 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd4d4d-ce3d-4b90-8337-8abdf5e23f66 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:03.703933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 947/1882] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:03.704073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd4d4d-ce3d-4b90-8337-8abdf5e23f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:03.705560 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd4d4d-ce3d-4b90-8337-8abdf5e23f66 admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:03.707245 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd4d4d-ce3d-4b90-8337-8abdf5e23f66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:58:03.708033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd4d4d-ce3d-4b90-8337-8abdf5e23f66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:03.708527 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff4ded-ed7f-4945-b2c9-421e1af63fd1 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:03.710151 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd4d4d-ce3d-4b90-8337-8abdf5e23f66 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:03.719937 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff4ded-ed7f-4945-b2c9-421e1af63fd1 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:03.724833 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 936/1883] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:58:03.728871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af87714-96c0-458a-b002-8f1451fd7fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:03.728871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af87714-96c0-458a-b002-8f1451fd7fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:03.728871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af87714-96c0-458a-b002-8f1451fd7fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:03.728871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af87714-96c0-458a-b002-8f1451fd7fc7 admin admin] PATH_INFO: `/v3/projects/0e3f3c718c0a49b7b6a18d992054bc1c/users/da9310f8105f4d378dd71b18f3f86f90/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:03.732024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd4d4d-ce3d-4b90-8337-8abdf5e23f66 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:03.742794 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd4d4d-ce3d-4b90-8337-8abdf5e23f66 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:03.747544 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f2da9-8d18-4d0d-bfb0-e487df1d9a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:03.748204 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f2da9-8d18-4d0d-bfb0-e487df1d9a0a admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:03.748490 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f2da9-8d18-4d0d-bfb0-e487df1d9a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:03.748772 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f2da9-8d18-4d0d-bfb0-e487df1d9a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:03.749512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f2da9-8d18-4d0d-bfb0-e487df1d9a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:03.751430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f2da9-8d18-4d0d-bfb0-e487df1d9a0a admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:03.751534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af87714-96c0-458a-b002-8f1451fd7fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3f3c718c0a49b7b6a18d992054bc1c, user_id=da9310f8105f4d378dd71b18f3f86f90, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:03.754519 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af87714-96c0-458a-b002-8f1451fd7fc7 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:03.886539 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 948/1884] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:03 2022] PUT /identity/v3/projects/0e3f3c718c0a49b7b6a18d992054bc1c/users/da9310f8105f4d378dd71b18f3f86f90/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:58:03.887742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af87714-96c0-458a-b002-8f1451fd7fc7 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:03.889364 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-5af87714-96c0-458a-b002-8f1451fd7fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:03.894582 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 937/1885] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:03 2022] POST /identity/v3/projects => generated 407 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:58:03.894582 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f2da9-8d18-4d0d-bfb0-e487df1d9a0a admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:03.961633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f2da9-8d18-4d0d-bfb0-e487df1d9a0a admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:03.971068 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e49e1-8a5b-4abd-8c6c-4a6a42e51afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:03.973211 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e49e1-8a5b-4abd-8c6c-4a6a42e51afd admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:03.973612 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e49e1-8a5b-4abd-8c6c-4a6a42e51afd admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:03.973972 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e49e1-8a5b-4abd-8c6c-4a6a42e51afd admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:03.974811 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e49e1-8a5b-4abd-8c6c-4a6a42e51afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:03.977029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e49e1-8a5b-4abd-8c6c-4a6a42e51afd admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:03.992628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 938/1886] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:03.992628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e49e1-8a5b-4abd-8c6c-4a6a42e51afd admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:04.004998 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e49e1-8a5b-4abd-8c6c-4a6a42e51afd admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:04.009879 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec1115-efa8-4e21-b27c-52d786ef50f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:04.010578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec1115-efa8-4e21-b27c-52d786ef50f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:04.010869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec1115-efa8-4e21-b27c-52d786ef50f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:04.011151 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec1115-efa8-4e21-b27c-52d786ef50f4 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:04.011856 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec1115-efa8-4e21-b27c-52d786ef50f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:04.013855 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec1115-efa8-4e21-b27c-52d786ef50f4 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:04.085569 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af87714-96c0-458a-b002-8f1451fd7fc7 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:04.098197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193724eb-b0a2-467a-86ee-14d29302cae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:04.098197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193724eb-b0a2-467a-86ee-14d29302cae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:04.098197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193724eb-b0a2-467a-86ee-14d29302cae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:04.098197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193724eb-b0a2-467a-86ee-14d29302cae3 admin admin] PATH_INFO: `/v3/projects/ba3fa9ccaedf4d11939afae1acfc9117` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:04.100169 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193724eb-b0a2-467a-86ee-14d29302cae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3fa9ccaedf4d11939afae1acfc9117)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:04.103437 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193724eb-b0a2-467a-86ee-14d29302cae3 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:04.137071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 939/1887] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:03 2022] POST /identity/v3/users => generated 304 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:04.137071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec1115-efa8-4e21-b27c-52d786ef50f4 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:04.153146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec1115-efa8-4e21-b27c-52d786ef50f4 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:04.158547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272055f6-641b-4b28-a8e1-2d9400899f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:04.160140 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272055f6-641b-4b28-a8e1-2d9400899f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:04.160579 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272055f6-641b-4b28-a8e1-2d9400899f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:04.166662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272055f6-641b-4b28-a8e1-2d9400899f9f admin admin] PATH_INFO: `/v3/projects/0e3f3c718c0a49b7b6a18d992054bc1c/users/da9310f8105f4d378dd71b18f3f86f90/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:04.166662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272055f6-641b-4b28-a8e1-2d9400899f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3f3c718c0a49b7b6a18d992054bc1c, user_id=da9310f8105f4d378dd71b18f3f86f90, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:04.166662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272055f6-641b-4b28-a8e1-2d9400899f9f admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:04.178014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 940/1888] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:04 2022] PUT /identity/v3/projects/0e3f3c718c0a49b7b6a18d992054bc1c/users/da9310f8105f4d378dd71b18f3f86f90/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:04.178825 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272055f6-641b-4b28-a8e1-2d9400899f9f admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:04.219139 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:04.242479 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272055f6-641b-4b28-a8e1-2d9400899f9f admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:04.248004 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6148ce-31cc-4fa7-91fe-e16a8e82ab46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:04.248692 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6148ce-31cc-4fa7-91fe-e16a8e82ab46 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:04.249015 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6148ce-31cc-4fa7-91fe-e16a8e82ab46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:04.249334 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6148ce-31cc-4fa7-91fe-e16a8e82ab46 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:04.251057 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6148ce-31cc-4fa7-91fe-e16a8e82ab46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:04.257144 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6148ce-31cc-4fa7-91fe-e16a8e82ab46 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:04.275791 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 941/1889] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:04.276192 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-193724eb-b0a2-467a-86ee-14d29302cae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3fa9ccaedf4d11939afae1acfc9117', 'request_id': 'req-193724eb-b0a2-467a-86ee-14d29302cae3'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:04.278651 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e410fd-e207-43da-a317-7b4963694cf7 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:04.280722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-193724eb-b0a2-467a-86ee-14d29302cae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3fa9ccaedf4d11939afae1acfc9117', 'request_id': 'req-193724eb-b0a2-467a-86ee-14d29302cae3'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:04.281218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e410fd-e207-43da-a317-7b4963694cf7 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:04.282386 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e410fd-e207-43da-a317-7b4963694cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:04.287412 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-193724eb-b0a2-467a-86ee-14d29302cae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3fa9ccaedf4d11939afae1acfc9117', 'request_id': 'req-193724eb-b0a2-467a-86ee-14d29302cae3'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:04.324976 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-90e410fd-e207-43da-a317-7b4963694cf7 None None] MFA Rules not processed for user `da9310f8105f4d378dd71b18f3f86f90`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:04.326315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-90e410fd-e207-43da-a317-7b4963694cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:04.406833 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-193724eb-b0a2-467a-86ee-14d29302cae3 admin admin] The token cache is being invalidate because project ba3fa9ccaedf4d11939afae1acfc9117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:04.407204 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-193724eb-b0a2-467a-86ee-14d29302cae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:04.407879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-193724eb-b0a2-467a-86ee-14d29302cae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:04.413397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 949/1890] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:03 2022] DELETE /identity/v3/projects/ba3fa9ccaedf4d11939afae1acfc9117 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:04.413397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193724eb-b0a2-467a-86ee-14d29302cae3 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:04.413397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-193724eb-b0a2-467a-86ee-14d29302cae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:04.441468 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 942/1891] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:04.446792 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e410fd-e207-43da-a317-7b4963694cf7 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:04.453426 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-90e410fd-e207-43da-a317-7b4963694cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:04.527960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193724eb-b0a2-467a-86ee-14d29302cae3 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:04.533672 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa2e48-564d-4bc1-b124-f134518b8064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:04.534752 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa2e48-564d-4bc1-b124-f134518b8064 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:04.539283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa2e48-564d-4bc1-b124-f134518b8064 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:04.539283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa2e48-564d-4bc1-b124-f134518b8064 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:04.539283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa2e48-564d-4bc1-b124-f134518b8064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:04.539283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa2e48-564d-4bc1-b124-f134518b8064 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:04.540030 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e410fd-e207-43da-a317-7b4963694cf7 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:04.547658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48360bfc-f3cd-4666-91c7-fbf2c79653fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:04.548997 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48360bfc-f3cd-4666-91c7-fbf2c79653fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:04.549494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48360bfc-f3cd-4666-91c7-fbf2c79653fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:04.549874 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48360bfc-f3cd-4666-91c7-fbf2c79653fd admin admin] PATH_INFO: `/v3/users/09fdddbd093e4435912d48f33c2d4cf1` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:04.551858 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 950/1892] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:04.552419 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48360bfc-f3cd-4666-91c7-fbf2c79653fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=09fdddbd093e4435912d48f33c2d4cf1)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:04.554403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48360bfc-f3cd-4666-91c7-fbf2c79653fd admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:04.568489 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa2e48-564d-4bc1-b124-f134518b8064 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:04.589024 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa2e48-564d-4bc1-b124-f134518b8064 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:04.601435 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edc2e9-9020-4d19-9754-a0376a4b2c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:04.602871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edc2e9-9020-4d19-9754-a0376a4b2c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:04.603311 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edc2e9-9020-4d19-9754-a0376a4b2c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:04.603744 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edc2e9-9020-4d19-9754-a0376a4b2c7f admin admin] PATH_INFO: `/v3/projects/eb8cee8035254181915e88fed9322b46/users/aac9b12ddb9c4c8bb83e01005eb5b48d/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:04.625292 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edc2e9-9020-4d19-9754-a0376a4b2c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb8cee8035254181915e88fed9322b46, user_id=aac9b12ddb9c4c8bb83e01005eb5b48d, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:04.630982 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edc2e9-9020-4d19-9754-a0376a4b2c7f admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:04.707199 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 951/1893] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:04 2022] PUT /identity/v3/projects/eb8cee8035254181915e88fed9322b46/users/aac9b12ddb9c4c8bb83e01005eb5b48d/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:04.708439 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edc2e9-9020-4d19-9754-a0376a4b2c7f admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:04.710194 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-21edc2e9-9020-4d19-9754-a0376a4b2c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:04.770793 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edc2e9-9020-4d19-9754-a0376a4b2c7f admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:04.775768 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560853ce-6b6d-4145-91af-ff4723fe3599 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:04.777775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560853ce-6b6d-4145-91af-ff4723fe3599 service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:04.778213 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560853ce-6b6d-4145-91af-ff4723fe3599 service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:04.779797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560853ce-6b6d-4145-91af-ff4723fe3599 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:04.823456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-48360bfc-f3cd-4666-91c7-fbf2c79653fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09fdddbd093e4435912d48f33c2d4cf1'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:04.843740 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-48360bfc-f3cd-4666-91c7-fbf2c79653fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09fdddbd093e4435912d48f33c2d4cf1'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:04.872377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560853ce-6b6d-4145-91af-ff4723fe3599 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:04.874080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560853ce-6b6d-4145-91af-ff4723fe3599 service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:04.888025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 952/1894] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:04.889504 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f264aa-145d-476a-955c-9cff8e26f897 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:04.889933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f264aa-145d-476a-955c-9cff8e26f897 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:04.891866 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f264aa-145d-476a-955c-9cff8e26f897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:04.922718 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-f1f264aa-145d-476a-955c-9cff8e26f897 None None] MFA Rules not processed for user `aac9b12ddb9c4c8bb83e01005eb5b48d`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:04.923925 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f1f264aa-145d-476a-955c-9cff8e26f897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:04.948724 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-48360bfc-f3cd-4666-91c7-fbf2c79653fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09fdddbd093e4435912d48f33c2d4cf1'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:04.949925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-48360bfc-f3cd-4666-91c7-fbf2c79653fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09fdddbd093e4435912d48f33c2d4cf1'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:04.968404 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-48360bfc-f3cd-4666-91c7-fbf2c79653fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09fdddbd093e4435912d48f33c2d4cf1'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:04.994856 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 943/1895] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:04 2022] DELETE /identity/v3/users/09fdddbd093e4435912d48f33c2d4cf1 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:04.996819 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b33f9-e274-473d-9b23-acedc75d201a None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:04.997118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b33f9-e274-473d-9b23-acedc75d201a None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:04.997436 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b33f9-e274-473d-9b23-acedc75d201a None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:04.998836 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 944/1896] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 19:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:58:05.006304 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b33f9-e274-473d-9b23-acedc75d201a None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:05.011569 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-5d5b33f9-e274-473d-9b23-acedc75d201a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:05.011657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 953/1897] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:04 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:05.016397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f264aa-145d-476a-955c-9cff8e26f897 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:05.017828 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f1f264aa-145d-476a-955c-9cff8e26f897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:05.112385 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b33f9-e274-473d-9b23-acedc75d201a None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:05.117748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1a644-5854-4049-81c7-d23507b39297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:05.118423 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1a644-5854-4049-81c7-d23507b39297 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:05.118708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1a644-5854-4049-81c7-d23507b39297 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:05.118995 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1a644-5854-4049-81c7-d23507b39297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:05.121023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-64c1a644-5854-4049-81c7-d23507b39297 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:05.125245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f264aa-145d-476a-955c-9cff8e26f897 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:05.197027 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1a644-5854-4049-81c7-d23507b39297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:05.197472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3e2f8-7a10-487c-97e7-77626f24160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:05.198215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3e2f8-7a10-487c-97e7-77626f24160e admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:05.198334 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1a644-5854-4049-81c7-d23507b39297 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:05.198499 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3e2f8-7a10-487c-97e7-77626f24160e admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:05.198728 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3e2f8-7a10-487c-97e7-77626f24160e admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:05.199424 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3e2f8-7a10-487c-97e7-77626f24160e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:05.201355 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3e2f8-7a10-487c-97e7-77626f24160e admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:05.221401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 945/1898] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:05.224663 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb650e-5d16-4de5-9b39-72ff6bb87bc2 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:05.224960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb650e-5d16-4de5-9b39-72ff6bb87bc2 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:05.225282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb650e-5d16-4de5-9b39-72ff6bb87bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:05.248927 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-39fb650e-5d16-4de5-9b39-72ff6bb87bc2 None None] MFA Rules not processed for user `83bff5cd7782423eaa0bc5b29b208ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:05.251871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-39fb650e-5d16-4de5-9b39-72ff6bb87bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:05.333027 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 946/1899] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 19:58:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:05.345707 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb650e-5d16-4de5-9b39-72ff6bb87bc2 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:05.348022 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-39fb650e-5d16-4de5-9b39-72ff6bb87bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:05.361692 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb650e-5d16-4de5-9b39-72ff6bb87bc2 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:05.368514 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c539948-9f67-416b-a1bb-2a0938721f8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:05.369180 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c539948-9f67-416b-a1bb-2a0938721f8d service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:05.369483 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c539948-9f67-416b-a1bb-2a0938721f8d service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:05.369760 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c539948-9f67-416b-a1bb-2a0938721f8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:05.372764 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 954/1900] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:05 2022] POST /identity/v3/projects => generated 407 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:05.373604 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3e2f8-7a10-487c-97e7-77626f24160e admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:05.379889 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c539948-9f67-416b-a1bb-2a0938721f8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:05.381854 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c539948-9f67-416b-a1bb-2a0938721f8d service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:05.420804 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 947/1901] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:58:05.426652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c539948-9f67-416b-a1bb-2a0938721f8d service nova] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:05.431363 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-5c539948-9f67-416b-a1bb-2a0938721f8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:05.446580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c539948-9f67-416b-a1bb-2a0938721f8d service nova] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:05.461144 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3e2f8-7a10-487c-97e7-77626f24160e admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:05.466838 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1ed61-41ca-4540-92d0-bd9799efeca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:05.468011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1ed61-41ca-4540-92d0-bd9799efeca8 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:05.468011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1ed61-41ca-4540-92d0-bd9799efeca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:05.468183 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1ed61-41ca-4540-92d0-bd9799efeca8 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:05.468938 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1ed61-41ca-4540-92d0-bd9799efeca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:05.471126 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1ed61-41ca-4540-92d0-bd9799efeca8 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:05.523001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986770f-4d34-4fe9-8fd8-2fa3fb5eae3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:05.524005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986770f-4d34-4fe9-8fd8-2fa3fb5eae3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:05.524477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986770f-4d34-4fe9-8fd8-2fa3fb5eae3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:05.524763 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986770f-4d34-4fe9-8fd8-2fa3fb5eae3f admin admin] PATH_INFO: `/v3/users/956c85d1e4d2444d9477bf1214562ba6` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:05.526088 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986770f-4d34-4fe9-8fd8-2fa3fb5eae3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=956c85d1e4d2444d9477bf1214562ba6)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:05.528046 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986770f-4d34-4fe9-8fd8-2fa3fb5eae3f admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:05.591240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 955/1902] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:05 2022] POST /identity/v3/users => generated 310 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:05.592092 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1ed61-41ca-4540-92d0-bd9799efeca8 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:05.595770 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-a6c1ed61-41ca-4540-92d0-bd9799efeca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:05.614255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1ed61-41ca-4540-92d0-bd9799efeca8 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:05.619671 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df743c99-96b8-4c0f-8806-7d32335e2e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:05.620676 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df743c99-96b8-4c0f-8806-7d32335e2e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:05.620971 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df743c99-96b8-4c0f-8806-7d32335e2e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:05.621403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df743c99-96b8-4c0f-8806-7d32335e2e8d admin admin] PATH_INFO: `/v3/projects/b960d2b8d1b24269bfb99cb6f486f7dc` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:05.622634 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df743c99-96b8-4c0f-8806-7d32335e2e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b960d2b8d1b24269bfb99cb6f486f7dc)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:05.624595 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df743c99-96b8-4c0f-8806-7d32335e2e8d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:05.867050 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5986770f-4d34-4fe9-8fd8-2fa3fb5eae3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956c85d1e4d2444d9477bf1214562ba6'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:05.867268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-df743c99-96b8-4c0f-8806-7d32335e2e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b960d2b8d1b24269bfb99cb6f486f7dc', 'request_id': 'req-df743c99-96b8-4c0f-8806-7d32335e2e8d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:05.881538 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5986770f-4d34-4fe9-8fd8-2fa3fb5eae3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956c85d1e4d2444d9477bf1214562ba6'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:05.882431 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-df743c99-96b8-4c0f-8806-7d32335e2e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b960d2b8d1b24269bfb99cb6f486f7dc', 'request_id': 'req-df743c99-96b8-4c0f-8806-7d32335e2e8d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:05.888923 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-df743c99-96b8-4c0f-8806-7d32335e2e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b960d2b8d1b24269bfb99cb6f486f7dc', 'request_id': 'req-df743c99-96b8-4c0f-8806-7d32335e2e8d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:05.959729 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5986770f-4d34-4fe9-8fd8-2fa3fb5eae3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956c85d1e4d2444d9477bf1214562ba6'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:05.960377 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5986770f-4d34-4fe9-8fd8-2fa3fb5eae3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956c85d1e4d2444d9477bf1214562ba6'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:05.968876 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5986770f-4d34-4fe9-8fd8-2fa3fb5eae3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956c85d1e4d2444d9477bf1214562ba6'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:05.980972 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 948/1903] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:05 2022] DELETE /identity/v3/users/956c85d1e4d2444d9477bf1214562ba6 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:05.985343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986770f-4d34-4fe9-8fd8-2fa3fb5eae3f admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:05.988250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-5986770f-4d34-4fe9-8fd8-2fa3fb5eae3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:06.062431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986770f-4d34-4fe9-8fd8-2fa3fb5eae3f admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:06.068851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd195c37-a083-4878-8e91-760822acd208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:06.069589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd195c37-a083-4878-8e91-760822acd208 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:06.069882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd195c37-a083-4878-8e91-760822acd208 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:06.070212 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd195c37-a083-4878-8e91-760822acd208 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:06.071534 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd195c37-a083-4878-8e91-760822acd208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:06.073335 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd195c37-a083-4878-8e91-760822acd208 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:06.079780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-df743c99-96b8-4c0f-8806-7d32335e2e8d admin admin] The token cache is being invalidate because project b960d2b8d1b24269bfb99cb6f486f7dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:06.080654 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-df743c99-96b8-4c0f-8806-7d32335e2e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:06.082025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-df743c99-96b8-4c0f-8806-7d32335e2e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:06.085214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 956/1904] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:05 2022] DELETE /identity/v3/projects/b960d2b8d1b24269bfb99cb6f486f7dc => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:06.086886 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399935c0-195b-4c54-a251-dcf50b3d08f0 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:06.089455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399935c0-195b-4c54-a251-dcf50b3d08f0 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:06.089585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 949/1905] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:06.090456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd195c37-a083-4878-8e91-760822acd208 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:06.092213 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399935c0-195b-4c54-a251-dcf50b3d08f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:06.092603 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-cd195c37-a083-4878-8e91-760822acd208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:06.110435 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd195c37-a083-4878-8e91-760822acd208 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:06.116369 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086e127-c1ed-444c-95ff-1eb64e0f81e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:06.117387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086e127-c1ed-444c-95ff-1eb64e0f81e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:06.117786 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086e127-c1ed-444c-95ff-1eb64e0f81e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:06.117952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086e127-c1ed-444c-95ff-1eb64e0f81e7 admin admin] PATH_INFO: `/v3/projects/bf51d0539caa4946b1a55ac46426c7d5/users/ba4227098dbd44b9bc852339f7952399/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:06.125749 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-399935c0-195b-4c54-a251-dcf50b3d08f0 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:06.126910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-399935c0-195b-4c54-a251-dcf50b3d08f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:06.142228 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086e127-c1ed-444c-95ff-1eb64e0f81e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf51d0539caa4946b1a55ac46426c7d5, user_id=ba4227098dbd44b9bc852339f7952399, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:06.145305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086e127-c1ed-444c-95ff-1eb64e0f81e7 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:06.148074 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 957/1906] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:06.149547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb5072-a825-437e-8671-a6bc4cdfa086 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:06.149940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb5072-a825-437e-8671-a6bc4cdfa086 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:06.150346 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb5072-a825-437e-8671-a6bc4cdfa086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:06.173783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-c1fb5072-a825-437e-8671-a6bc4cdfa086 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:06.175573 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c1fb5072-a825-437e-8671-a6bc4cdfa086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:06.194204 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 958/1907] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:06.195038 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb5072-a825-437e-8671-a6bc4cdfa086 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:06.196375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c1fb5072-a825-437e-8671-a6bc4cdfa086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:06.263548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 950/1908] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:06 2022] PUT /identity/v3/projects/bf51d0539caa4946b1a55ac46426c7d5/users/ba4227098dbd44b9bc852339f7952399/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:06.263548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d1e0a-7dd7-4fb4-b79b-f3dc85463a19 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:06.263548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d1e0a-7dd7-4fb4-b79b-f3dc85463a19 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:06.263548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d1e0a-7dd7-4fb4-b79b-f3dc85463a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:06.300592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb5072-a825-437e-8671-a6bc4cdfa086 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:06.305434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-e24d1e0a-7dd7-4fb4-b79b-f3dc85463a19 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:06.306671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e24d1e0a-7dd7-4fb4-b79b-f3dc85463a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:06.388113 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccf432-0744-484c-a267-cc2c1e31735c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:06.389186 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccf432-0744-484c-a267-cc2c1e31735c service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:06.389821 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccf432-0744-484c-a267-cc2c1e31735c service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:06.390201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccf432-0744-484c-a267-cc2c1e31735c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:06.447685 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 951/1909] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:06.451563 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d1e0a-7dd7-4fb4-b79b-f3dc85463a19 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:06.464014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d1e0a-7dd7-4fb4-b79b-f3dc85463a19 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:06.469426 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72588d7c-6f44-45da-b5ae-1d57748595b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:06.470108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72588d7c-6f44-45da-b5ae-1d57748595b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:06.470420 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72588d7c-6f44-45da-b5ae-1d57748595b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:06.470727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72588d7c-6f44-45da-b5ae-1d57748595b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:06.471503 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72588d7c-6f44-45da-b5ae-1d57748595b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:06.473169 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72588d7c-6f44-45da-b5ae-1d57748595b3 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:06.476727 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccf432-0744-484c-a267-cc2c1e31735c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:06.478232 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccf432-0744-484c-a267-cc2c1e31735c service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:06.487059 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 952/1910] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:06.487059 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72588d7c-6f44-45da-b5ae-1d57748595b3 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:06.492062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 959/1911] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:06.494598 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccf432-0744-484c-a267-cc2c1e31735c service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:06.496626 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72588d7c-6f44-45da-b5ae-1d57748595b3 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:06.504658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1c633-cd12-499b-a67c-1e60e7d60dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:06.505297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccf432-0744-484c-a267-cc2c1e31735c service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:06.505413 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1c633-cd12-499b-a67c-1e60e7d60dad admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:06.505781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1c633-cd12-499b-a67c-1e60e7d60dad admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:06.506136 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1c633-cd12-499b-a67c-1e60e7d60dad admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:06.506964 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1c633-cd12-499b-a67c-1e60e7d60dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:58:06.507402 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1c633-cd12-499b-a67c-1e60e7d60dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:06.509704 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1c633-cd12-499b-a67c-1e60e7d60dad admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:06.510456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35217f5e-5b62-4da8-9d08-50d479e03fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:06.511298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35217f5e-5b62-4da8-9d08-50d479e03fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:06.511584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35217f5e-5b62-4da8-9d08-50d479e03fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:06.511862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35217f5e-5b62-4da8-9d08-50d479e03fa2 admin admin] PATH_INFO: `/v3/projects/bf51d0539caa4946b1a55ac46426c7d5/users/ba4227098dbd44b9bc852339f7952399/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:06.513870 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35217f5e-5b62-4da8-9d08-50d479e03fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf51d0539caa4946b1a55ac46426c7d5, user_id=ba4227098dbd44b9bc852339f7952399, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:06.516854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35217f5e-5b62-4da8-9d08-50d479e03fa2 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:06.524800 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 953/1912] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:58:06.528688 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 960/1913] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:06 2022] PUT /identity/v3/projects/bf51d0539caa4946b1a55ac46426c7d5/users/ba4227098dbd44b9bc852339f7952399/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:06.530376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1c633-cd12-499b-a67c-1e60e7d60dad admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:06.540368 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f080cd-8711-4d82-84f0-dcc46816bfff None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:06.540659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f080cd-8711-4d82-84f0-dcc46816bfff None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:06.540962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f080cd-8711-4d82-84f0-dcc46816bfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:06.548774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1c633-cd12-499b-a67c-1e60e7d60dad admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:06.572512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-44f080cd-8711-4d82-84f0-dcc46816bfff None None] MFA Rules not processed for user `ba4227098dbd44b9bc852339f7952399`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:06.574056 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-44f080cd-8711-4d82-84f0-dcc46816bfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:06.617415 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7c255-90c8-46b6-8501-418501b98f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:06.618086 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7c255-90c8-46b6-8501-418501b98f5e admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:06.618371 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7c255-90c8-46b6-8501-418501b98f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:06.618650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7c255-90c8-46b6-8501-418501b98f5e admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:06.619345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7c255-90c8-46b6-8501-418501b98f5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:06.621285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7c255-90c8-46b6-8501-418501b98f5e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:06.648736 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 961/1914] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:06 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:06.660051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f080cd-8711-4d82-84f0-dcc46816bfff None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:06.661516 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-44f080cd-8711-4d82-84f0-dcc46816bfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:06.725643 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f080cd-8711-4d82-84f0-dcc46816bfff None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:06.729900 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7defc2-2a9e-4e9c-834a-5568cf917051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:06.730630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7defc2-2a9e-4e9c-834a-5568cf917051 service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:06.730922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7defc2-2a9e-4e9c-834a-5568cf917051 service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:06.731204 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7defc2-2a9e-4e9c-834a-5568cf917051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:06.742430 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7defc2-2a9e-4e9c-834a-5568cf917051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:06.744272 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7defc2-2a9e-4e9c-834a-5568cf917051 service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:06.754692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 962/1915] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:06 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:58:06.839538 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 954/1916] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:06 2022] POST /identity/v3/projects => generated 385 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:58:06.839945 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7defc2-2a9e-4e9c-834a-5568cf917051 service cinder] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:06.851729 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7defc2-2a9e-4e9c-834a-5568cf917051 service cinder] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:06.934274 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ab8b8-9227-43b2-a651-f1dd1bc378c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:06.934928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ab8b8-9227-43b2-a651-f1dd1bc378c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:06.935221 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ab8b8-9227-43b2-a651-f1dd1bc378c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:06.935500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ab8b8-9227-43b2-a651-f1dd1bc378c9 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:06.936258 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ab8b8-9227-43b2-a651-f1dd1bc378c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:06.938276 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ab8b8-9227-43b2-a651-f1dd1bc378c9 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:06.984012 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7c255-90c8-46b6-8501-418501b98f5e admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:06.989244 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ebd7c255-90c8-46b6-8501-418501b98f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:07.000079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7c255-90c8-46b6-8501-418501b98f5e admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:07.006047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e14d4c-944d-4c21-af75-3856177976d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:07.007116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e14d4c-944d-4c21-af75-3856177976d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:07.007465 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e14d4c-944d-4c21-af75-3856177976d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:07.007858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e14d4c-944d-4c21-af75-3856177976d7 admin admin] PATH_INFO: `/v3/projects/81a6569b3e4c425a80e8987b02b8a304` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:07.010191 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e14d4c-944d-4c21-af75-3856177976d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a6569b3e4c425a80e8987b02b8a304)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:07.012281 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e14d4c-944d-4c21-af75-3856177976d7 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:07.060677 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 963/1917] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:06 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:58:07.064130 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ab8b8-9227-43b2-a651-f1dd1bc378c9 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:07.088622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ab8b8-9227-43b2-a651-f1dd1bc378c9 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:07.102432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee7019-8c83-49f1-a98f-022c92410649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:07.104683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee7019-8c83-49f1-a98f-022c92410649 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:07.104683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee7019-8c83-49f1-a98f-022c92410649 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:07.104683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee7019-8c83-49f1-a98f-022c92410649 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:07.105011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee7019-8c83-49f1-a98f-022c92410649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:07.106843 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee7019-8c83-49f1-a98f-022c92410649 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:07.120359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 964/1918] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:07.121497 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee7019-8c83-49f1-a98f-022c92410649 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:07.132876 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee7019-8c83-49f1-a98f-022c92410649 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:07.137605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efa2aa-f410-4db5-a53f-0bd772b53065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:07.138251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efa2aa-f410-4db5-a53f-0bd772b53065 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:07.138542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efa2aa-f410-4db5-a53f-0bd772b53065 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:07.138820 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efa2aa-f410-4db5-a53f-0bd772b53065 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:07.139678 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efa2aa-f410-4db5-a53f-0bd772b53065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:07.141338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efa2aa-f410-4db5-a53f-0bd772b53065 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:07.151731 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 965/1919] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:07.155914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efa2aa-f410-4db5-a53f-0bd772b53065 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:07.165727 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efa2aa-f410-4db5-a53f-0bd772b53065 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:07.170259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce48522-0686-4f3c-a189-363a32312333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:07.171106 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce48522-0686-4f3c-a189-363a32312333 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:07.171395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce48522-0686-4f3c-a189-363a32312333 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:07.171669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce48522-0686-4f3c-a189-363a32312333 admin admin] PATH_INFO: `/v3/projects/68a7b16111444ef1b375a2947e1d77e7/users/b5b5308601714757a9e5ac34ba812f8c/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:07.185872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce48522-0686-4f3c-a189-363a32312333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a7b16111444ef1b375a2947e1d77e7, user_id=b5b5308601714757a9e5ac34ba812f8c, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:07.188490 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce48522-0686-4f3c-a189-363a32312333 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:07.301465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 966/1920] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:07 2022] PUT /identity/v3/projects/68a7b16111444ef1b375a2947e1d77e7/users/b5b5308601714757a9e5ac34ba812f8c/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:58:07.302302 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce48522-0686-4f3c-a189-363a32312333 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:07.317929 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-76e14d4c-944d-4c21-af75-3856177976d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a6569b3e4c425a80e8987b02b8a304', 'request_id': 'req-76e14d4c-944d-4c21-af75-3856177976d7'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:07.326884 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-76e14d4c-944d-4c21-af75-3856177976d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a6569b3e4c425a80e8987b02b8a304', 'request_id': 'req-76e14d4c-944d-4c21-af75-3856177976d7'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:07.333365 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-76e14d4c-944d-4c21-af75-3856177976d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a6569b3e4c425a80e8987b02b8a304', 'request_id': 'req-76e14d4c-944d-4c21-af75-3856177976d7'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:07.355573 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce48522-0686-4f3c-a189-363a32312333 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:07.406667 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6b32f-ff34-4c99-8f82-4a89e345614e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:07.407337 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6b32f-ff34-4c99-8f82-4a89e345614e service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:07.409941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6b32f-ff34-4c99-8f82-4a89e345614e service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:07.410119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6b32f-ff34-4c99-8f82-4a89e345614e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:07.417316 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:07.417316 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-3dc6b32f-ff34-4c99-8f82-4a89e345614e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:07.447655 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-76e14d4c-944d-4c21-af75-3856177976d7 admin admin] The token cache is being invalidate because project 81a6569b3e4c425a80e8987b02b8a304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:07.447946 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-76e14d4c-944d-4c21-af75-3856177976d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:07.448637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-76e14d4c-944d-4c21-af75-3856177976d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:07.453273 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 955/1921] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:06 2022] DELETE /identity/v3/projects/81a6569b3e4c425a80e8987b02b8a304 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:58:07.453273 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c855fdb-7323-4854-96fa-132b9ab5687a None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:07.453273 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c855fdb-7323-4854-96fa-132b9ab5687a None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:07.453273 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c855fdb-7323-4854-96fa-132b9ab5687a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:07.482788 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-2c855fdb-7323-4854-96fa-132b9ab5687a None None] MFA Rules not processed for user `b5b5308601714757a9e5ac34ba812f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:07.484073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-2c855fdb-7323-4854-96fa-132b9ab5687a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:07.508117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6b32f-ff34-4c99-8f82-4a89e345614e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:07.509691 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6b32f-ff34-4c99-8f82-4a89e345614e service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:07.520592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 967/1922] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:07 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:07.521497 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6b32f-ff34-4c99-8f82-4a89e345614e service cinder] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:07.598565 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 956/1923] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:07.599503 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c855fdb-7323-4854-96fa-132b9ab5687a None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:07.604676 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-2c855fdb-7323-4854-96fa-132b9ab5687a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:07.605922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6b32f-ff34-4c99-8f82-4a89e345614e service cinder] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:07.612356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f520d9-200b-4a3d-8d8a-4e510ef842e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:07.614326 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f520d9-200b-4a3d-8d8a-4e510ef842e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:07.615900 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f520d9-200b-4a3d-8d8a-4e510ef842e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:07.616262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f520d9-200b-4a3d-8d8a-4e510ef842e0 admin admin] PATH_INFO: `/v3/users/bfe923c46e354697a1758a766a1ae98c` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:07.619564 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f520d9-200b-4a3d-8d8a-4e510ef842e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe923c46e354697a1758a766a1ae98c)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:07.621721 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f520d9-200b-4a3d-8d8a-4e510ef842e0 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:07.624211 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c855fdb-7323-4854-96fa-132b9ab5687a None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:07.631715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53d06b-9fa1-49f2-afc2-769b8357481c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:07.632465 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d06b-9fa1-49f2-afc2-769b8357481c admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:07.633060 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d06b-9fa1-49f2-afc2-769b8357481c admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:07.633510 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d06b-9fa1-49f2-afc2-769b8357481c admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:07.634327 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53d06b-9fa1-49f2-afc2-769b8357481c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:07.638466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53d06b-9fa1-49f2-afc2-769b8357481c admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:07.748495 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 957/1924] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:07 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:07.749720 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53d06b-9fa1-49f2-afc2-769b8357481c admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:07.826477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53d06b-9fa1-49f2-afc2-769b8357481c admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:07.831781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ed0b6-6f3b-4dea-8f5c-2aa7a39880fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:07.832563 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ed0b6-6f3b-4dea-8f5c-2aa7a39880fa admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:07.832845 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ed0b6-6f3b-4dea-8f5c-2aa7a39880fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:07.833118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ed0b6-6f3b-4dea-8f5c-2aa7a39880fa admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:07.833824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ed0b6-6f3b-4dea-8f5c-2aa7a39880fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:07.835772 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ed0b6-6f3b-4dea-8f5c-2aa7a39880fa admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:07.932675 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-66f520d9-200b-4a3d-8d8a-4e510ef842e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe923c46e354697a1758a766a1ae98c'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:07.945986 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-66f520d9-200b-4a3d-8d8a-4e510ef842e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe923c46e354697a1758a766a1ae98c'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:07.987781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 958/1925] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:07 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:07.988029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ed0b6-6f3b-4dea-8f5c-2aa7a39880fa admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:07.998625 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ed0b6-6f3b-4dea-8f5c-2aa7a39880fa admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:08.003735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391c7a0-aad7-4ef9-a690-2f1190e1a8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:08.004392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391c7a0-aad7-4ef9-a690-2f1190e1a8aa admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:08.004679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391c7a0-aad7-4ef9-a690-2f1190e1a8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:08.004958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391c7a0-aad7-4ef9-a690-2f1190e1a8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:08.005726 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391c7a0-aad7-4ef9-a690-2f1190e1a8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:08.007329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391c7a0-aad7-4ef9-a690-2f1190e1a8aa admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:08.017068 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 959/1926] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:58:08.021517 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391c7a0-aad7-4ef9-a690-2f1190e1a8aa admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:08.030799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391c7a0-aad7-4ef9-a690-2f1190e1a8aa admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:08.035956 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea78e11-3553-403c-9a1e-fd80da3d2fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:08.036602 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea78e11-3553-403c-9a1e-fd80da3d2fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:08.036889 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea78e11-3553-403c-9a1e-fd80da3d2fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:08.037189 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea78e11-3553-403c-9a1e-fd80da3d2fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:08.037908 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea78e11-3553-403c-9a1e-fd80da3d2fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:08.039483 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea78e11-3553-403c-9a1e-fd80da3d2fb4 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:08.050100 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 960/1927] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:58:08.054086 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea78e11-3553-403c-9a1e-fd80da3d2fb4 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:08.054495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-66f520d9-200b-4a3d-8d8a-4e510ef842e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe923c46e354697a1758a766a1ae98c'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:08.055150 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-66f520d9-200b-4a3d-8d8a-4e510ef842e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe923c46e354697a1758a766a1ae98c'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:08.062698 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-66f520d9-200b-4a3d-8d8a-4e510ef842e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe923c46e354697a1758a766a1ae98c'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:08.064686 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea78e11-3553-403c-9a1e-fd80da3d2fb4 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:08.069849 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 968/1928] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:07 2022] DELETE /identity/v3/users/bfe923c46e354697a1758a766a1ae98c => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:08.070030 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6d9ec-ba73-488d-8085-9885c006975c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:08.070990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6d9ec-ba73-488d-8085-9885c006975c admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:08.071277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6d9ec-ba73-488d-8085-9885c006975c admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:08.071554 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6d9ec-ba73-488d-8085-9885c006975c admin admin] PATH_INFO: `/v3/projects/fcf518d69ee94b7f853d078af4ceec0f/users/0b245084b30c45dfaccea4696e75a5cd/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:08.089942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6d9ec-ba73-488d-8085-9885c006975c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf518d69ee94b7f853d078af4ceec0f, user_id=0b245084b30c45dfaccea4696e75a5cd, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:08.093077 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6d9ec-ba73-488d-8085-9885c006975c admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:08.169499 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 961/1929] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:08 2022] PUT /identity/v3/projects/fcf518d69ee94b7f853d078af4ceec0f/users/0b245084b30c45dfaccea4696e75a5cd/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:58:08.184782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ac881-00cf-4ea8-a919-b098e64fa447 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:08.185086 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ac881-00cf-4ea8-a919-b098e64fa447 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:08.185403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ac881-00cf-4ea8-a919-b098e64fa447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:08.215475 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-422ac881-00cf-4ea8-a919-b098e64fa447 None None] MFA Rules not processed for user `0b245084b30c45dfaccea4696e75a5cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:08.216960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-422ac881-00cf-4ea8-a919-b098e64fa447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:08.288881 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 969/1930] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:08.293501 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6d9ec-ba73-488d-8085-9885c006975c admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:08.295399 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f2c6d9ec-ba73-488d-8085-9885c006975c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:08.334718 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:08.435437 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6d9ec-ba73-488d-8085-9885c006975c admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:08.455569 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430e8d0-3900-40bb-a77d-776a6f362a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:08.456905 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430e8d0-3900-40bb-a77d-776a6f362a67 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:08.462193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430e8d0-3900-40bb-a77d-776a6f362a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:08.462586 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430e8d0-3900-40bb-a77d-776a6f362a67 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:08.464666 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430e8d0-3900-40bb-a77d-776a6f362a67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:08.467533 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430e8d0-3900-40bb-a77d-776a6f362a67 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:08.591945 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 962/1931] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:08 2022] POST /identity/v3/projects => generated 385 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:08.598757 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ac881-00cf-4ea8-a919-b098e64fa447 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:08.621581 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ac881-00cf-4ea8-a919-b098e64fa447 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:08.657717 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430e8d0-3900-40bb-a77d-776a6f362a67 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:08.659220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-a430e8d0-3900-40bb-a77d-776a6f362a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:08.728274 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90f9c7-2445-450e-8d88-197d89bd2558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:08.729103 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90f9c7-2445-450e-8d88-197d89bd2558 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:08.729429 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90f9c7-2445-450e-8d88-197d89bd2558 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:08.729947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90f9c7-2445-450e-8d88-197d89bd2558 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:08.730491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90f9c7-2445-450e-8d88-197d89bd2558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:08.732508 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90f9c7-2445-450e-8d88-197d89bd2558 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:08.780828 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430e8d0-3900-40bb-a77d-776a6f362a67 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:08.786958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e27d11-5905-4658-95b3-19646baaade2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:08.788060 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e27d11-5905-4658-95b3-19646baaade2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:08.788451 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e27d11-5905-4658-95b3-19646baaade2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:08.788740 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e27d11-5905-4658-95b3-19646baaade2 admin admin] PATH_INFO: `/v3/projects/3d5387b90c1e43adaf67d7f59603ec46` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:08.790066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e27d11-5905-4658-95b3-19646baaade2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d5387b90c1e43adaf67d7f59603ec46)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:08.792002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e27d11-5905-4658-95b3-19646baaade2 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:08.871285 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 970/1932] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:08 2022] POST /identity/v3/users => generated 299 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:08.875315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90f9c7-2445-450e-8d88-197d89bd2558 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:08.886191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90f9c7-2445-450e-8d88-197d89bd2558 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:08.890943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d806f7-5c23-44e6-a74a-9a98e981117a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:08.891606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d806f7-5c23-44e6-a74a-9a98e981117a admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:08.891892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d806f7-5c23-44e6-a74a-9a98e981117a admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:08.892173 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d806f7-5c23-44e6-a74a-9a98e981117a admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:08.892905 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d806f7-5c23-44e6-a74a-9a98e981117a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:08.894812 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d806f7-5c23-44e6-a74a-9a98e981117a admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:08.906013 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 971/1933] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:58:08.915683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d806f7-5c23-44e6-a74a-9a98e981117a admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:08.921387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-90e27d11-5905-4658-95b3-19646baaade2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d5387b90c1e43adaf67d7f59603ec46', 'request_id': 'req-90e27d11-5905-4658-95b3-19646baaade2'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:08.926432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d806f7-5c23-44e6-a74a-9a98e981117a admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:08.928203 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-90e27d11-5905-4658-95b3-19646baaade2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d5387b90c1e43adaf67d7f59603ec46', 'request_id': 'req-90e27d11-5905-4658-95b3-19646baaade2'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:08.934165 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-90e27d11-5905-4658-95b3-19646baaade2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d5387b90c1e43adaf67d7f59603ec46', 'request_id': 'req-90e27d11-5905-4658-95b3-19646baaade2'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:08.983409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a77f04-462c-4c22-9a7f-b82f2a70e008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:08.984310 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a77f04-462c-4c22-9a7f-b82f2a70e008 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:08.984600 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a77f04-462c-4c22-9a7f-b82f2a70e008 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:08.984885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a77f04-462c-4c22-9a7f-b82f2a70e008 admin admin] PATH_INFO: `/v3/projects/8d39cb9f3f034cd082d6a441c4a8c931/users/33fde2c78dec40a7b4d3ddf8cf28c3d0/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:08.995057 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-90e27d11-5905-4658-95b3-19646baaade2 admin admin] The token cache is being invalidate because project 3d5387b90c1e43adaf67d7f59603ec46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:08.995349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-90e27d11-5905-4658-95b3-19646baaade2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:08.996005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-90e27d11-5905-4658-95b3-19646baaade2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:09.001964 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 963/1934] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:08 2022] DELETE /identity/v3/projects/3d5387b90c1e43adaf67d7f59603ec46 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:09.003233 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a77f04-462c-4c22-9a7f-b82f2a70e008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d39cb9f3f034cd082d6a441c4a8c931, user_id=33fde2c78dec40a7b4d3ddf8cf28c3d0, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:09.003382 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f09a4-6a89-4c3a-910f-2d35bde5e26e None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:09.003678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f09a4-6a89-4c3a-910f-2d35bde5e26e None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:09.003963 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f09a4-6a89-4c3a-910f-2d35bde5e26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:09.006525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a77f04-462c-4c22-9a7f-b82f2a70e008 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:09.026960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-fe9f09a4-6a89-4c3a-910f-2d35bde5e26e None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:09.028175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-fe9f09a4-6a89-4c3a-910f-2d35bde5e26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:09.037730 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 964/1935] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:09.045330 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05253b83-9072-4ce3-b8a9-2d04c7bd6647 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:09.045718 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05253b83-9072-4ce3-b8a9-2d04c7bd6647 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:09.046748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05253b83-9072-4ce3-b8a9-2d04c7bd6647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:09.070718 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-05253b83-9072-4ce3-b8a9-2d04c7bd6647 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:09.073431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-05253b83-9072-4ce3-b8a9-2d04c7bd6647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:09.086517 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 965/1936] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:58:09.089566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05253b83-9072-4ce3-b8a9-2d04c7bd6647 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:09.100246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05253b83-9072-4ce3-b8a9-2d04c7bd6647 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:09.116740 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ff014-0896-484e-ac30-47a43d56e67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:09.117448 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ff014-0896-484e-ac30-47a43d56e67e admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:09.117737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ff014-0896-484e-ac30-47a43d56e67e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:09.118079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ff014-0896-484e-ac30-47a43d56e67e admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:09.118849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ff014-0896-484e-ac30-47a43d56e67e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:58:09.119158 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ff014-0896-484e-ac30-47a43d56e67e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:09.120761 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ff014-0896-484e-ac30-47a43d56e67e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:09.134126 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 966/1937] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:58:09.138099 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ff014-0896-484e-ac30-47a43d56e67e admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:09.149009 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ff014-0896-484e-ac30-47a43d56e67e admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:09.150874 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 972/1938] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:08 2022] PUT /identity/v3/projects/8d39cb9f3f034cd082d6a441c4a8c931/users/33fde2c78dec40a7b4d3ddf8cf28c3d0/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:58:09.164738 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a77f04-462c-4c22-9a7f-b82f2a70e008 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:09.167171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-43a77f04-462c-4c22-9a7f-b82f2a70e008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:09.210964 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e654308-c8fc-4c47-a393-76065c3b93f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:09.211636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e654308-c8fc-4c47-a393-76065c3b93f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:09.211921 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e654308-c8fc-4c47-a393-76065c3b93f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:09.212280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e654308-c8fc-4c47-a393-76065c3b93f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:09.212901 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e654308-c8fc-4c47-a393-76065c3b93f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:09.214817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e654308-c8fc-4c47-a393-76065c3b93f0 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:09.412950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a77f04-462c-4c22-9a7f-b82f2a70e008 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:09.412950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce576f57-b337-463c-a576-d3ba216a12f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:09.412950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce576f57-b337-463c-a576-d3ba216a12f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:09.412950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce576f57-b337-463c-a576-d3ba216a12f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:09.413331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce576f57-b337-463c-a576-d3ba216a12f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:09.413331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce576f57-b337-463c-a576-d3ba216a12f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:09.413331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce576f57-b337-463c-a576-d3ba216a12f5 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:09.413331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 973/1939] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:09.413331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce576f57-b337-463c-a576-d3ba216a12f5 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:09.413331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce576f57-b337-463c-a576-d3ba216a12f5 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:09.417752 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba6f90-8da8-4f5f-ab5c-0861b0f46854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:09.418624 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba6f90-8da8-4f5f-ab5c-0861b0f46854 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:09.418909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba6f90-8da8-4f5f-ab5c-0861b0f46854 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:09.419188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba6f90-8da8-4f5f-ab5c-0861b0f46854 admin admin] PATH_INFO: `/v3/projects/8d39cb9f3f034cd082d6a441c4a8c931/users/33fde2c78dec40a7b4d3ddf8cf28c3d0/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:09.421207 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba6f90-8da8-4f5f-ab5c-0861b0f46854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d39cb9f3f034cd082d6a441c4a8c931, user_id=33fde2c78dec40a7b4d3ddf8cf28c3d0, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:09.423836 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba6f90-8da8-4f5f-ab5c-0861b0f46854 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:09.434314 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 974/1940] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:09 2022] PUT /identity/v3/projects/8d39cb9f3f034cd082d6a441c4a8c931/users/33fde2c78dec40a7b4d3ddf8cf28c3d0/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:58:09.451435 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e2a84-1415-48d3-9004-836de84d53b5 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:09.451435 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e2a84-1415-48d3-9004-836de84d53b5 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:09.451435 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e2a84-1415-48d3-9004-836de84d53b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:09.481986 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-2f1e2a84-1415-48d3-9004-836de84d53b5 None None] MFA Rules not processed for user `33fde2c78dec40a7b4d3ddf8cf28c3d0`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:09.483214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-2f1e2a84-1415-48d3-9004-836de84d53b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:09.564143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 975/1941] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:58:09.601904 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 967/1942] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:09 2022] POST /identity/v3/projects => generated 367 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:58:09.611428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e2a84-1415-48d3-9004-836de84d53b5 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:09.678230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e2a84-1415-48d3-9004-836de84d53b5 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:09.739355 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2f96b-17f1-4933-ac61-2176d57cd9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:09.740034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2f96b-17f1-4933-ac61-2176d57cd9bb admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:09.740327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2f96b-17f1-4933-ac61-2176d57cd9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:09.740607 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2f96b-17f1-4933-ac61-2176d57cd9bb admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:09.741341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2f96b-17f1-4933-ac61-2176d57cd9bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:09.743284 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2f96b-17f1-4933-ac61-2176d57cd9bb admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:09.832188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e654308-c8fc-4c47-a393-76065c3b93f0 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:09.832188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-4e654308-c8fc-4c47-a393-76065c3b93f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:09.886803 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e654308-c8fc-4c47-a393-76065c3b93f0 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:09.890704 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09e52c-36c1-4a97-91e8-c9c83af97e58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:09.891401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09e52c-36c1-4a97-91e8-c9c83af97e58 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:09.891609 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09e52c-36c1-4a97-91e8-c9c83af97e58 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:09.892004 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09e52c-36c1-4a97-91e8-c9c83af97e58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:09.898889 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 976/1943] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:09 2022] POST /identity/v3/users => generated 284 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:09.902812 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2f96b-17f1-4933-ac61-2176d57cd9bb admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:09.914685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2f96b-17f1-4933-ac61-2176d57cd9bb admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:09.919904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045960ab-c09e-42b0-af6f-e99e71507ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:09.920750 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045960ab-c09e-42b0-af6f-e99e71507ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:09.921104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045960ab-c09e-42b0-af6f-e99e71507ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:09.921477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045960ab-c09e-42b0-af6f-e99e71507ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:09.922277 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045960ab-c09e-42b0-af6f-e99e71507ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:09.924428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045960ab-c09e-42b0-af6f-e99e71507ee8 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:09.935186 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 977/1944] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:58:09.939623 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045960ab-c09e-42b0-af6f-e99e71507ee8 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:09.951090 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045960ab-c09e-42b0-af6f-e99e71507ee8 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:09.956136 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e39b61-36d8-40b9-8e67-97288046d0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:09.957486 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e39b61-36d8-40b9-8e67-97288046d0fc admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:09.958688 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e39b61-36d8-40b9-8e67-97288046d0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:09.958992 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e39b61-36d8-40b9-8e67-97288046d0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:09.959719 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e39b61-36d8-40b9-8e67-97288046d0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:09.961380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e39b61-36d8-40b9-8e67-97288046d0fc admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:09.970274 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09e52c-36c1-4a97-91e8-c9c83af97e58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:09.976678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09e52c-36c1-4a97-91e8-c9c83af97e58 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:09.977906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 978/1945] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:58:09.981832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e39b61-36d8-40b9-8e67-97288046d0fc admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:09.987376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 968/1946] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:58:09.994138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e39b61-36d8-40b9-8e67-97288046d0fc admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:09.999425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f57046-2269-4ab1-bd82-a4b5a2103635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:10.004127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f57046-2269-4ab1-bd82-a4b5a2103635 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:10.004127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f57046-2269-4ab1-bd82-a4b5a2103635 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:10.004127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f57046-2269-4ab1-bd82-a4b5a2103635 admin admin] PATH_INFO: `/v3/projects/931c40f9cbd14128bf6ab128bb026bb1/users/99a04818ed364be7be9ed8b5a83e0814/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:10.021588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f57046-2269-4ab1-bd82-a4b5a2103635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=931c40f9cbd14128bf6ab128bb026bb1, user_id=99a04818ed364be7be9ed8b5a83e0814, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:10.024733 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f57046-2269-4ab1-bd82-a4b5a2103635 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:10.056583 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:10.136696 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 979/1947] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:09 2022] PUT /identity/v3/projects/931c40f9cbd14128bf6ab128bb026bb1/users/99a04818ed364be7be9ed8b5a83e0814/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:10.148897 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af5f08-b587-40de-94f1-3409d5a04999 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:10.149240 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af5f08-b587-40de-94f1-3409d5a04999 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:10.149529 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af5f08-b587-40de-94f1-3409d5a04999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:10.178191 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-09af5f08-b587-40de-94f1-3409d5a04999 None None] MFA Rules not processed for user `99a04818ed364be7be9ed8b5a83e0814`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:10.179326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-09af5f08-b587-40de-94f1-3409d5a04999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:10.243499 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 969/1948] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:10.247946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f57046-2269-4ab1-bd82-a4b5a2103635 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:10.315373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f57046-2269-4ab1-bd82-a4b5a2103635 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:10.321461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add9206-b674-4330-901f-5b305395b532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:10.322137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add9206-b674-4330-901f-5b305395b532 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:10.322426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add9206-b674-4330-901f-5b305395b532 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:10.322704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add9206-b674-4330-901f-5b305395b532 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:10.323559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add9206-b674-4330-901f-5b305395b532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:10.325403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add9206-b674-4330-901f-5b305395b532 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:10.438670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 980/1949] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:10 2022] POST /identity/v3/projects => generated 367 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:10.439118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af5f08-b587-40de-94f1-3409d5a04999 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:10.452798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af5f08-b587-40de-94f1-3409d5a04999 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:10.512565 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388101d-f7e7-4a1a-ad0a-53ac55b9b47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:10.513655 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388101d-f7e7-4a1a-ad0a-53ac55b9b47b admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:10.513942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388101d-f7e7-4a1a-ad0a-53ac55b9b47b admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:10.514219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388101d-f7e7-4a1a-ad0a-53ac55b9b47b admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:10.514912 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388101d-f7e7-4a1a-ad0a-53ac55b9b47b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:10.516846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388101d-f7e7-4a1a-ad0a-53ac55b9b47b admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:10.633477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 970/1950] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:10 2022] POST /identity/v3/users => generated 290 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:10.637502 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add9206-b674-4330-901f-5b305395b532 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:10.647887 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add9206-b674-4330-901f-5b305395b532 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:10.652392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0157c40-d9cf-4beb-991a-39eeff34acd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:10.653046 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0157c40-d9cf-4beb-991a-39eeff34acd2 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:10.653489 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0157c40-d9cf-4beb-991a-39eeff34acd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:10.664687 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0157c40-d9cf-4beb-991a-39eeff34acd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:10.664687 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0157c40-d9cf-4beb-991a-39eeff34acd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:10.664687 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0157c40-d9cf-4beb-991a-39eeff34acd2 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:10.666473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 981/1951] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:58:10.670759 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388101d-f7e7-4a1a-ad0a-53ac55b9b47b admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:10.681397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388101d-f7e7-4a1a-ad0a-53ac55b9b47b admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:10.685910 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a90703-74cd-4fa6-bc11-b2ae252dea92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:10.686785 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a90703-74cd-4fa6-bc11-b2ae252dea92 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:10.687071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a90703-74cd-4fa6-bc11-b2ae252dea92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:10.687352 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a90703-74cd-4fa6-bc11-b2ae252dea92 admin admin] PATH_INFO: `/v3/projects/64635bd06e3e4fc2ae1f095a12b12cfe/users/fb902d70e07040e78bea18e3f5cb1b06/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:10.702256 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a90703-74cd-4fa6-bc11-b2ae252dea92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64635bd06e3e4fc2ae1f095a12b12cfe, user_id=fb902d70e07040e78bea18e3f5cb1b06, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:10.705107 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a90703-74cd-4fa6-bc11-b2ae252dea92 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:10.862431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 971/1952] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:10 2022] PUT /identity/v3/projects/64635bd06e3e4fc2ae1f095a12b12cfe/users/fb902d70e07040e78bea18e3f5cb1b06/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:58:10.866831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0157c40-d9cf-4beb-991a-39eeff34acd2 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:10.878931 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0157c40-d9cf-4beb-991a-39eeff34acd2 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:10.937682 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107eed8-3543-40ed-ad95-9ec14d49872f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:10.938385 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107eed8-3543-40ed-ad95-9ec14d49872f admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:10.938674 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107eed8-3543-40ed-ad95-9ec14d49872f admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:10.938957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107eed8-3543-40ed-ad95-9ec14d49872f admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:10.939683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107eed8-3543-40ed-ad95-9ec14d49872f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:10.941896 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107eed8-3543-40ed-ad95-9ec14d49872f admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:10.961572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 982/1953] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:10.961666 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a90703-74cd-4fa6-bc11-b2ae252dea92 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:10.968938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a90703-74cd-4fa6-bc11-b2ae252dea92 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:10.974429 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa6762-a1b1-42a6-abbf-c7c9def4ad1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:10.975333 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa6762-a1b1-42a6-abbf-c7c9def4ad1e admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:10.975704 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa6762-a1b1-42a6-abbf-c7c9def4ad1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:10.976036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa6762-a1b1-42a6-abbf-c7c9def4ad1e admin admin] PATH_INFO: `/v3/projects/64635bd06e3e4fc2ae1f095a12b12cfe/users/fb902d70e07040e78bea18e3f5cb1b06/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:10.978370 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa6762-a1b1-42a6-abbf-c7c9def4ad1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=64635bd06e3e4fc2ae1f095a12b12cfe, user_id=fb902d70e07040e78bea18e3f5cb1b06, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:10.978865 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107eed8-3543-40ed-ad95-9ec14d49872f admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:10.981837 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-3107eed8-3543-40ed-ad95-9ec14d49872f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:10.982227 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa6762-a1b1-42a6-abbf-c7c9def4ad1e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:10.995312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 972/1954] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:10 2022] PUT /identity/v3/projects/64635bd06e3e4fc2ae1f095a12b12cfe/users/fb902d70e07040e78bea18e3f5cb1b06/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:11.009755 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4c6d6-97e8-48fd-b343-d13001bc6921 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:11.010689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4c6d6-97e8-48fd-b343-d13001bc6921 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:11.011089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4c6d6-97e8-48fd-b343-d13001bc6921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:11.016173 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107eed8-3543-40ed-ad95-9ec14d49872f admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:11.045748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-24c4c6d6-97e8-48fd-b343-d13001bc6921 None None] MFA Rules not processed for user `fb902d70e07040e78bea18e3f5cb1b06`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:11.047208 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-24c4c6d6-97e8-48fd-b343-d13001bc6921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:11.108732 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e7598-613d-4586-8b21-fd66cf972ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:11.115678 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e7598-613d-4586-8b21-fd66cf972ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:11.115678 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e7598-613d-4586-8b21-fd66cf972ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:11.115678 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e7598-613d-4586-8b21-fd66cf972ba1 admin admin] PATH_INFO: `/v3/users/517ba9b2511a4992b77d3c77280e9903` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:11.116262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e7598-613d-4586-8b21-fd66cf972ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=517ba9b2511a4992b77d3c77280e9903)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:11.117768 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e7598-613d-4586-8b21-fd66cf972ba1 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:11.151804 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 973/1955] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:11.164293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4c6d6-97e8-48fd-b343-d13001bc6921 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:11.166650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-24c4c6d6-97e8-48fd-b343-d13001bc6921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:11.227814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4c6d6-97e8-48fd-b343-d13001bc6921 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:11.231701 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa703918-cb86-417a-9e30-770f85ca7a8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:11.232358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa703918-cb86-417a-9e30-770f85ca7a8d service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:11.232647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa703918-cb86-417a-9e30-770f85ca7a8d service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:11.232978 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa703918-cb86-417a-9e30-770f85ca7a8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:11.242703 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa703918-cb86-417a-9e30-770f85ca7a8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:11.244123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa703918-cb86-417a-9e30-770f85ca7a8d service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:11.254899 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 974/1956] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:11 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:11.447913 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-392e7598-613d-4586-8b21-fd66cf972ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '517ba9b2511a4992b77d3c77280e9903'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:11.460671 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-392e7598-613d-4586-8b21-fd66cf972ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '517ba9b2511a4992b77d3c77280e9903'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:11.515084 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa703918-cb86-417a-9e30-770f85ca7a8d service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:11.523902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa703918-cb86-417a-9e30-770f85ca7a8d service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:11.527878 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c0c8f-d886-4a20-a523-5b1a7569b717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:11.528525 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c0c8f-d886-4a20-a523-5b1a7569b717 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:11.528804 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c0c8f-d886-4a20-a523-5b1a7569b717 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:11.529079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c0c8f-d886-4a20-a523-5b1a7569b717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:11.587785 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c0c8f-d886-4a20-a523-5b1a7569b717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:11.589584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c0c8f-d886-4a20-a523-5b1a7569b717 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:11.599818 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 975/1957] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:11 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:58:11.606426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-392e7598-613d-4586-8b21-fd66cf972ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '517ba9b2511a4992b77d3c77280e9903'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:11.611066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-392e7598-613d-4586-8b21-fd66cf972ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '517ba9b2511a4992b77d3c77280e9903'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:11.618579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-392e7598-613d-4586-8b21-fd66cf972ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '517ba9b2511a4992b77d3c77280e9903'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:11.625334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 983/1958] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:10 2022] DELETE /identity/v3/users/517ba9b2511a4992b77d3c77280e9903 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:58:11.630824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e560cb4-4aae-4195-943c-9e8e5a98da2f None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:11.633756 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e560cb4-4aae-4195-943c-9e8e5a98da2f None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:11.633756 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e560cb4-4aae-4195-943c-9e8e5a98da2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:11.651576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-9e560cb4-4aae-4195-943c-9e8e5a98da2f None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:11.651576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-9e560cb4-4aae-4195-943c-9e8e5a98da2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:11.718849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 976/1959] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:11.729288 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e7598-613d-4586-8b21-fd66cf972ba1 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:11.731202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-392e7598-613d-4586-8b21-fd66cf972ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:11.790223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e7598-613d-4586-8b21-fd66cf972ba1 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:11.793730 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d4ef6-4c17-49d9-a4fe-b9e9f8eb9f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:11.794374 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d4ef6-4c17-49d9-a4fe-b9e9f8eb9f3a service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:11.794654 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d4ef6-4c17-49d9-a4fe-b9e9f8eb9f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:11.794927 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d4ef6-4c17-49d9-a4fe-b9e9f8eb9f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:11.804410 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d4ef6-4c17-49d9-a4fe-b9e9f8eb9f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:11.805866 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d4ef6-4c17-49d9-a4fe-b9e9f8eb9f3a service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:11.815444 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 984/1960] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:12.090772 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:12.296272 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:12.305361 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e560cb4-4aae-4195-943c-9e8e5a98da2f None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:12.306982 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-9e560cb4-4aae-4195-943c-9e8e5a98da2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:12.325483 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e560cb4-4aae-4195-943c-9e8e5a98da2f None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:12.330776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a2bdc-2452-4b55-8596-cb56e5a902e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:12.332351 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a2bdc-2452-4b55-8596-cb56e5a902e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:12.332640 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a2bdc-2452-4b55-8596-cb56e5a902e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:12.332937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a2bdc-2452-4b55-8596-cb56e5a902e4 admin admin] PATH_INFO: `/v3/projects/adbf8fec90a347cf96eb6aa36b987063` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:12.334220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a2bdc-2452-4b55-8596-cb56e5a902e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adbf8fec90a347cf96eb6aa36b987063)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:12.336168 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a2bdc-2452-4b55-8596-cb56e5a902e4 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:12.558553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-a77a2bdc-2452-4b55-8596-cb56e5a902e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adbf8fec90a347cf96eb6aa36b987063', 'request_id': 'req-a77a2bdc-2452-4b55-8596-cb56e5a902e4'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:12.574857 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-a77a2bdc-2452-4b55-8596-cb56e5a902e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adbf8fec90a347cf96eb6aa36b987063', 'request_id': 'req-a77a2bdc-2452-4b55-8596-cb56e5a902e4'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:12.582110 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-a77a2bdc-2452-4b55-8596-cb56e5a902e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adbf8fec90a347cf96eb6aa36b987063', 'request_id': 'req-a77a2bdc-2452-4b55-8596-cb56e5a902e4'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:12.666421 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-a77a2bdc-2452-4b55-8596-cb56e5a902e4 admin admin] The token cache is being invalidate because project adbf8fec90a347cf96eb6aa36b987063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:12.666421 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-a77a2bdc-2452-4b55-8596-cb56e5a902e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:12.673677 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-a77a2bdc-2452-4b55-8596-cb56e5a902e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:12.675542 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 977/1961] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:12 2022] DELETE /identity/v3/projects/adbf8fec90a347cf96eb6aa36b987063 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:12.680290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d4ef6-4c17-49d9-a4fe-b9e9f8eb9f3a service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:12.695613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d4ef6-4c17-49d9-a4fe-b9e9f8eb9f3a service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:12.794373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848354a-dea7-494f-bb77-406a14768159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:12.795680 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848354a-dea7-494f-bb77-406a14768159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:12.796192 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848354a-dea7-494f-bb77-406a14768159 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:12.796690 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848354a-dea7-494f-bb77-406a14768159 admin admin] PATH_INFO: `/v3/users/961d9a08d9dd4582a41f8f6fd7ec7fda` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:12.798291 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848354a-dea7-494f-bb77-406a14768159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=961d9a08d9dd4582a41f8f6fd7ec7fda)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:12.801300 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848354a-dea7-494f-bb77-406a14768159 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:13.018307 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a2bdc-2452-4b55-8596-cb56e5a902e4 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:13.020533 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-a77a2bdc-2452-4b55-8596-cb56e5a902e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:13.040673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7848354a-dea7-494f-bb77-406a14768159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '961d9a08d9dd4582a41f8f6fd7ec7fda'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:13.070103 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7848354a-dea7-494f-bb77-406a14768159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '961d9a08d9dd4582a41f8f6fd7ec7fda'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:13.091241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a2bdc-2452-4b55-8596-cb56e5a902e4 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:13.095160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a19177-0151-4fd2-9812-d8622729d3e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:13.095963 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19177-0151-4fd2-9812-d8622729d3e5 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:13.096343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19177-0151-4fd2-9812-d8622729d3e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:13.096692 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19177-0151-4fd2-9812-d8622729d3e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:13.104525 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-54a19177-0151-4fd2-9812-d8622729d3e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:13.160697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7848354a-dea7-494f-bb77-406a14768159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '961d9a08d9dd4582a41f8f6fd7ec7fda'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:13.161356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7848354a-dea7-494f-bb77-406a14768159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '961d9a08d9dd4582a41f8f6fd7ec7fda'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:13.175784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7848354a-dea7-494f-bb77-406a14768159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '961d9a08d9dd4582a41f8f6fd7ec7fda'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:13.196996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 985/1962] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:12 2022] DELETE /identity/v3/users/961d9a08d9dd4582a41f8f6fd7ec7fda => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:13.205922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a19177-0151-4fd2-9812-d8622729d3e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:13.208688 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a19177-0151-4fd2-9812-d8622729d3e5 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:13.219818 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 978/1963] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:13.779467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848354a-dea7-494f-bb77-406a14768159 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:13.781071 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7848354a-dea7-494f-bb77-406a14768159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:13.939135 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848354a-dea7-494f-bb77-406a14768159 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:13.949954 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36138f4c-ddc3-456c-af47-bc38249610c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:13.954994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36138f4c-ddc3-456c-af47-bc38249610c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:13.954994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36138f4c-ddc3-456c-af47-bc38249610c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:13.954994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36138f4c-ddc3-456c-af47-bc38249610c5 admin admin] PATH_INFO: `/v3/projects/7bf8e901451749068474acac3ea660c4` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:13.954994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36138f4c-ddc3-456c-af47-bc38249610c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bf8e901451749068474acac3ea660c4)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:13.957001 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36138f4c-ddc3-456c-af47-bc38249610c5 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:14.021674 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:14.186193 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-36138f4c-ddc3-456c-af47-bc38249610c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf8e901451749068474acac3ea660c4', 'request_id': 'req-36138f4c-ddc3-456c-af47-bc38249610c5'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:14.194356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-36138f4c-ddc3-456c-af47-bc38249610c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf8e901451749068474acac3ea660c4', 'request_id': 'req-36138f4c-ddc3-456c-af47-bc38249610c5'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:14.210656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-36138f4c-ddc3-456c-af47-bc38249610c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf8e901451749068474acac3ea660c4', 'request_id': 'req-36138f4c-ddc3-456c-af47-bc38249610c5'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:14.292186 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-36138f4c-ddc3-456c-af47-bc38249610c5 admin admin] The token cache is being invalidate because project 7bf8e901451749068474acac3ea660c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:14.292419 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-36138f4c-ddc3-456c-af47-bc38249610c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:14.294159 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-36138f4c-ddc3-456c-af47-bc38249610c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:14.304671 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 986/1964] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:13 2022] DELETE /identity/v3/projects/7bf8e901451749068474acac3ea660c4 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:14.305075 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a19177-0151-4fd2-9812-d8622729d3e5 service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:14.305075 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-54a19177-0151-4fd2-9812-d8622729d3e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:14.324272 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a19177-0151-4fd2-9812-d8622729d3e5 service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:14.436311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abce16-0e97-45ad-88d9-4646dd09ad04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:14.437446 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abce16-0e97-45ad-88d9-4646dd09ad04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:14.437741 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abce16-0e97-45ad-88d9-4646dd09ad04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:14.438026 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abce16-0e97-45ad-88d9-4646dd09ad04 admin admin] PATH_INFO: `/v3/users/da9310f8105f4d378dd71b18f3f86f90` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:14.439382 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abce16-0e97-45ad-88d9-4646dd09ad04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da9310f8105f4d378dd71b18f3f86f90)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:14.442380 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abce16-0e97-45ad-88d9-4646dd09ad04 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:14.491973 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:14.660288 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-66abce16-0e97-45ad-88d9-4646dd09ad04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da9310f8105f4d378dd71b18f3f86f90'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:14.669066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-66abce16-0e97-45ad-88d9-4646dd09ad04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da9310f8105f4d378dd71b18f3f86f90'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:14.763990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-66abce16-0e97-45ad-88d9-4646dd09ad04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da9310f8105f4d378dd71b18f3f86f90'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:14.765219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-66abce16-0e97-45ad-88d9-4646dd09ad04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da9310f8105f4d378dd71b18f3f86f90'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:14.776959 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-66abce16-0e97-45ad-88d9-4646dd09ad04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da9310f8105f4d378dd71b18f3f86f90'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:14.786515 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 979/1965] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:14 2022] DELETE /identity/v3/users/da9310f8105f4d378dd71b18f3f86f90 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:15.298352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:15.521881 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36138f4c-ddc3-456c-af47-bc38249610c5 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:15.524236 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-36138f4c-ddc3-456c-af47-bc38249610c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:15.548410 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36138f4c-ddc3-456c-af47-bc38249610c5 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:15.623699 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc0b3b-a5b9-4be1-bce5-18ba04fa35af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:15.624874 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc0b3b-a5b9-4be1-bce5-18ba04fa35af admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:15.625355 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc0b3b-a5b9-4be1-bce5-18ba04fa35af admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:15.625916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc0b3b-a5b9-4be1-bce5-18ba04fa35af admin admin] PATH_INFO: `/v3/projects/0e3f3c718c0a49b7b6a18d992054bc1c` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:15.632980 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc0b3b-a5b9-4be1-bce5-18ba04fa35af admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e3f3c718c0a49b7b6a18d992054bc1c)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:15.632980 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc0b3b-a5b9-4be1-bce5-18ba04fa35af admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:15.788334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-bdfc0b3b-a5b9-4be1-bce5-18ba04fa35af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e3f3c718c0a49b7b6a18d992054bc1c', 'request_id': 'req-bdfc0b3b-a5b9-4be1-bce5-18ba04fa35af'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:15.795258 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-bdfc0b3b-a5b9-4be1-bce5-18ba04fa35af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e3f3c718c0a49b7b6a18d992054bc1c', 'request_id': 'req-bdfc0b3b-a5b9-4be1-bce5-18ba04fa35af'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:15.801456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-bdfc0b3b-a5b9-4be1-bce5-18ba04fa35af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e3f3c718c0a49b7b6a18d992054bc1c', 'request_id': 'req-bdfc0b3b-a5b9-4be1-bce5-18ba04fa35af'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:15.896829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-bdfc0b3b-a5b9-4be1-bce5-18ba04fa35af admin admin] The token cache is being invalidate because project 0e3f3c718c0a49b7b6a18d992054bc1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:15.897351 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-bdfc0b3b-a5b9-4be1-bce5-18ba04fa35af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:15.898248 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-bdfc0b3b-a5b9-4be1-bce5-18ba04fa35af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:15.903803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 987/1966] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:15 2022] DELETE /identity/v3/projects/0e3f3c718c0a49b7b6a18d992054bc1c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:15.906366 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfff74-e5b6-42fd-afe3-adbf4e90168c None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:15.907214 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfff74-e5b6-42fd-afe3-adbf4e90168c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:15.907698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfff74-e5b6-42fd-afe3-adbf4e90168c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:15.951698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-2ccfff74-e5b6-42fd-afe3-adbf4e90168c None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:15.952665 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-2ccfff74-e5b6-42fd-afe3-adbf4e90168c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:16.045911 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 980/1967] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:16.060260 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d7495-fe1e-4dca-bc77-598127b93e6b None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:16.060260 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d7495-fe1e-4dca-bc77-598127b93e6b None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:16.060260 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d7495-fe1e-4dca-bc77-598127b93e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:16.088773 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-2b8d7495-fe1e-4dca-bc77-598127b93e6b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:16.088773 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-2b8d7495-fe1e-4dca-bc77-598127b93e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:16.096580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 988/1968] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:16.098630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfff74-e5b6-42fd-afe3-adbf4e90168c None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:16.113852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfff74-e5b6-42fd-afe3-adbf4e90168c None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:16.119067 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeee974-1f45-49cc-9b6f-466d5c5fdd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:16.120177 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeee974-1f45-49cc-9b6f-466d5c5fdd63 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:16.120437 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeee974-1f45-49cc-9b6f-466d5c5fdd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:16.120717 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeee974-1f45-49cc-9b6f-466d5c5fdd63 admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:16.121507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeee974-1f45-49cc-9b6f-466d5c5fdd63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:58:16.121817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeee974-1f45-49cc-9b6f-466d5c5fdd63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:16.123601 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeee974-1f45-49cc-9b6f-466d5c5fdd63 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:16.136836 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 981/1969] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:58:16.141585 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d7495-fe1e-4dca-bc77-598127b93e6b None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:16.151602 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d7495-fe1e-4dca-bc77-598127b93e6b None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:16.156681 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ecb5b-efac-45b9-b9e7-5d0635441ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:16.157581 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ecb5b-efac-45b9-b9e7-5d0635441ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:16.157937 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ecb5b-efac-45b9-b9e7-5d0635441ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:16.158232 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ecb5b-efac-45b9-b9e7-5d0635441ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:16.158964 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ecb5b-efac-45b9-b9e7-5d0635441ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:16.161717 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ecb5b-efac-45b9-b9e7-5d0635441ac3 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:16.310322 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 989/1970] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:16 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:16.314893 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeee974-1f45-49cc-9b6f-466d5c5fdd63 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:16.326173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeee974-1f45-49cc-9b6f-466d5c5fdd63 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:16.385067 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee6c46-2c3b-4411-8e20-e762246adbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:16.385802 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee6c46-2c3b-4411-8e20-e762246adbc2 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:16.386089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee6c46-2c3b-4411-8e20-e762246adbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:16.386369 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee6c46-2c3b-4411-8e20-e762246adbc2 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:16.387126 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee6c46-2c3b-4411-8e20-e762246adbc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:16.389082 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee6c46-2c3b-4411-8e20-e762246adbc2 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:16.501117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 982/1971] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:16 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:16.503621 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ecb5b-efac-45b9-b9e7-5d0635441ac3 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:16.513534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ecb5b-efac-45b9-b9e7-5d0635441ac3 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:16.518238 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0ca5f-b468-42cc-a9a3-79c76fe482b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:16.519386 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0ca5f-b468-42cc-a9a3-79c76fe482b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:16.519673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0ca5f-b468-42cc-a9a3-79c76fe482b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:16.519940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0ca5f-b468-42cc-a9a3-79c76fe482b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:16.520851 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0ca5f-b468-42cc-a9a3-79c76fe482b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:16.522545 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0ca5f-b468-42cc-a9a3-79c76fe482b6 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:16.533394 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 990/1972] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:16.538352 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee6c46-2c3b-4411-8e20-e762246adbc2 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:16.549065 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee6c46-2c3b-4411-8e20-e762246adbc2 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:16.558951 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a9768-5865-4bf7-96f4-2674fff40c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:16.559674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a9768-5865-4bf7-96f4-2674fff40c33 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:16.560128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a9768-5865-4bf7-96f4-2674fff40c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:16.560409 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a9768-5865-4bf7-96f4-2674fff40c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:16.561165 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a9768-5865-4bf7-96f4-2674fff40c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:16.562819 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a9768-5865-4bf7-96f4-2674fff40c33 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:16.573646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 983/1973] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:58:16.578425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0ca5f-b468-42cc-a9a3-79c76fe482b6 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:16.592060 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0ca5f-b468-42cc-a9a3-79c76fe482b6 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:16.596817 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2acc5d-2d9c-48c8-9d0b-9620e04a4ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:16.598314 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2acc5d-2d9c-48c8-9d0b-9620e04a4ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:16.598601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2acc5d-2d9c-48c8-9d0b-9620e04a4ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:16.599025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2acc5d-2d9c-48c8-9d0b-9620e04a4ad9 admin admin] PATH_INFO: `/v3/projects/cfb016f2a8cf4a1bb5cae40f643168c8/users/78e7abd036fe405bafcbf7f8017136d8/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:16.622409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2acc5d-2d9c-48c8-9d0b-9620e04a4ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfb016f2a8cf4a1bb5cae40f643168c8, user_id=78e7abd036fe405bafcbf7f8017136d8, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:16.625554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2acc5d-2d9c-48c8-9d0b-9620e04a4ad9 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:16.652326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:16.695140 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a9768-5865-4bf7-96f4-2674fff40c33 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:16.696882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d18a9768-5865-4bf7-96f4-2674fff40c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:16.710520 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a9768-5865-4bf7-96f4-2674fff40c33 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:16.718129 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089741f-823f-45bc-941f-e2583e825130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:16.719132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089741f-823f-45bc-941f-e2583e825130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:16.719515 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089741f-823f-45bc-941f-e2583e825130 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:16.719796 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089741f-823f-45bc-941f-e2583e825130 admin admin] PATH_INFO: `/v3/users/aac9b12ddb9c4c8bb83e01005eb5b48d` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:16.721108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089741f-823f-45bc-941f-e2583e825130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aac9b12ddb9c4c8bb83e01005eb5b48d)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:16.724430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089741f-823f-45bc-941f-e2583e825130 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:16.726562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 991/1974] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:16 2022] PUT /identity/v3/projects/cfb016f2a8cf4a1bb5cae40f643168c8/users/78e7abd036fe405bafcbf7f8017136d8/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:16.731646 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8029150-63de-4a3a-aa0b-62075c492311 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:16.732307 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8029150-63de-4a3a-aa0b-62075c492311 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:16.732595 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8029150-63de-4a3a-aa0b-62075c492311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:16.750872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-b8029150-63de-4a3a-aa0b-62075c492311 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:16.752103 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-b8029150-63de-4a3a-aa0b-62075c492311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:16.813789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 992/1975] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:16.824591 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8029150-63de-4a3a-aa0b-62075c492311 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:16.826129 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-b8029150-63de-4a3a-aa0b-62075c492311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:16.884554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8029150-63de-4a3a-aa0b-62075c492311 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:16.888209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a2af9-f71c-418d-96c5-76725cc6e7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:16.888871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a2af9-f71c-418d-96c5-76725cc6e7af service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:16.889178 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a2af9-f71c-418d-96c5-76725cc6e7af service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:16.889488 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a2af9-f71c-418d-96c5-76725cc6e7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:16.899069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a2af9-f71c-418d-96c5-76725cc6e7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:16.900553 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a2af9-f71c-418d-96c5-76725cc6e7af service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:16.911047 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 993/1976] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:58:17.002267 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8089741f-823f-45bc-941f-e2583e825130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac9b12ddb9c4c8bb83e01005eb5b48d'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:17.017352 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8089741f-823f-45bc-941f-e2583e825130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac9b12ddb9c4c8bb83e01005eb5b48d'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:17.021946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:17.095523 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8089741f-823f-45bc-941f-e2583e825130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac9b12ddb9c4c8bb83e01005eb5b48d'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:17.096479 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8089741f-823f-45bc-941f-e2583e825130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac9b12ddb9c4c8bb83e01005eb5b48d'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:17.105406 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8089741f-823f-45bc-941f-e2583e825130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac9b12ddb9c4c8bb83e01005eb5b48d'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:17.111557 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 984/1977] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:16 2022] DELETE /identity/v3/users/aac9b12ddb9c4c8bb83e01005eb5b48d => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:58:17.116257 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98241b8b-bd71-4c8e-9183-07b3b50695b3 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:17.116615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98241b8b-bd71-4c8e-9183-07b3b50695b3 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:17.117023 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98241b8b-bd71-4c8e-9183-07b3b50695b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:17.138020 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-98241b8b-bd71-4c8e-9183-07b3b50695b3 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:17.139259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-98241b8b-bd71-4c8e-9183-07b3b50695b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:17.198475 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 994/1978] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:17.208921 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089741f-823f-45bc-941f-e2583e825130 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:17.210366 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-8089741f-823f-45bc-941f-e2583e825130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:17.282873 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089741f-823f-45bc-941f-e2583e825130 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:17.288554 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47688228-bbd7-4fca-92f6-45fe53bbc08d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:17.289794 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47688228-bbd7-4fca-92f6-45fe53bbc08d service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:17.290835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47688228-bbd7-4fca-92f6-45fe53bbc08d service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:17.291220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47688228-bbd7-4fca-92f6-45fe53bbc08d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:17.306380 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47688228-bbd7-4fca-92f6-45fe53bbc08d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:17.308794 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47688228-bbd7-4fca-92f6-45fe53bbc08d service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:17.321425 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 985/1979] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:18.035676 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98241b8b-bd71-4c8e-9183-07b3b50695b3 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:18.037881 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-98241b8b-bd71-4c8e-9183-07b3b50695b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:18.051197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98241b8b-bd71-4c8e-9183-07b3b50695b3 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:18.056241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351c633-4f98-47d8-85e9-2453af5aa4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:18.062480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351c633-4f98-47d8-85e9-2453af5aa4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:18.062480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351c633-4f98-47d8-85e9-2453af5aa4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:18.062480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351c633-4f98-47d8-85e9-2453af5aa4d0 admin admin] PATH_INFO: `/v3/projects/eb8cee8035254181915e88fed9322b46` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:18.062480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351c633-4f98-47d8-85e9-2453af5aa4d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb8cee8035254181915e88fed9322b46)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:18.062480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351c633-4f98-47d8-85e9-2453af5aa4d0 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:18.175752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:18.218231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-b351c633-4f98-47d8-85e9-2453af5aa4d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb8cee8035254181915e88fed9322b46', 'request_id': 'req-b351c633-4f98-47d8-85e9-2453af5aa4d0'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:18.225461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-b351c633-4f98-47d8-85e9-2453af5aa4d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb8cee8035254181915e88fed9322b46', 'request_id': 'req-b351c633-4f98-47d8-85e9-2453af5aa4d0'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:18.231814 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-b351c633-4f98-47d8-85e9-2453af5aa4d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb8cee8035254181915e88fed9322b46', 'request_id': 'req-b351c633-4f98-47d8-85e9-2453af5aa4d0'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:18.312597 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-b351c633-4f98-47d8-85e9-2453af5aa4d0 admin admin] The token cache is being invalidate because project eb8cee8035254181915e88fed9322b46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:18.313919 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-b351c633-4f98-47d8-85e9-2453af5aa4d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:18.315972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-b351c633-4f98-47d8-85e9-2453af5aa4d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:18.317878 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 995/1980] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:18 2022] DELETE /identity/v3/projects/eb8cee8035254181915e88fed9322b46 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:18.326257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47688228-bbd7-4fca-92f6-45fe53bbc08d service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:18.339383 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47688228-bbd7-4fca-92f6-45fe53bbc08d service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:18.410091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff8119-d1a7-40d0-8762-9c4ee1d23b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:18.410951 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff8119-d1a7-40d0-8762-9c4ee1d23b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:18.411235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff8119-d1a7-40d0-8762-9c4ee1d23b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:18.411513 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff8119-d1a7-40d0-8762-9c4ee1d23b4a admin admin] PATH_INFO: `/v3/users/ba4227098dbd44b9bc852339f7952399` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:18.412773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff8119-d1a7-40d0-8762-9c4ee1d23b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba4227098dbd44b9bc852339f7952399)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:18.414730 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff8119-d1a7-40d0-8762-9c4ee1d23b4a admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:18.435709 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b11d7-f2fd-4dc3-8368-21e5e958d7cc None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:18.436427 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b11d7-f2fd-4dc3-8368-21e5e958d7cc None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:18.437278 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b11d7-f2fd-4dc3-8368-21e5e958d7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:18.469275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-6d6b11d7-f2fd-4dc3-8368-21e5e958d7cc None None] MFA Rules not processed for user `78e7abd036fe405bafcbf7f8017136d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:18.470495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-6d6b11d7-f2fd-4dc3-8368-21e5e958d7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:18.481184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:18.548795 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 996/1981] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:58:18.554033 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b11d7-f2fd-4dc3-8368-21e5e958d7cc None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:18.555356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-6d6b11d7-f2fd-4dc3-8368-21e5e958d7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:18.566968 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-70ff8119-d1a7-40d0-8762-9c4ee1d23b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba4227098dbd44b9bc852339f7952399'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:18.569066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b11d7-f2fd-4dc3-8368-21e5e958d7cc None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:18.574055 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb901b-3a4c-4ac4-9d34-55ef0f6ef05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:18.574880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb901b-3a4c-4ac4-9d34-55ef0f6ef05c admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:18.575095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb901b-3a4c-4ac4-9d34-55ef0f6ef05c admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:18.575379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb901b-3a4c-4ac4-9d34-55ef0f6ef05c admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:18.576153 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb901b-3a4c-4ac4-9d34-55ef0f6ef05c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:18.579624 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb901b-3a4c-4ac4-9d34-55ef0f6ef05c admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:18.579845 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-70ff8119-d1a7-40d0-8762-9c4ee1d23b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba4227098dbd44b9bc852339f7952399'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:18.707562 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-70ff8119-d1a7-40d0-8762-9c4ee1d23b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba4227098dbd44b9bc852339f7952399'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:18.708255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-70ff8119-d1a7-40d0-8762-9c4ee1d23b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba4227098dbd44b9bc852339f7952399'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:18.718153 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 997/1982] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:18 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:58:18.718326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-70ff8119-d1a7-40d0-8762-9c4ee1d23b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba4227098dbd44b9bc852339f7952399'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:18.719176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb901b-3a4c-4ac4-9d34-55ef0f6ef05c admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:18.720726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-65fb901b-3a4c-4ac4-9d34-55ef0f6ef05c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:18.722602 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 986/1983] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:18 2022] DELETE /identity/v3/users/ba4227098dbd44b9bc852339f7952399 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:18.790310 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb901b-3a4c-4ac4-9d34-55ef0f6ef05c admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:18.860833 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5735c-607d-426e-a508-88e8f2e581ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:18.860833 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5735c-607d-426e-a508-88e8f2e581ff admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:18.860833 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5735c-607d-426e-a508-88e8f2e581ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:18.860833 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5735c-607d-426e-a508-88e8f2e581ff admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:18.861461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5735c-607d-426e-a508-88e8f2e581ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:18.861461 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5735c-607d-426e-a508-88e8f2e581ff admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:18.979647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 998/1984] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:18 2022] POST /identity/v3/users => generated 292 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:18.982528 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff8119-d1a7-40d0-8762-9c4ee1d23b4a admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:18.993295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff8119-d1a7-40d0-8762-9c4ee1d23b4a admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:18.998409 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10aa57-bed5-40f4-978e-9de482586015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:18.999290 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10aa57-bed5-40f4-978e-9de482586015 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:18.999749 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10aa57-bed5-40f4-978e-9de482586015 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:19.000369 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10aa57-bed5-40f4-978e-9de482586015 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:19.001334 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10aa57-bed5-40f4-978e-9de482586015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:19.003250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10aa57-bed5-40f4-978e-9de482586015 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:19.015714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 987/1985] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:19.020309 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5735c-607d-426e-a508-88e8f2e581ff admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:19.032200 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5735c-607d-426e-a508-88e8f2e581ff admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:19.039473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7788f-0a52-43cf-b629-6f36bacb5ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:19.040370 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7788f-0a52-43cf-b629-6f36bacb5ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:19.040656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7788f-0a52-43cf-b629-6f36bacb5ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:19.040933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7788f-0a52-43cf-b629-6f36bacb5ce1 admin admin] PATH_INFO: `/v3/projects/bcee92d79d3c4e0285aa3bc12d8375df/users/d8b1ced278f443a691d7506cdb8d5db8/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:19.059797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7788f-0a52-43cf-b629-6f36bacb5ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcee92d79d3c4e0285aa3bc12d8375df, user_id=d8b1ced278f443a691d7506cdb8d5db8, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:19.062705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7788f-0a52-43cf-b629-6f36bacb5ce1 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:19.100898 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10aa57-bed5-40f4-978e-9de482586015 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:19.102677 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-4a10aa57-bed5-40f4-978e-9de482586015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:19.143165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 999/1986] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:19 2022] PUT /identity/v3/projects/bcee92d79d3c4e0285aa3bc12d8375df/users/d8b1ced278f443a691d7506cdb8d5db8/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:19.150428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7788f-0a52-43cf-b629-6f36bacb5ce1 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:19.166301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:19.170784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10aa57-bed5-40f4-978e-9de482586015 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:19.238655 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7788f-0a52-43cf-b629-6f36bacb5ce1 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:19.239939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acab67e-3549-4374-9d85-4c67e36c2e93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:19.240640 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acab67e-3549-4374-9d85-4c67e36c2e93 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:19.240938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acab67e-3549-4374-9d85-4c67e36c2e93 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:19.241249 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acab67e-3549-4374-9d85-4c67e36c2e93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:19.243193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-0acab67e-3549-4374-9d85-4c67e36c2e93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:19.245351 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94df92-4ec0-4273-8953-9862787808cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:19.246120 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94df92-4ec0-4273-8953-9862787808cb admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:19.246412 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94df92-4ec0-4273-8953-9862787808cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:19.246693 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94df92-4ec0-4273-8953-9862787808cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:19.247449 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94df92-4ec0-4273-8953-9862787808cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:19.249110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94df92-4ec0-4273-8953-9862787808cb admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:19.261198 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1000/1987] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:58:19.261670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94df92-4ec0-4273-8953-9862787808cb admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:19.265418 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0b94df92-4ec0-4273-8953-9862787808cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:19.278835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94df92-4ec0-4273-8953-9862787808cb admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:19.283543 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044e333-7df6-47c8-9240-001f9f25aec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:19.284546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044e333-7df6-47c8-9240-001f9f25aec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:19.284843 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044e333-7df6-47c8-9240-001f9f25aec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:19.290525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044e333-7df6-47c8-9240-001f9f25aec0 admin admin] PATH_INFO: `/v3/projects/bf51d0539caa4946b1a55ac46426c7d5` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:19.290525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044e333-7df6-47c8-9240-001f9f25aec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf51d0539caa4946b1a55ac46426c7d5)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:19.290525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044e333-7df6-47c8-9240-001f9f25aec0 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:19.304092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acab67e-3549-4374-9d85-4c67e36c2e93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:19.305842 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acab67e-3549-4374-9d85-4c67e36c2e93 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:19.315048 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 988/1988] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:58:19.316585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acab67e-3549-4374-9d85-4c67e36c2e93 service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:19.327008 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acab67e-3549-4374-9d85-4c67e36c2e93 service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:19.332395 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75ecc3-e5cc-46c3-97af-6633b03dc2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:19.333387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75ecc3-e5cc-46c3-97af-6633b03dc2c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:19.333691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75ecc3-e5cc-46c3-97af-6633b03dc2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:19.333979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75ecc3-e5cc-46c3-97af-6633b03dc2c8 admin admin] PATH_INFO: `/v3/projects/bcee92d79d3c4e0285aa3bc12d8375df/users/d8b1ced278f443a691d7506cdb8d5db8/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:19.336032 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75ecc3-e5cc-46c3-97af-6633b03dc2c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcee92d79d3c4e0285aa3bc12d8375df, user_id=d8b1ced278f443a691d7506cdb8d5db8, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:19.338710 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75ecc3-e5cc-46c3-97af-6633b03dc2c8 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:19.350222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 989/1989] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:19 2022] PUT /identity/v3/projects/bcee92d79d3c4e0285aa3bc12d8375df/users/d8b1ced278f443a691d7506cdb8d5db8/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:19.433853 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2044e333-7df6-47c8-9240-001f9f25aec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf51d0539caa4946b1a55ac46426c7d5', 'request_id': 'req-2044e333-7df6-47c8-9240-001f9f25aec0'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:19.441119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2044e333-7df6-47c8-9240-001f9f25aec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf51d0539caa4946b1a55ac46426c7d5', 'request_id': 'req-2044e333-7df6-47c8-9240-001f9f25aec0'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:19.447018 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2044e333-7df6-47c8-9240-001f9f25aec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf51d0539caa4946b1a55ac46426c7d5', 'request_id': 'req-2044e333-7df6-47c8-9240-001f9f25aec0'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:19.581738 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2044e333-7df6-47c8-9240-001f9f25aec0 admin admin] The token cache is being invalidate because project bf51d0539caa4946b1a55ac46426c7d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:19.581738 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2044e333-7df6-47c8-9240-001f9f25aec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:19.581738 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2044e333-7df6-47c8-9240-001f9f25aec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:19.581738 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1001/1990] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:19 2022] DELETE /identity/v3/projects/bf51d0539caa4946b1a55ac46426c7d5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:19.582794 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec818eb-a548-42fe-a71a-0e456be791e9 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:19.582794 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec818eb-a548-42fe-a71a-0e456be791e9 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:19.582794 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec818eb-a548-42fe-a71a-0e456be791e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:19.603105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-dec818eb-a548-42fe-a71a-0e456be791e9 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:19.603105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-dec818eb-a548-42fe-a71a-0e456be791e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:19.661677 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 990/1991] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:19.669252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c860f17-7c67-4875-a0e4-ad4470fca8fd None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:19.669541 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c860f17-7c67-4875-a0e4-ad4470fca8fd None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:19.670261 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c860f17-7c67-4875-a0e4-ad4470fca8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:19.688456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-2c860f17-7c67-4875-a0e4-ad4470fca8fd None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:19.694482 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-2c860f17-7c67-4875-a0e4-ad4470fca8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:19.701444 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1002/1992] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:58:19.706061 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec818eb-a548-42fe-a71a-0e456be791e9 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:19.716221 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec818eb-a548-42fe-a71a-0e456be791e9 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:19.721931 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5214da-ff0b-4869-8e02-aba7947f9fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:19.722904 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5214da-ff0b-4869-8e02-aba7947f9fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:19.723365 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5214da-ff0b-4869-8e02-aba7947f9fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:19.723775 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5214da-ff0b-4869-8e02-aba7947f9fd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:19.725412 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5214da-ff0b-4869-8e02-aba7947f9fd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:58:19.725734 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5214da-ff0b-4869-8e02-aba7947f9fd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:19.727344 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5214da-ff0b-4869-8e02-aba7947f9fd6 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:19.741679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 991/1993] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:58:19.746275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c860f17-7c67-4875-a0e4-ad4470fca8fd None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:19.757211 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c860f17-7c67-4875-a0e4-ad4470fca8fd None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:19.762060 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc30f4-c02a-4176-9f7c-f70c334826d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:19.762795 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc30f4-c02a-4176-9f7c-f70c334826d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:19.763146 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc30f4-c02a-4176-9f7c-f70c334826d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:19.763521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc30f4-c02a-4176-9f7c-f70c334826d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:19.764326 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc30f4-c02a-4176-9f7c-f70c334826d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:19.766344 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc30f4-c02a-4176-9f7c-f70c334826d6 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:19.876027 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1003/1994] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:19 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:19.877198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5214da-ff0b-4869-8e02-aba7947f9fd6 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:19.888971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5214da-ff0b-4869-8e02-aba7947f9fd6 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:19.964521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c552ac-20f2-4a82-9ba5-e90190f93211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:19.965959 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c552ac-20f2-4a82-9ba5-e90190f93211 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:19.966483 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c552ac-20f2-4a82-9ba5-e90190f93211 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:19.967241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c552ac-20f2-4a82-9ba5-e90190f93211 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:19.968515 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c552ac-20f2-4a82-9ba5-e90190f93211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:19.973582 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c552ac-20f2-4a82-9ba5-e90190f93211 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:20.163680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 992/1995] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:19 2022] POST /identity/v3/users => generated 294 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:20.164890 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc30f4-c02a-4176-9f7c-f70c334826d6 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:20.176811 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc30f4-c02a-4176-9f7c-f70c334826d6 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:20.190828 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f8c4a-0028-4cb6-97d5-f57e27a13a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:20.195163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f8c4a-0028-4cb6-97d5-f57e27a13a7e admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:20.195662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f8c4a-0028-4cb6-97d5-f57e27a13a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:20.196112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f8c4a-0028-4cb6-97d5-f57e27a13a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:20.197082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f8c4a-0028-4cb6-97d5-f57e27a13a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:20.198996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f8c4a-0028-4cb6-97d5-f57e27a13a7e admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:20.222774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1004/1996] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:20.224139 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c552ac-20f2-4a82-9ba5-e90190f93211 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:20.235955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c552ac-20f2-4a82-9ba5-e90190f93211 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:20.247477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada91a2-5c42-4006-8e0c-7c430aabcd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:20.250000 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada91a2-5c42-4006-8e0c-7c430aabcd1d admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:20.250721 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada91a2-5c42-4006-8e0c-7c430aabcd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:20.251854 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada91a2-5c42-4006-8e0c-7c430aabcd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:20.252737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada91a2-5c42-4006-8e0c-7c430aabcd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:20.255877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada91a2-5c42-4006-8e0c-7c430aabcd1d admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:20.273656 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 993/1997] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:20.276312 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f8c4a-0028-4cb6-97d5-f57e27a13a7e admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:20.289388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f8c4a-0028-4cb6-97d5-f57e27a13a7e admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:20.294892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2078d5-c31a-4ca0-a8ce-c87e3d3e7df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:20.295781 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2078d5-c31a-4ca0-a8ce-c87e3d3e7df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:20.296719 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2078d5-c31a-4ca0-a8ce-c87e3d3e7df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:20.297004 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2078d5-c31a-4ca0-a8ce-c87e3d3e7df5 admin admin] PATH_INFO: `/v3/projects/2ca339892efe4fd4b76ab4ec98c5bcd6/users/50a2187d233a4940970c03189d1309e4/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:20.315070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2078d5-c31a-4ca0-a8ce-c87e3d3e7df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca339892efe4fd4b76ab4ec98c5bcd6, user_id=50a2187d233a4940970c03189d1309e4, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:20.319079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2078d5-c31a-4ca0-a8ce-c87e3d3e7df5 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:20.402726 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada91a2-5c42-4006-8e0c-7c430aabcd1d admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:20.405375 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-dada91a2-5c42-4006-8e0c-7c430aabcd1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:20.418241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1005/1998] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:20 2022] PUT /identity/v3/projects/2ca339892efe4fd4b76ab4ec98c5bcd6/users/50a2187d233a4940970c03189d1309e4/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:20.420206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada91a2-5c42-4006-8e0c-7c430aabcd1d admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:20.420971 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051682e-72dd-4bf7-a15d-268c75e71b24 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:20.421402 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051682e-72dd-4bf7-a15d-268c75e71b24 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:20.421686 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051682e-72dd-4bf7-a15d-268c75e71b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:20.452565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-d051682e-72dd-4bf7-a15d-268c75e71b24 None None] MFA Rules not processed for user `50a2187d233a4940970c03189d1309e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:20.454009 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d051682e-72dd-4bf7-a15d-268c75e71b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:20.475730 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:20.500139 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98954cca-3592-44f5-92c3-03ac684fc349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:20.501673 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98954cca-3592-44f5-92c3-03ac684fc349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:20.502186 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98954cca-3592-44f5-92c3-03ac684fc349 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:20.504463 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98954cca-3592-44f5-92c3-03ac684fc349 admin admin] PATH_INFO: `/v3/users/99a04818ed364be7be9ed8b5a83e0814` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:20.506927 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98954cca-3592-44f5-92c3-03ac684fc349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99a04818ed364be7be9ed8b5a83e0814)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:20.510164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98954cca-3592-44f5-92c3-03ac684fc349 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:20.547513 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1006/1999] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:20.558204 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051682e-72dd-4bf7-a15d-268c75e71b24 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:20.577959 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051682e-72dd-4bf7-a15d-268c75e71b24 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:20.582907 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f004a98-ed8a-40c7-8c54-3e45148f0d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:20.583698 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f004a98-ed8a-40c7-8c54-3e45148f0d3e admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:20.583992 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f004a98-ed8a-40c7-8c54-3e45148f0d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:20.584274 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f004a98-ed8a-40c7-8c54-3e45148f0d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:20.585093 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f004a98-ed8a-40c7-8c54-3e45148f0d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:20.587204 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f004a98-ed8a-40c7-8c54-3e45148f0d3e admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:20.693879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1007/2000] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:20 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:58:20.697646 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f004a98-ed8a-40c7-8c54-3e45148f0d3e admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:20.793404 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f004a98-ed8a-40c7-8c54-3e45148f0d3e admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:20.801512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fb434-088f-4163-8835-f6859041304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:20.802301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fb434-088f-4163-8835-f6859041304d admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:20.802589 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fb434-088f-4163-8835-f6859041304d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:20.802870 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fb434-088f-4163-8835-f6859041304d admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:20.803583 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fb434-088f-4163-8835-f6859041304d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:20.805630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fb434-088f-4163-8835-f6859041304d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:20.816772 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-98954cca-3592-44f5-92c3-03ac684fc349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99a04818ed364be7be9ed8b5a83e0814'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:20.858573 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-98954cca-3592-44f5-92c3-03ac684fc349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99a04818ed364be7be9ed8b5a83e0814'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:20.938603 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-98954cca-3592-44f5-92c3-03ac684fc349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99a04818ed364be7be9ed8b5a83e0814'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:20.939355 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-98954cca-3592-44f5-92c3-03ac684fc349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99a04818ed364be7be9ed8b5a83e0814'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:20.947042 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1008/2001] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:20 2022] POST /identity/v3/users => generated 299 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:58:20.950133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b774f44-6e2c-4fc2-9fcc-9299f4d4bb65 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:20.952920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b774f44-6e2c-4fc2-9fcc-9299f4d4bb65 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:20.953243 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b774f44-6e2c-4fc2-9fcc-9299f4d4bb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:20.954881 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-98954cca-3592-44f5-92c3-03ac684fc349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99a04818ed364be7be9ed8b5a83e0814'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:20.974265 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 994/2002] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:20 2022] DELETE /identity/v3/users/99a04818ed364be7be9ed8b5a83e0814 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:20.975245 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98954cca-3592-44f5-92c3-03ac684fc349 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:20.986395 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-98954cca-3592-44f5-92c3-03ac684fc349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:21.033868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-5b774f44-6e2c-4fc2-9fcc-9299f4d4bb65 None None] MFA Rules not processed for user `d8b1ced278f443a691d7506cdb8d5db8`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:21.033868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-5b774f44-6e2c-4fc2-9fcc-9299f4d4bb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:21.152291 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98954cca-3592-44f5-92c3-03ac684fc349 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:21.156496 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1009/2003] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:20 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:21.157819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c41189-1de4-4fb5-b9d2-53d946998564 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:21.158122 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c41189-1de4-4fb5-b9d2-53d946998564 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:21.158407 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c41189-1de4-4fb5-b9d2-53d946998564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:21.169013 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db674d6-2881-4bd2-8b1f-85ca8b54282e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:21.169773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db674d6-2881-4bd2-8b1f-85ca8b54282e admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:21.170005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db674d6-2881-4bd2-8b1f-85ca8b54282e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:21.170283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db674d6-2881-4bd2-8b1f-85ca8b54282e admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:21.171022 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db674d6-2881-4bd2-8b1f-85ca8b54282e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:21.172622 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db674d6-2881-4bd2-8b1f-85ca8b54282e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:21.181254 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-34c41189-1de4-4fb5-b9d2-53d946998564 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:21.182483 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-34c41189-1de4-4fb5-b9d2-53d946998564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:21.185116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 995/2004] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:21.189796 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a225be1-0abd-4519-a3d8-cb087c647f89 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:21.190578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a225be1-0abd-4519-a3d8-cb087c647f89 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:21.190578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a225be1-0abd-4519-a3d8-cb087c647f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:21.191224 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1010/2005] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:21.194071 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c41189-1de4-4fb5-b9d2-53d946998564 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:21.206678 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c41189-1de4-4fb5-b9d2-53d946998564 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:21.213253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-5a225be1-0abd-4519-a3d8-cb087c647f89 None None] MFA Rules not processed for user `78e7abd036fe405bafcbf7f8017136d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:21.213512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ef43d-ba90-46e7-8a49-fb55c389ff3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:21.214418 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-5a225be1-0abd-4519-a3d8-cb087c647f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:21.214895 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ef43d-ba90-46e7-8a49-fb55c389ff3e admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:21.215576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ef43d-ba90-46e7-8a49-fb55c389ff3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:21.216165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ef43d-ba90-46e7-8a49-fb55c389ff3e admin admin] PATH_INFO: `/v3/projects/9002309214234ff0acff7abc1ec2e8c3/users/87e66cd65e9b49c7a0a9b7170f43563e/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:21.242560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ef43d-ba90-46e7-8a49-fb55c389ff3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9002309214234ff0acff7abc1ec2e8c3, user_id=87e66cd65e9b49c7a0a9b7170f43563e, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:21.246170 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ef43d-ba90-46e7-8a49-fb55c389ff3e admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:21.285316 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 996/2006] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:21.286044 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a225be1-0abd-4519-a3d8-cb087c647f89 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:21.288607 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-5a225be1-0abd-4519-a3d8-cb087c647f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:21.349935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1011/2007] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:21 2022] PUT /identity/v3/projects/9002309214234ff0acff7abc1ec2e8c3/users/87e66cd65e9b49c7a0a9b7170f43563e/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:21.351082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ef43d-ba90-46e7-8a49-fb55c389ff3e admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:21.352890 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e19ef43d-ba90-46e7-8a49-fb55c389ff3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:21.353323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a225be1-0abd-4519-a3d8-cb087c647f89 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:21.405588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29e21a-6981-48a5-b40a-35a9dca20f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:21.406634 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29e21a-6981-48a5-b40a-35a9dca20f94 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:21.407415 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29e21a-6981-48a5-b40a-35a9dca20f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:21.407747 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29e21a-6981-48a5-b40a-35a9dca20f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:21.437811 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ef43d-ba90-46e7-8a49-fb55c389ff3e admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:21.445910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27614d-65a2-431d-a73c-c8426358fc47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:21.447353 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27614d-65a2-431d-a73c-c8426358fc47 service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:21.447786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27614d-65a2-431d-a73c-c8426358fc47 service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:21.448141 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27614d-65a2-431d-a73c-c8426358fc47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:21.450227 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ac27614d-65a2-431d-a73c-c8426358fc47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:21.518422 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29e21a-6981-48a5-b40a-35a9dca20f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:21.522330 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29e21a-6981-48a5-b40a-35a9dca20f94 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:21.551175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 997/2008] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:21.552402 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29e21a-6981-48a5-b40a-35a9dca20f94 service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:21.563045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29e21a-6981-48a5-b40a-35a9dca20f94 service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:21.566474 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27614d-65a2-431d-a73c-c8426358fc47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:21.568671 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27614d-65a2-431d-a73c-c8426358fc47 service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:21.569122 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2867c97-d721-4bec-9f29-41dedde2aa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:21.573905 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2867c97-d721-4bec-9f29-41dedde2aa56 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:21.573905 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2867c97-d721-4bec-9f29-41dedde2aa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:21.573905 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2867c97-d721-4bec-9f29-41dedde2aa56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:21.573905 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2867c97-d721-4bec-9f29-41dedde2aa56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:21.573905 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2867c97-d721-4bec-9f29-41dedde2aa56 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:21.580188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1012/2009] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:21.596363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=87,keystone:DELETE=8,keystone:INSERT=5 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:21.602510 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 998/2010] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:21.606274 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27614d-65a2-431d-a73c-c8426358fc47 service nova] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:21.620241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27614d-65a2-431d-a73c-c8426358fc47 service nova] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:21.626789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d177e-166a-4004-8cae-f303dd0293f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:21.628652 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d177e-166a-4004-8cae-f303dd0293f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:21.629692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d177e-166a-4004-8cae-f303dd0293f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:21.636944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d177e-166a-4004-8cae-f303dd0293f2 admin admin] PATH_INFO: `/v3/projects/9002309214234ff0acff7abc1ec2e8c3/users/87e66cd65e9b49c7a0a9b7170f43563e/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:21.636944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d177e-166a-4004-8cae-f303dd0293f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9002309214234ff0acff7abc1ec2e8c3, user_id=87e66cd65e9b49c7a0a9b7170f43563e, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:21.636944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d177e-166a-4004-8cae-f303dd0293f2 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:21.669532 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1013/2011] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:21 2022] PUT /identity/v3/projects/9002309214234ff0acff7abc1ec2e8c3/users/87e66cd65e9b49c7a0a9b7170f43563e/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:21.673655 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43d371-3f8c-43ba-b1a4-2b9ab632d70a None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:21.674142 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43d371-3f8c-43ba-b1a4-2b9ab632d70a None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:21.674529 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43d371-3f8c-43ba-b1a4-2b9ab632d70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:21.707780 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-8b43d371-3f8c-43ba-b1a4-2b9ab632d70a None None] MFA Rules not processed for user `87e66cd65e9b49c7a0a9b7170f43563e`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:21.709541 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-8b43d371-3f8c-43ba-b1a4-2b9ab632d70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:21.846644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 999/2012] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:21.859912 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d177e-166a-4004-8cae-f303dd0293f2 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:21.863805 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-840d177e-166a-4004-8cae-f303dd0293f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:21.968734 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d177e-166a-4004-8cae-f303dd0293f2 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:21.975107 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520d29f-8288-425b-bf67-0accdfa5810d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:21.976326 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520d29f-8288-425b-bf67-0accdfa5810d service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:21.976615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520d29f-8288-425b-bf67-0accdfa5810d service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:21.976905 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520d29f-8288-425b-bf67-0accdfa5810d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:21.989536 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520d29f-8288-425b-bf67-0accdfa5810d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:21.992353 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520d29f-8288-425b-bf67-0accdfa5810d service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:22.002840 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1014/2013] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:22.091953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43d371-3f8c-43ba-b1a4-2b9ab632d70a None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:22.097783 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-8b43d371-3f8c-43ba-b1a4-2b9ab632d70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:22.207750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43d371-3f8c-43ba-b1a4-2b9ab632d70a None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:22.213559 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170c116-3937-4f9d-92b9-853c834b7a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:22.214452 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170c116-3937-4f9d-92b9-853c834b7a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:22.214737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170c116-3937-4f9d-92b9-853c834b7a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:22.215028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170c116-3937-4f9d-92b9-853c834b7a37 admin admin] PATH_INFO: `/v3/projects/931c40f9cbd14128bf6ab128bb026bb1` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:22.216215 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170c116-3937-4f9d-92b9-853c834b7a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=931c40f9cbd14128bf6ab128bb026bb1)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:22.218486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170c116-3937-4f9d-92b9-853c834b7a37 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:22.369832 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1170c116-3937-4f9d-92b9-853c834b7a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '931c40f9cbd14128bf6ab128bb026bb1', 'request_id': 'req-1170c116-3937-4f9d-92b9-853c834b7a37'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:22.376022 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1170c116-3937-4f9d-92b9-853c834b7a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '931c40f9cbd14128bf6ab128bb026bb1', 'request_id': 'req-1170c116-3937-4f9d-92b9-853c834b7a37'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:22.381679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1170c116-3937-4f9d-92b9-853c834b7a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '931c40f9cbd14128bf6ab128bb026bb1', 'request_id': 'req-1170c116-3937-4f9d-92b9-853c834b7a37'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:22.502923 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1170c116-3937-4f9d-92b9-853c834b7a37 admin admin] The token cache is being invalidate because project 931c40f9cbd14128bf6ab128bb026bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:22.503174 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1170c116-3937-4f9d-92b9-853c834b7a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:22.504177 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1170c116-3937-4f9d-92b9-853c834b7a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:22.508271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1000/2014] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:22 2022] DELETE /identity/v3/projects/931c40f9cbd14128bf6ab128bb026bb1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:22.512333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520d29f-8288-425b-bf67-0accdfa5810d service cinder] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:22.529510 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520d29f-8288-425b-bf67-0accdfa5810d service cinder] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:22.609447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b70210-4d9c-4989-af25-d6a94903282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:22.610436 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b70210-4d9c-4989-af25-d6a94903282f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:22.610725 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b70210-4d9c-4989-af25-d6a94903282f admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:22.611089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b70210-4d9c-4989-af25-d6a94903282f admin admin] PATH_INFO: `/v3/users/fb902d70e07040e78bea18e3f5cb1b06` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:22.612872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b70210-4d9c-4989-af25-d6a94903282f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb902d70e07040e78bea18e3f5cb1b06)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:22.615312 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b70210-4d9c-4989-af25-d6a94903282f admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:22.943038 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-80b70210-4d9c-4989-af25-d6a94903282f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb902d70e07040e78bea18e3f5cb1b06'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:22.980329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-80b70210-4d9c-4989-af25-d6a94903282f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb902d70e07040e78bea18e3f5cb1b06'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:23.083786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-80b70210-4d9c-4989-af25-d6a94903282f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb902d70e07040e78bea18e3f5cb1b06'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:23.084485 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-80b70210-4d9c-4989-af25-d6a94903282f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb902d70e07040e78bea18e3f5cb1b06'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:23.104658 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-80b70210-4d9c-4989-af25-d6a94903282f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb902d70e07040e78bea18e3f5cb1b06'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:23.117119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1015/2015] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:22 2022] DELETE /identity/v3/users/fb902d70e07040e78bea18e3f5cb1b06 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:23.468795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170c116-3937-4f9d-92b9-853c834b7a37 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:23.470338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-1170c116-3937-4f9d-92b9-853c834b7a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:23.493796 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170c116-3937-4f9d-92b9-853c834b7a37 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:23.592097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036d638-ea8a-420e-a0ad-678e661dd410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:23.593291 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036d638-ea8a-420e-a0ad-678e661dd410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:23.593584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036d638-ea8a-420e-a0ad-678e661dd410 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:23.593909 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036d638-ea8a-420e-a0ad-678e661dd410 admin admin] PATH_INFO: `/v3/users/50a2187d233a4940970c03189d1309e4` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:23.595178 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036d638-ea8a-420e-a0ad-678e661dd410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a2187d233a4940970c03189d1309e4)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:23.600981 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036d638-ea8a-420e-a0ad-678e661dd410 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:23.729086 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b70210-4d9c-4989-af25-d6a94903282f admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:23.730837 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-80b70210-4d9c-4989-af25-d6a94903282f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:23.750343 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b70210-4d9c-4989-af25-d6a94903282f admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:23.756339 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5f294-cc48-486e-86e1-8e57a4eb8f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:23.757643 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5f294-cc48-486e-86e1-8e57a4eb8f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:23.765773 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5f294-cc48-486e-86e1-8e57a4eb8f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:23.766232 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5f294-cc48-486e-86e1-8e57a4eb8f5f admin admin] PATH_INFO: `/v3/projects/64635bd06e3e4fc2ae1f095a12b12cfe` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:23.767655 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5f294-cc48-486e-86e1-8e57a4eb8f5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=64635bd06e3e4fc2ae1f095a12b12cfe)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:23.770760 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5f294-cc48-486e-86e1-8e57a4eb8f5f admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:23.852090 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:23.865986 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d036d638-ea8a-420e-a0ad-678e661dd410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a2187d233a4940970c03189d1309e4'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:23.883524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d036d638-ea8a-420e-a0ad-678e661dd410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a2187d233a4940970c03189d1309e4'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:23.953072 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6de5f294-cc48-486e-86e1-8e57a4eb8f5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64635bd06e3e4fc2ae1f095a12b12cfe', 'request_id': 'req-6de5f294-cc48-486e-86e1-8e57a4eb8f5f'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:23.960374 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6de5f294-cc48-486e-86e1-8e57a4eb8f5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64635bd06e3e4fc2ae1f095a12b12cfe', 'request_id': 'req-6de5f294-cc48-486e-86e1-8e57a4eb8f5f'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:23.966051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6de5f294-cc48-486e-86e1-8e57a4eb8f5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64635bd06e3e4fc2ae1f095a12b12cfe', 'request_id': 'req-6de5f294-cc48-486e-86e1-8e57a4eb8f5f'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:23.973942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d036d638-ea8a-420e-a0ad-678e661dd410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a2187d233a4940970c03189d1309e4'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:23.974694 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d036d638-ea8a-420e-a0ad-678e661dd410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a2187d233a4940970c03189d1309e4'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:23.982608 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d036d638-ea8a-420e-a0ad-678e661dd410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a2187d233a4940970c03189d1309e4'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:23.991040 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1001/2016] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:23 2022] DELETE /identity/v3/users/50a2187d233a4940970c03189d1309e4 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:23.995547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef363c-13b0-4b8d-965d-c5feca80e608 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:23.996222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef363c-13b0-4b8d-965d-c5feca80e608 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:23.996578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef363c-13b0-4b8d-965d-c5feca80e608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:24.014441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-05ef363c-13b0-4b8d-965d-c5feca80e608 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:24.015597 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-05ef363c-13b0-4b8d-965d-c5feca80e608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:24.086300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1002/2017] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:24.097263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef363c-13b0-4b8d-965d-c5feca80e608 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:24.098992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-05ef363c-13b0-4b8d-965d-c5feca80e608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:24.127044 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6de5f294-cc48-486e-86e1-8e57a4eb8f5f admin admin] The token cache is being invalidate because project 64635bd06e3e4fc2ae1f095a12b12cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:24.127346 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6de5f294-cc48-486e-86e1-8e57a4eb8f5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:24.128127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6de5f294-cc48-486e-86e1-8e57a4eb8f5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:24.130339 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1016/2018] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:23 2022] DELETE /identity/v3/projects/64635bd06e3e4fc2ae1f095a12b12cfe => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:24.141939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05756d05-e8bb-4f22-a831-f220e6412402 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:24.142227 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05756d05-e8bb-4f22-a831-f220e6412402 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:24.142512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05756d05-e8bb-4f22-a831-f220e6412402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:24.170082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-05756d05-e8bb-4f22-a831-f220e6412402 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:24.172018 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-05756d05-e8bb-4f22-a831-f220e6412402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:24.192273 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1017/2019] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:58:24.192618 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef363c-13b0-4b8d-965d-c5feca80e608 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:24.194946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a4810-4a1b-42b7-b340-ca81e1b04e95 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:24.195351 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a4810-4a1b-42b7-b340-ca81e1b04e95 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:24.195778 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a4810-4a1b-42b7-b340-ca81e1b04e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:24.196083 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93437efe-a253-44ac-ae50-29dcaf45a736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:24.196757 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93437efe-a253-44ac-ae50-29dcaf45a736 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:24.197047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93437efe-a253-44ac-ae50-29dcaf45a736 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:24.197362 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93437efe-a253-44ac-ae50-29dcaf45a736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:24.199540 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-93437efe-a253-44ac-ae50-29dcaf45a736 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:24.213145 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93437efe-a253-44ac-ae50-29dcaf45a736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:24.214987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93437efe-a253-44ac-ae50-29dcaf45a736 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:24.226001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1003/2020] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:24.229696 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-273a4810-4a1b-42b7-b340-ca81e1b04e95 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:24.231165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-273a4810-4a1b-42b7-b340-ca81e1b04e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:24.246003 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1018/2021] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:24.251907 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93437efe-a253-44ac-ae50-29dcaf45a736 service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:24.269082 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93437efe-a253-44ac-ae50-29dcaf45a736 service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:24.276654 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34a8ad-204a-4f07-a795-62fba4a6c506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:24.282294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34a8ad-204a-4f07-a795-62fba4a6c506 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:24.282294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34a8ad-204a-4f07-a795-62fba4a6c506 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:24.282294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34a8ad-204a-4f07-a795-62fba4a6c506 admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:24.282294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34a8ad-204a-4f07-a795-62fba4a6c506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:58:24.282294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34a8ad-204a-4f07-a795-62fba4a6c506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:24.282294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34a8ad-204a-4f07-a795-62fba4a6c506 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:24.297262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1004/2022] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:58:24.298681 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a4810-4a1b-42b7-b340-ca81e1b04e95 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:24.310928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a4810-4a1b-42b7-b340-ca81e1b04e95 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:24.317012 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a55a6-0530-47cc-842f-a7ddc57fda97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:24.317769 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a55a6-0530-47cc-842f-a7ddc57fda97 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:24.319176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a55a6-0530-47cc-842f-a7ddc57fda97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:24.319520 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a55a6-0530-47cc-842f-a7ddc57fda97 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:24.320776 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a55a6-0530-47cc-842f-a7ddc57fda97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:24.322858 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a55a6-0530-47cc-842f-a7ddc57fda97 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:24.441075 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1019/2023] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:24 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:24.445421 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34a8ad-204a-4f07-a795-62fba4a6c506 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:24.457947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34a8ad-204a-4f07-a795-62fba4a6c506 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:24.531041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddac204-7bd9-40bf-85d2-b03100aec2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:24.532383 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddac204-7bd9-40bf-85d2-b03100aec2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:24.532383 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddac204-7bd9-40bf-85d2-b03100aec2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:24.532383 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddac204-7bd9-40bf-85d2-b03100aec2c2 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:24.533015 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddac204-7bd9-40bf-85d2-b03100aec2c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:24.536309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddac204-7bd9-40bf-85d2-b03100aec2c2 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:24.622419 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a55a6-0530-47cc-842f-a7ddc57fda97 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:24.624562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-bc0a55a6-0530-47cc-842f-a7ddc57fda97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:24.626632 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1005/2024] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:24 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:24.627649 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddac204-7bd9-40bf-85d2-b03100aec2c2 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:24.638987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a55a6-0530-47cc-842f-a7ddc57fda97 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:24.639816 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddac204-7bd9-40bf-85d2-b03100aec2c2 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:24.643971 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c74cd-80f3-4066-83b2-252733707dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:24.645287 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332e50a-b003-4c95-8338-632cf345c696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:24.645442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c74cd-80f3-4066-83b2-252733707dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:24.645704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c74cd-80f3-4066-83b2-252733707dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:24.645974 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332e50a-b003-4c95-8338-632cf345c696 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:24.646090 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c74cd-80f3-4066-83b2-252733707dd0 admin admin] PATH_INFO: `/v3/users/b5b5308601714757a9e5ac34ba812f8c` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:24.646849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332e50a-b003-4c95-8338-632cf345c696 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:24.647276 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c74cd-80f3-4066-83b2-252733707dd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5b5308601714757a9e5ac34ba812f8c)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:24.647627 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332e50a-b003-4c95-8338-632cf345c696 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:24.648858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332e50a-b003-4c95-8338-632cf345c696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:24.649466 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c74cd-80f3-4066-83b2-252733707dd0 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:24.651142 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332e50a-b003-4c95-8338-632cf345c696 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:24.664028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1006/2025] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:24.668901 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332e50a-b003-4c95-8338-632cf345c696 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:24.686728 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332e50a-b003-4c95-8338-632cf345c696 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:24.692780 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a94f16-3992-43ac-82c7-772e53e9ccca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:24.694275 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a94f16-3992-43ac-82c7-772e53e9ccca admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:24.694275 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a94f16-3992-43ac-82c7-772e53e9ccca admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:24.694275 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a94f16-3992-43ac-82c7-772e53e9ccca admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:24.695198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a94f16-3992-43ac-82c7-772e53e9ccca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:24.696891 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a94f16-3992-43ac-82c7-772e53e9ccca admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:24.709876 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1007/2026] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:24.713912 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a94f16-3992-43ac-82c7-772e53e9ccca admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:24.725197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a94f16-3992-43ac-82c7-772e53e9ccca admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:24.730307 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2714f-5c1c-4529-986f-20b7560e2d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:24.731318 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2714f-5c1c-4529-986f-20b7560e2d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:24.731681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2714f-5c1c-4529-986f-20b7560e2d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:24.732037 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2714f-5c1c-4529-986f-20b7560e2d0a admin admin] PATH_INFO: `/v3/projects/428210464e1a4d858d6bcc15648e0eaa/users/af8e80b5680b469e9df3c65543fc717e/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:24.753338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2714f-5c1c-4529-986f-20b7560e2d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=428210464e1a4d858d6bcc15648e0eaa, user_id=af8e80b5680b469e9df3c65543fc717e, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:24.756068 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2714f-5c1c-4529-986f-20b7560e2d0a admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:24.944890 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1008/2027] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:24 2022] PUT /identity/v3/projects/428210464e1a4d858d6bcc15648e0eaa/users/af8e80b5680b469e9df3c65543fc717e/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:58:24.967542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-cb7c74cd-80f3-4066-83b2-252733707dd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5b5308601714757a9e5ac34ba812f8c'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:24.968084 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8cd20-f9f6-43ea-956c-fec18413a866 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:24.968084 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8cd20-f9f6-43ea-956c-fec18413a866 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:24.968084 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8cd20-f9f6-43ea-956c-fec18413a866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:24.985278 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-cb7c74cd-80f3-4066-83b2-252733707dd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5b5308601714757a9e5ac34ba812f8c'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:25.015744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-66a8cd20-f9f6-43ea-956c-fec18413a866 None None] MFA Rules not processed for user `af8e80b5680b469e9df3c65543fc717e`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:25.016993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-66a8cd20-f9f6-43ea-956c-fec18413a866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:25.078629 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-cb7c74cd-80f3-4066-83b2-252733707dd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5b5308601714757a9e5ac34ba812f8c'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:25.080265 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-cb7c74cd-80f3-4066-83b2-252733707dd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5b5308601714757a9e5ac34ba812f8c'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:25.087914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1009/2028] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:25.094069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-cb7c74cd-80f3-4066-83b2-252733707dd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5b5308601714757a9e5ac34ba812f8c'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:25.100899 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8cd20-f9f6-43ea-956c-fec18413a866 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:25.105282 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1020/2029] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:24 2022] DELETE /identity/v3/users/b5b5308601714757a9e5ac34ba812f8c => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:25.105439 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-66a8cd20-f9f6-43ea-956c-fec18413a866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:25.106875 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f3d10-caf9-4864-ba07-40a647864d1e None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:25.107259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f3d10-caf9-4864-ba07-40a647864d1e None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:25.107615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f3d10-caf9-4864-ba07-40a647864d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:25.126166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-361f3d10-caf9-4864-ba07-40a647864d1e None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:25.127483 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-361f3d10-caf9-4864-ba07-40a647864d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:25.169462 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8cd20-f9f6-43ea-956c-fec18413a866 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:25.197869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1021/2030] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:25.206798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f3d10-caf9-4864-ba07-40a647864d1e None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:25.208361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-361f3d10-caf9-4864-ba07-40a647864d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:25.217650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:25.226537 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f3d10-caf9-4864-ba07-40a647864d1e None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:25.233526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127b864-4f65-476d-a5c8-0be0bd60bc49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:25.234496 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54d80a-5b27-47dc-b7cc-1e96ac1e97bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:25.235119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127b864-4f65-476d-a5c8-0be0bd60bc49 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:25.236550 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54d80a-5b27-47dc-b7cc-1e96ac1e97bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:25.236968 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54d80a-5b27-47dc-b7cc-1e96ac1e97bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:25.238579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54d80a-5b27-47dc-b7cc-1e96ac1e97bb admin admin] PATH_INFO: `/v3/projects/2ca339892efe4fd4b76ab4ec98c5bcd6` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:25.245083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54d80a-5b27-47dc-b7cc-1e96ac1e97bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca339892efe4fd4b76ab4ec98c5bcd6)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:25.245601 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127b864-4f65-476d-a5c8-0be0bd60bc49 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:25.245677 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54d80a-5b27-47dc-b7cc-1e96ac1e97bb admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:25.245841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127b864-4f65-476d-a5c8-0be0bd60bc49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:25.245841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-a127b864-4f65-476d-a5c8-0be0bd60bc49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:25.316209 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127b864-4f65-476d-a5c8-0be0bd60bc49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:25.318014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127b864-4f65-476d-a5c8-0be0bd60bc49 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:25.328219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1010/2031] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:58:25.330846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127b864-4f65-476d-a5c8-0be0bd60bc49 service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:25.332909 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-a127b864-4f65-476d-a5c8-0be0bd60bc49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:25.381934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7a54d80a-5b27-47dc-b7cc-1e96ac1e97bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca339892efe4fd4b76ab4ec98c5bcd6', 'request_id': 'req-7a54d80a-5b27-47dc-b7cc-1e96ac1e97bb'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:25.392350 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7a54d80a-5b27-47dc-b7cc-1e96ac1e97bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca339892efe4fd4b76ab4ec98c5bcd6', 'request_id': 'req-7a54d80a-5b27-47dc-b7cc-1e96ac1e97bb'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:25.400099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7a54d80a-5b27-47dc-b7cc-1e96ac1e97bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca339892efe4fd4b76ab4ec98c5bcd6', 'request_id': 'req-7a54d80a-5b27-47dc-b7cc-1e96ac1e97bb'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:25.402080 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127b864-4f65-476d-a5c8-0be0bd60bc49 service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:25.477789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5adaa1-a50d-4a5f-aaa9-10446f124d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:25.478544 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5adaa1-a50d-4a5f-aaa9-10446f124d89 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:25.478832 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5adaa1-a50d-4a5f-aaa9-10446f124d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:25.479110 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5adaa1-a50d-4a5f-aaa9-10446f124d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:25.486818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7a54d80a-5b27-47dc-b7cc-1e96ac1e97bb admin admin] The token cache is being invalidate because project 2ca339892efe4fd4b76ab4ec98c5bcd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:25.487200 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7a54d80a-5b27-47dc-b7cc-1e96ac1e97bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:25.488264 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7a54d80a-5b27-47dc-b7cc-1e96ac1e97bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:25.491679 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1022/2032] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:25 2022] DELETE /identity/v3/projects/2ca339892efe4fd4b76ab4ec98c5bcd6 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:25.492631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54d80a-5b27-47dc-b7cc-1e96ac1e97bb admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:25.495932 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7a54d80a-5b27-47dc-b7cc-1e96ac1e97bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:25.552254 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5adaa1-a50d-4a5f-aaa9-10446f124d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:25.554830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5adaa1-a50d-4a5f-aaa9-10446f124d89 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:25.567157 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1011/2033] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:25.569199 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54d80a-5b27-47dc-b7cc-1e96ac1e97bb admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:25.574264 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b34496-eaaf-41df-8109-8171d7ab46ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:25.575180 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b34496-eaaf-41df-8109-8171d7ab46ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:25.575459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b34496-eaaf-41df-8109-8171d7ab46ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:25.576993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5adaa1-a50d-4a5f-aaa9-10446f124d89 service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:25.577897 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b34496-eaaf-41df-8109-8171d7ab46ab admin admin] PATH_INFO: `/v3/users/af8e80b5680b469e9df3c65543fc717e` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:25.579269 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b34496-eaaf-41df-8109-8171d7ab46ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=af8e80b5680b469e9df3c65543fc717e)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:25.581833 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b34496-eaaf-41df-8109-8171d7ab46ab admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:25.590225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5adaa1-a50d-4a5f-aaa9-10446f124d89 service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:25.595536 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a9b60-43bc-4c16-8e24-d3e6007ef4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:25.596476 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a9b60-43bc-4c16-8e24-d3e6007ef4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:25.597952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a9b60-43bc-4c16-8e24-d3e6007ef4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:25.598250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a9b60-43bc-4c16-8e24-d3e6007ef4d1 admin admin] PATH_INFO: `/v3/users/87e66cd65e9b49c7a0a9b7170f43563e` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:25.600941 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a9b60-43bc-4c16-8e24-d3e6007ef4d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e66cd65e9b49c7a0a9b7170f43563e)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:25.603749 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a9b60-43bc-4c16-8e24-d3e6007ef4d1 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:25.887760 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-765a9b60-43bc-4c16-8e24-d3e6007ef4d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e66cd65e9b49c7a0a9b7170f43563e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:25.896568 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e7b34496-eaaf-41df-8109-8171d7ab46ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af8e80b5680b469e9df3c65543fc717e'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:25.922601 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-765a9b60-43bc-4c16-8e24-d3e6007ef4d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e66cd65e9b49c7a0a9b7170f43563e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:25.925882 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e7b34496-eaaf-41df-8109-8171d7ab46ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af8e80b5680b469e9df3c65543fc717e'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:26.040182 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-765a9b60-43bc-4c16-8e24-d3e6007ef4d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e66cd65e9b49c7a0a9b7170f43563e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:26.040900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-765a9b60-43bc-4c16-8e24-d3e6007ef4d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e66cd65e9b49c7a0a9b7170f43563e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:26.049322 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-765a9b60-43bc-4c16-8e24-d3e6007ef4d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e66cd65e9b49c7a0a9b7170f43563e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:26.056365 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1012/2034] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:25 2022] DELETE /identity/v3/users/87e66cd65e9b49c7a0a9b7170f43563e => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:26.120462 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e7b34496-eaaf-41df-8109-8171d7ab46ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af8e80b5680b469e9df3c65543fc717e'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:26.127049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e7b34496-eaaf-41df-8109-8171d7ab46ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af8e80b5680b469e9df3c65543fc717e'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:26.131465 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a9b60-43bc-4c16-8e24-d3e6007ef4d1 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:26.136279 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e7b34496-eaaf-41df-8109-8171d7ab46ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af8e80b5680b469e9df3c65543fc717e'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:26.138584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-765a9b60-43bc-4c16-8e24-d3e6007ef4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:26.147974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1023/2035] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:25 2022] DELETE /identity/v3/users/af8e80b5680b469e9df3c65543fc717e => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:26.152418 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857faf9b-3b4e-4653-9e4c-a8d407ed404d None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:26.152752 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857faf9b-3b4e-4653-9e4c-a8d407ed404d None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:26.154908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857faf9b-3b4e-4653-9e4c-a8d407ed404d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:26.185515 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-857faf9b-3b4e-4653-9e4c-a8d407ed404d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:26.187330 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-857faf9b-3b4e-4653-9e4c-a8d407ed404d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:26.235323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a9b60-43bc-4c16-8e24-d3e6007ef4d1 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:26.261701 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1024/2036] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:26.284362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857faf9b-3b4e-4653-9e4c-a8d407ed404d None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:26.285998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-857faf9b-3b4e-4653-9e4c-a8d407ed404d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:26.299315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e75ed6-4756-4cb4-97f0-ff2476a51a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:26.301553 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e75ed6-4756-4cb4-97f0-ff2476a51a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:26.303277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e75ed6-4756-4cb4-97f0-ff2476a51a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:26.303277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e75ed6-4756-4cb4-97f0-ff2476a51a90 admin admin] PATH_INFO: `/v3/projects/68a7b16111444ef1b375a2947e1d77e7` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:26.303989 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e75ed6-4756-4cb4-97f0-ff2476a51a90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68a7b16111444ef1b375a2947e1d77e7)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:26.306382 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e75ed6-4756-4cb4-97f0-ff2476a51a90 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:26.353109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857faf9b-3b4e-4653-9e4c-a8d407ed404d None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:26.356869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b961a-2be9-4075-8fe2-8b83e02b4b7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:26.357651 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b961a-2be9-4075-8fe2-8b83e02b4b7a service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:26.357937 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b961a-2be9-4075-8fe2-8b83e02b4b7a service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:26.358743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b961a-2be9-4075-8fe2-8b83e02b4b7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:26.371141 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b961a-2be9-4075-8fe2-8b83e02b4b7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:26.372804 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b961a-2be9-4075-8fe2-8b83e02b4b7a service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:26.383913 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1025/2037] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:26.416314 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-33e75ed6-4756-4cb4-97f0-ff2476a51a90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68a7b16111444ef1b375a2947e1d77e7', 'request_id': 'req-33e75ed6-4756-4cb4-97f0-ff2476a51a90'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:26.425356 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-33e75ed6-4756-4cb4-97f0-ff2476a51a90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68a7b16111444ef1b375a2947e1d77e7', 'request_id': 'req-33e75ed6-4756-4cb4-97f0-ff2476a51a90'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:26.433407 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-33e75ed6-4756-4cb4-97f0-ff2476a51a90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68a7b16111444ef1b375a2947e1d77e7', 'request_id': 'req-33e75ed6-4756-4cb4-97f0-ff2476a51a90'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:26.519882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-33e75ed6-4756-4cb4-97f0-ff2476a51a90 admin admin] The token cache is being invalidate because project 68a7b16111444ef1b375a2947e1d77e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:26.520181 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-33e75ed6-4756-4cb4-97f0-ff2476a51a90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:26.520861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-33e75ed6-4756-4cb4-97f0-ff2476a51a90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:26.522698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1013/2038] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:26 2022] DELETE /identity/v3/projects/68a7b16111444ef1b375a2947e1d77e7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:26.529439 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b961a-2be9-4075-8fe2-8b83e02b4b7a service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:26.530975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-4d8b961a-2be9-4075-8fe2-8b83e02b4b7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:26.547135 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b961a-2be9-4075-8fe2-8b83e02b4b7a service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:26.629569 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187a9c9-d0c9-474c-968b-1d57f7e1d0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:26.631246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187a9c9-d0c9-474c-968b-1d57f7e1d0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:26.631542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187a9c9-d0c9-474c-968b-1d57f7e1d0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:26.631820 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187a9c9-d0c9-474c-968b-1d57f7e1d0c8 admin admin] PATH_INFO: `/v3/users/0b245084b30c45dfaccea4696e75a5cd` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:26.634388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187a9c9-d0c9-474c-968b-1d57f7e1d0c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b245084b30c45dfaccea4696e75a5cd)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:26.636444 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187a9c9-d0c9-474c-968b-1d57f7e1d0c8 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:26.891914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:27.016297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e75ed6-4756-4cb4-97f0-ff2476a51a90 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:27.017829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-33e75ed6-4756-4cb4-97f0-ff2476a51a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:27.036441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e75ed6-4756-4cb4-97f0-ff2476a51a90 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:27.053921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7187a9c9-d0c9-474c-968b-1d57f7e1d0c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b245084b30c45dfaccea4696e75a5cd'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:27.062972 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03250a-5ff6-494c-aa10-014481c7c0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:27.063859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03250a-5ff6-494c-aa10-014481c7c0db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:27.064142 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03250a-5ff6-494c-aa10-014481c7c0db admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:27.066586 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03250a-5ff6-494c-aa10-014481c7c0db admin admin] PATH_INFO: `/v3/projects/9002309214234ff0acff7abc1ec2e8c3` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:27.070827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7187a9c9-d0c9-474c-968b-1d57f7e1d0c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b245084b30c45dfaccea4696e75a5cd'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:27.071091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03250a-5ff6-494c-aa10-014481c7c0db admin admin] RBAC: Authorizing `identity:delete_project(project_id=9002309214234ff0acff7abc1ec2e8c3)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:27.073338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03250a-5ff6-494c-aa10-014481c7c0db admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:27.140914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7187a9c9-d0c9-474c-968b-1d57f7e1d0c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b245084b30c45dfaccea4696e75a5cd'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:27.142446 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7187a9c9-d0c9-474c-968b-1d57f7e1d0c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b245084b30c45dfaccea4696e75a5cd'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:27.153310 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7187a9c9-d0c9-474c-968b-1d57f7e1d0c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b245084b30c45dfaccea4696e75a5cd'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:27.161051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1026/2039] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:26 2022] DELETE /identity/v3/users/0b245084b30c45dfaccea4696e75a5cd => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:27.203311 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187a9c9-d0c9-474c-968b-1d57f7e1d0c8 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:27.205216 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7187a9c9-d0c9-474c-968b-1d57f7e1d0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:27.248726 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-aa03250a-5ff6-494c-aa10-014481c7c0db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9002309214234ff0acff7abc1ec2e8c3', 'request_id': 'req-aa03250a-5ff6-494c-aa10-014481c7c0db'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:27.259143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-aa03250a-5ff6-494c-aa10-014481c7c0db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9002309214234ff0acff7abc1ec2e8c3', 'request_id': 'req-aa03250a-5ff6-494c-aa10-014481c7c0db'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:27.269385 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-aa03250a-5ff6-494c-aa10-014481c7c0db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9002309214234ff0acff7abc1ec2e8c3', 'request_id': 'req-aa03250a-5ff6-494c-aa10-014481c7c0db'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:27.313825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187a9c9-d0c9-474c-968b-1d57f7e1d0c8 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:27.372196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a675d-72b1-4f44-9617-c075a60c0d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:27.373121 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a675d-72b1-4f44-9617-c075a60c0d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:27.373458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a675d-72b1-4f44-9617-c075a60c0d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:27.373700 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a675d-72b1-4f44-9617-c075a60c0d52 admin admin] PATH_INFO: `/v3/projects/428210464e1a4d858d6bcc15648e0eaa` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:27.374977 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a675d-72b1-4f44-9617-c075a60c0d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=428210464e1a4d858d6bcc15648e0eaa)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:27.376942 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a675d-72b1-4f44-9617-c075a60c0d52 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:27.381320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-aa03250a-5ff6-494c-aa10-014481c7c0db admin admin] The token cache is being invalidate because project 9002309214234ff0acff7abc1ec2e8c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:27.381814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-aa03250a-5ff6-494c-aa10-014481c7c0db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:27.382647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-aa03250a-5ff6-494c-aa10-014481c7c0db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:27.388690 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1014/2040] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:27 2022] DELETE /identity/v3/projects/9002309214234ff0acff7abc1ec2e8c3 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:27.391914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f9d64-cd0e-4f38-8284-2b160f0f399e None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:27.391914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f9d64-cd0e-4f38-8284-2b160f0f399e None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:27.391914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f9d64-cd0e-4f38-8284-2b160f0f399e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:27.420587 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-e72f9d64-cd0e-4f38-8284-2b160f0f399e None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:27.420587 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e72f9d64-cd0e-4f38-8284-2b160f0f399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:27.426538 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1015/2041] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:27.434721 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd0ac8-7d85-4ad8-8f35-e5855cf38a2d None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:27.435018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd0ac8-7d85-4ad8-8f35-e5855cf38a2d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:27.435373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd0ac8-7d85-4ad8-8f35-e5855cf38a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:27.463295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-90fd0ac8-7d85-4ad8-8f35-e5855cf38a2d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:27.464830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-90fd0ac8-7d85-4ad8-8f35-e5855cf38a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:27.477822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1016/2042] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:58:27.492504 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd0ac8-7d85-4ad8-8f35-e5855cf38a2d None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:27.495020 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f00a675d-72b1-4f44-9617-c075a60c0d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '428210464e1a4d858d6bcc15648e0eaa', 'request_id': 'req-f00a675d-72b1-4f44-9617-c075a60c0d52'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:27.502424 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f00a675d-72b1-4f44-9617-c075a60c0d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '428210464e1a4d858d6bcc15648e0eaa', 'request_id': 'req-f00a675d-72b1-4f44-9617-c075a60c0d52'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:27.506261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd0ac8-7d85-4ad8-8f35-e5855cf38a2d None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:27.510398 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f00a675d-72b1-4f44-9617-c075a60c0d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '428210464e1a4d858d6bcc15648e0eaa', 'request_id': 'req-f00a675d-72b1-4f44-9617-c075a60c0d52'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:27.576827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e832cb-7228-48f8-a43d-478cef3c4fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:27.578002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e832cb-7228-48f8-a43d-478cef3c4fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:27.578362 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e832cb-7228-48f8-a43d-478cef3c4fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:27.578745 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e832cb-7228-48f8-a43d-478cef3c4fc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:27.579690 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e832cb-7228-48f8-a43d-478cef3c4fc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:58:27.580063 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e832cb-7228-48f8-a43d-478cef3c4fc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:27.581920 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e832cb-7228-48f8-a43d-478cef3c4fc5 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:27.595891 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1017/2043] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:58:27.601083 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e832cb-7228-48f8-a43d-478cef3c4fc5 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:27.612751 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e832cb-7228-48f8-a43d-478cef3c4fc5 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:27.618576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8df4c1-8373-4a27-b4af-64b69be865df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:27.621386 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f00a675d-72b1-4f44-9617-c075a60c0d52 admin admin] The token cache is being invalidate because project 428210464e1a4d858d6bcc15648e0eaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:27.621506 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8df4c1-8373-4a27-b4af-64b69be865df admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:27.621595 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f00a675d-72b1-4f44-9617-c075a60c0d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:27.621678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8df4c1-8373-4a27-b4af-64b69be865df admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:27.621678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8df4c1-8373-4a27-b4af-64b69be865df admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:27.621848 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f00a675d-72b1-4f44-9617-c075a60c0d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:27.621948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8df4c1-8373-4a27-b4af-64b69be865df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:27.622974 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8df4c1-8373-4a27-b4af-64b69be865df admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:27.628401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1027/2044] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:27 2022] DELETE /identity/v3/projects/428210464e1a4d858d6bcc15648e0eaa => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:27.630732 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238e911-ed36-4357-9053-f2ee6a6e6c90 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:27.631329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238e911-ed36-4357-9053-f2ee6a6e6c90 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:27.631799 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238e911-ed36-4357-9053-f2ee6a6e6c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:27.656484 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-a238e911-ed36-4357-9053-f2ee6a6e6c90 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:27.661279 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-a238e911-ed36-4357-9053-f2ee6a6e6c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:27.673511 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1028/2045] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:27.675119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad777ca-c756-49de-ae3b-71b1469820ff None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:27.675422 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad777ca-c756-49de-ae3b-71b1469820ff None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:27.675711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad777ca-c756-49de-ae3b-71b1469820ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:27.694975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-8ad777ca-c756-49de-ae3b-71b1469820ff None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:27.696207 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-8ad777ca-c756-49de-ae3b-71b1469820ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:27.710668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1029/2046] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:27.710668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad777ca-c756-49de-ae3b-71b1469820ff None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:27.729584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1018/2047] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:27 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:27.733466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8df4c1-8373-4a27-b4af-64b69be865df admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:27.736071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ef8df4c1-8373-4a27-b4af-64b69be865df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:27.739383 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad777ca-c756-49de-ae3b-71b1469820ff None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:27.821420 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec3a1e-ca32-4d85-ad17-1e2892f42368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:27.822261 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec3a1e-ca32-4d85-ad17-1e2892f42368 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:27.822657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec3a1e-ca32-4d85-ad17-1e2892f42368 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:27.823044 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec3a1e-ca32-4d85-ad17-1e2892f42368 admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:27.823998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec3a1e-ca32-4d85-ad17-1e2892f42368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:58:27.824418 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec3a1e-ca32-4d85-ad17-1e2892f42368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:27.826273 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec3a1e-ca32-4d85-ad17-1e2892f42368 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:27.833433 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8df4c1-8373-4a27-b4af-64b69be865df admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:27.839108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888f879-0de7-40a8-a047-beb4f9ec50d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:27.842591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888f879-0de7-40a8-a047-beb4f9ec50d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:27.842591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888f879-0de7-40a8-a047-beb4f9ec50d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:27.842591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888f879-0de7-40a8-a047-beb4f9ec50d7 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:27.842591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888f879-0de7-40a8-a047-beb4f9ec50d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:27.842907 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:27.846402 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1030/2048] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:58:27.847876 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec3a1e-ca32-4d85-ad17-1e2892f42368 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:27.850011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888f879-0de7-40a8-a047-beb4f9ec50d7 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:27.859212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec3a1e-ca32-4d85-ad17-1e2892f42368 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:27.865620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95265b43-960d-4602-ae13-611dd659cba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:27.865620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95265b43-960d-4602-ae13-611dd659cba7 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:27.865620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95265b43-960d-4602-ae13-611dd659cba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:27.866216 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95265b43-960d-4602-ae13-611dd659cba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:27.867024 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95265b43-960d-4602-ae13-611dd659cba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:27.869114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95265b43-960d-4602-ae13-611dd659cba7 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:27.984811 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1031/2049] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:27 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:27.989994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95265b43-960d-4602-ae13-611dd659cba7 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:28.014480 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1019/2050] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:27 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:28.020966 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888f879-0de7-40a8-a047-beb4f9ec50d7 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:28.048132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888f879-0de7-40a8-a047-beb4f9ec50d7 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:28.077812 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95265b43-960d-4602-ae13-611dd659cba7 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:28.085619 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b50b41-114d-4926-a133-a78cd276e809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:28.088472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b50b41-114d-4926-a133-a78cd276e809 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:28.088472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b50b41-114d-4926-a133-a78cd276e809 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:28.088472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b50b41-114d-4926-a133-a78cd276e809 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:28.088472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b50b41-114d-4926-a133-a78cd276e809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:28.090542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b50b41-114d-4926-a133-a78cd276e809 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:28.194285 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1032/2051] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:27 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:28.196692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b50b41-114d-4926-a133-a78cd276e809 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:28.199366 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d1b50b41-114d-4926-a133-a78cd276e809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:28.208736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e3f8d-2f17-4915-8698-a4081426a4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:28.209060 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e3f8d-2f17-4915-8698-a4081426a4ff admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:28.209492 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e3f8d-2f17-4915-8698-a4081426a4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:28.210327 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e3f8d-2f17-4915-8698-a4081426a4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:28.210915 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e3f8d-2f17-4915-8698-a4081426a4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:28.213258 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e3f8d-2f17-4915-8698-a4081426a4ff admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:28.225263 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b50b41-114d-4926-a133-a78cd276e809 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:28.233310 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e2025-86e2-46b9-a4d4-5ad5992f8b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:28.234597 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e2025-86e2-46b9-a4d4-5ad5992f8b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:28.235569 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e2025-86e2-46b9-a4d4-5ad5992f8b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:28.236013 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e2025-86e2-46b9-a4d4-5ad5992f8b28 admin admin] PATH_INFO: `/v3/projects/fcf518d69ee94b7f853d078af4ceec0f` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:28.242112 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1020/2052] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:58:28.242923 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e2025-86e2-46b9-a4d4-5ad5992f8b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcf518d69ee94b7f853d078af4ceec0f)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:28.244041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e3f8d-2f17-4915-8698-a4081426a4ff admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:28.245662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e2025-86e2-46b9-a4d4-5ad5992f8b28 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:28.267143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e3f8d-2f17-4915-8698-a4081426a4ff admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:28.279078 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac538de-7804-403a-85a4-e654e8d95e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:28.296774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac538de-7804-403a-85a4-e654e8d95e16 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:28.296774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac538de-7804-403a-85a4-e654e8d95e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:28.296774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac538de-7804-403a-85a4-e654e8d95e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:28.296774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac538de-7804-403a-85a4-e654e8d95e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:28.296774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac538de-7804-403a-85a4-e654e8d95e16 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:28.299118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1021/2053] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:28.300782 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac538de-7804-403a-85a4-e654e8d95e16 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:28.314188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac538de-7804-403a-85a4-e654e8d95e16 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:28.319761 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88de383-82f3-4aef-8666-316938192a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:28.320686 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88de383-82f3-4aef-8666-316938192a41 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:28.321204 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88de383-82f3-4aef-8666-316938192a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:28.321697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88de383-82f3-4aef-8666-316938192a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:28.322652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88de383-82f3-4aef-8666-316938192a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:28.324753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88de383-82f3-4aef-8666-316938192a41 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:28.336976 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1022/2054] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:28.338234 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88de383-82f3-4aef-8666-316938192a41 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:28.349215 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88de383-82f3-4aef-8666-316938192a41 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:28.359505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34157ac6-730c-4ca4-9085-d1cee11afee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:28.359505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34157ac6-730c-4ca4-9085-d1cee11afee2 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:28.359505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34157ac6-730c-4ca4-9085-d1cee11afee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:28.359505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34157ac6-730c-4ca4-9085-d1cee11afee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:28.359948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34157ac6-730c-4ca4-9085-d1cee11afee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:28.359948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34157ac6-730c-4ca4-9085-d1cee11afee2 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:28.370985 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1023/2055] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:28.371941 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34157ac6-730c-4ca4-9085-d1cee11afee2 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:28.385709 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34157ac6-730c-4ca4-9085-d1cee11afee2 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:28.386455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f59e2025-86e2-46b9-a4d4-5ad5992f8b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcf518d69ee94b7f853d078af4ceec0f', 'request_id': 'req-f59e2025-86e2-46b9-a4d4-5ad5992f8b28'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:28.398750 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f59e2025-86e2-46b9-a4d4-5ad5992f8b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcf518d69ee94b7f853d078af4ceec0f', 'request_id': 'req-f59e2025-86e2-46b9-a4d4-5ad5992f8b28'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:28.408975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f59e2025-86e2-46b9-a4d4-5ad5992f8b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcf518d69ee94b7f853d078af4ceec0f', 'request_id': 'req-f59e2025-86e2-46b9-a4d4-5ad5992f8b28'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:28.460400 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a390c-cd3a-4db7-bc17-f13436447665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:28.461397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a390c-cd3a-4db7-bc17-f13436447665 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:28.461759 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a390c-cd3a-4db7-bc17-f13436447665 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:28.462105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a390c-cd3a-4db7-bc17-f13436447665 admin admin] PATH_INFO: `/v3/projects/85ea5383fb15460889f9799bd7a33951/users/c9238586741c459da787b7f613d2e9dd/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:28.478321 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a390c-cd3a-4db7-bc17-f13436447665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ea5383fb15460889f9799bd7a33951, user_id=c9238586741c459da787b7f613d2e9dd, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:28.481544 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a390c-cd3a-4db7-bc17-f13436447665 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:28.503084 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f59e2025-86e2-46b9-a4d4-5ad5992f8b28 admin admin] The token cache is being invalidate because project fcf518d69ee94b7f853d078af4ceec0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:28.503084 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f59e2025-86e2-46b9-a4d4-5ad5992f8b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:28.505872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f59e2025-86e2-46b9-a4d4-5ad5992f8b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:28.508640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1033/2056] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:28 2022] DELETE /identity/v3/projects/fcf518d69ee94b7f853d078af4ceec0f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:28.509563 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e2025-86e2-46b9-a4d4-5ad5992f8b28 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:28.511166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f59e2025-86e2-46b9-a4d4-5ad5992f8b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:28.524691 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e2025-86e2-46b9-a4d4-5ad5992f8b28 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:28.531541 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb1c18-5f0b-41a2-b708-263f1d33e910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:28.533196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb1c18-5f0b-41a2-b708-263f1d33e910 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:28.533477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb1c18-5f0b-41a2-b708-263f1d33e910 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:28.533977 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb1c18-5f0b-41a2-b708-263f1d33e910 admin admin] PATH_INFO: `/v3/projects/b1ced5fb2f504aee9dd0f9280a97531f/users/e8dba2c48a2145ab894681ec0720996e/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:28.553555 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1024/2057] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:28 2022] PUT /identity/v3/projects/85ea5383fb15460889f9799bd7a33951/users/c9238586741c459da787b7f613d2e9dd/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:28.554339 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a390c-cd3a-4db7-bc17-f13436447665 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:28.557237 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-876a390c-cd3a-4db7-bc17-f13436447665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:28.559886 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb1c18-5f0b-41a2-b708-263f1d33e910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ced5fb2f504aee9dd0f9280a97531f, user_id=e8dba2c48a2145ab894681ec0720996e, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:28.564332 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb1c18-5f0b-41a2-b708-263f1d33e910 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:28.645654 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1034/2058] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:28 2022] PUT /identity/v3/projects/b1ced5fb2f504aee9dd0f9280a97531f/users/e8dba2c48a2145ab894681ec0720996e/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:28.645654 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda837bf-8a6f-4bd8-a91a-9520b59220d2 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:28.645654 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda837bf-8a6f-4bd8-a91a-9520b59220d2 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:28.645654 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda837bf-8a6f-4bd8-a91a-9520b59220d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:28.655283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a390c-cd3a-4db7-bc17-f13436447665 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:28.694877 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-cda837bf-8a6f-4bd8-a91a-9520b59220d2 None None] MFA Rules not processed for user `c9238586741c459da787b7f613d2e9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:28.696655 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-cda837bf-8a6f-4bd8-a91a-9520b59220d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:28.743836 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cc291-577d-4596-b6ed-d3d1cd2212f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:28.748278 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cc291-577d-4596-b6ed-d3d1cd2212f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:28.748278 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cc291-577d-4596-b6ed-d3d1cd2212f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:28.748278 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cc291-577d-4596-b6ed-d3d1cd2212f9 admin admin] PATH_INFO: `/v3/users/33fde2c78dec40a7b4d3ddf8cf28c3d0` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:28.748278 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71cc291-577d-4596-b6ed-d3d1cd2212f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33fde2c78dec40a7b4d3ddf8cf28c3d0)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:28.748813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71cc291-577d-4596-b6ed-d3d1cd2212f9 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:28.785099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1035/2059] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:28.790989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed735f6-7928-4f09-9a92-980ed037dfa7 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:28.790989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed735f6-7928-4f09-9a92-980ed037dfa7 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:28.790989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed735f6-7928-4f09-9a92-980ed037dfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:28.809037 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-1ed735f6-7928-4f09-9a92-980ed037dfa7 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:28.810338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-1ed735f6-7928-4f09-9a92-980ed037dfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:28.819209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1036/2060] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:28.820464 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed735f6-7928-4f09-9a92-980ed037dfa7 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:28.822095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-1ed735f6-7928-4f09-9a92-980ed037dfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:28.832119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:28.884254 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed735f6-7928-4f09-9a92-980ed037dfa7 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:28.888628 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c8482-7fde-438e-a2e8-51fee26de529 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:28.889323 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c8482-7fde-438e-a2e8-51fee26de529 service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:28.889679 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c8482-7fde-438e-a2e8-51fee26de529 service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:28.889884 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c8482-7fde-438e-a2e8-51fee26de529 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:28.899213 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c8482-7fde-438e-a2e8-51fee26de529 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:28.901093 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c8482-7fde-438e-a2e8-51fee26de529 service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:28.911850 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1037/2061] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:28.912552 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c8482-7fde-438e-a2e8-51fee26de529 service cinder] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:28.914259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-8a5c8482-7fde-438e-a2e8-51fee26de529 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:28.923839 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e71cc291-577d-4596-b6ed-d3d1cd2212f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33fde2c78dec40a7b4d3ddf8cf28c3d0'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:28.947374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e71cc291-577d-4596-b6ed-d3d1cd2212f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33fde2c78dec40a7b4d3ddf8cf28c3d0'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:28.974194 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c8482-7fde-438e-a2e8-51fee26de529 service cinder] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:28.978512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34d762-ee94-4921-9158-bfdf44d6c0d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:28.979224 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34d762-ee94-4921-9158-bfdf44d6c0d7 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:28.979514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34d762-ee94-4921-9158-bfdf44d6c0d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:28.979793 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34d762-ee94-4921-9158-bfdf44d6c0d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:28.990302 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34d762-ee94-4921-9158-bfdf44d6c0d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:28.991822 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34d762-ee94-4921-9158-bfdf44d6c0d7 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:29.001954 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1038/2062] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:29.002991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34d762-ee94-4921-9158-bfdf44d6c0d7 service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:29.004505 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ab34d762-ee94-4921-9158-bfdf44d6c0d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:29.020313 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34d762-ee94-4921-9158-bfdf44d6c0d7 service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:29.032494 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad78cc4-52cc-43ed-9258-af6dcce37146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:29.033515 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad78cc4-52cc-43ed-9258-af6dcce37146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:29.033873 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad78cc4-52cc-43ed-9258-af6dcce37146 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:29.034794 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad78cc4-52cc-43ed-9258-af6dcce37146 admin admin] PATH_INFO: `/v3/users/c9238586741c459da787b7f613d2e9dd` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:29.036169 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad78cc4-52cc-43ed-9258-af6dcce37146 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9238586741c459da787b7f613d2e9dd)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:29.038576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad78cc4-52cc-43ed-9258-af6dcce37146 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:29.052214 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e71cc291-577d-4596-b6ed-d3d1cd2212f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33fde2c78dec40a7b4d3ddf8cf28c3d0'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:29.053010 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e71cc291-577d-4596-b6ed-d3d1cd2212f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33fde2c78dec40a7b4d3ddf8cf28c3d0'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:29.068427 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e71cc291-577d-4596-b6ed-d3d1cd2212f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33fde2c78dec40a7b4d3ddf8cf28c3d0'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:29.091750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1025/2063] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:28 2022] DELETE /identity/v3/users/33fde2c78dec40a7b4d3ddf8cf28c3d0 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:29.312725 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7ad78cc4-52cc-43ed-9258-af6dcce37146 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9238586741c459da787b7f613d2e9dd'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:29.331825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7ad78cc4-52cc-43ed-9258-af6dcce37146 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9238586741c459da787b7f613d2e9dd'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:29.432568 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7ad78cc4-52cc-43ed-9258-af6dcce37146 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9238586741c459da787b7f613d2e9dd'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:29.433394 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7ad78cc4-52cc-43ed-9258-af6dcce37146 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9238586741c459da787b7f613d2e9dd'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:29.445427 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7ad78cc4-52cc-43ed-9258-af6dcce37146 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9238586741c459da787b7f613d2e9dd'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:29.452294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1039/2064] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:29 2022] DELETE /identity/v3/users/c9238586741c459da787b7f613d2e9dd => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:29.457664 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6424124-236b-4c12-a1f3-72ff53006b15 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:29.457962 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6424124-236b-4c12-a1f3-72ff53006b15 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:29.458243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6424124-236b-4c12-a1f3-72ff53006b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:29.479686 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-f6424124-236b-4c12-a1f3-72ff53006b15 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:29.481901 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f6424124-236b-4c12-a1f3-72ff53006b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:29.589287 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1026/2065] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:29.622685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad78cc4-52cc-43ed-9258-af6dcce37146 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:29.626184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7ad78cc4-52cc-43ed-9258-af6dcce37146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:29.745862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad78cc4-52cc-43ed-9258-af6dcce37146 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:29.753798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db64244-cfd5-4da6-bb0e-1e9784b02887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:29.754586 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db64244-cfd5-4da6-bb0e-1e9784b02887 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:29.754941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db64244-cfd5-4da6-bb0e-1e9784b02887 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:29.755224 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db64244-cfd5-4da6-bb0e-1e9784b02887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:29.768045 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db64244-cfd5-4da6-bb0e-1e9784b02887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:29.770338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db64244-cfd5-4da6-bb0e-1e9784b02887 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:29.786818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1040/2066] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:29.865922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6424124-236b-4c12-a1f3-72ff53006b15 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:29.867336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f6424124-236b-4c12-a1f3-72ff53006b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:29.882467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6424124-236b-4c12-a1f3-72ff53006b15 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:29.889379 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d629f2f-5565-49f3-a00e-49e3c604da4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:29.890614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d629f2f-5565-49f3-a00e-49e3c604da4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:29.891048 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d629f2f-5565-49f3-a00e-49e3c604da4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:29.891666 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d629f2f-5565-49f3-a00e-49e3c604da4c admin admin] PATH_INFO: `/v3/projects/8d39cb9f3f034cd082d6a441c4a8c931` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:29.893354 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d629f2f-5565-49f3-a00e-49e3c604da4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d39cb9f3f034cd082d6a441c4a8c931)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:29.895574 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d629f2f-5565-49f3-a00e-49e3c604da4c admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:29.929986 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:30.098526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-7d629f2f-5565-49f3-a00e-49e3c604da4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d39cb9f3f034cd082d6a441c4a8c931', 'request_id': 'req-7d629f2f-5565-49f3-a00e-49e3c604da4c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:30.107413 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-7d629f2f-5565-49f3-a00e-49e3c604da4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d39cb9f3f034cd082d6a441c4a8c931', 'request_id': 'req-7d629f2f-5565-49f3-a00e-49e3c604da4c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:30.121311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-7d629f2f-5565-49f3-a00e-49e3c604da4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d39cb9f3f034cd082d6a441c4a8c931', 'request_id': 'req-7d629f2f-5565-49f3-a00e-49e3c604da4c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:30.226686 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-7d629f2f-5565-49f3-a00e-49e3c604da4c admin admin] The token cache is being invalidate because project 8d39cb9f3f034cd082d6a441c4a8c931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:30.227209 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-7d629f2f-5565-49f3-a00e-49e3c604da4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:30.227988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-7d629f2f-5565-49f3-a00e-49e3c604da4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:30.230653 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1027/2067] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:29 2022] DELETE /identity/v3/projects/8d39cb9f3f034cd082d6a441c4a8c931 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:30.240217 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65ad42-df8f-46e1-a0aa-5d3fdf45e217 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:30.240217 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65ad42-df8f-46e1-a0aa-5d3fdf45e217 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:30.240217 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65ad42-df8f-46e1-a0aa-5d3fdf45e217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:30.276356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-dc65ad42-df8f-46e1-a0aa-5d3fdf45e217 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:30.277919 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-dc65ad42-df8f-46e1-a0aa-5d3fdf45e217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:30.422253 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1041/2068] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:30.424180 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afb413-e1fe-419e-badc-7aa65e1e2b84 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:30.424526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afb413-e1fe-419e-badc-7aa65e1e2b84 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:30.425523 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afb413-e1fe-419e-badc-7aa65e1e2b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:30.451242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-81afb413-e1fe-419e-badc-7aa65e1e2b84 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:30.452678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-81afb413-e1fe-419e-badc-7aa65e1e2b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:30.469770 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65ad42-df8f-46e1-a0aa-5d3fdf45e217 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:30.477397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1028/2069] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:30.482874 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65ad42-df8f-46e1-a0aa-5d3fdf45e217 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:30.490638 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54344e0-9c62-4af0-b777-49fa65d387ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:30.491333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54344e0-9c62-4af0-b777-49fa65d387ea admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:30.491626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54344e0-9c62-4af0-b777-49fa65d387ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:30.493546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54344e0-9c62-4af0-b777-49fa65d387ea admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:30.494803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54344e0-9c62-4af0-b777-49fa65d387ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:58:30.494932 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54344e0-9c62-4af0-b777-49fa65d387ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:30.497256 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54344e0-9c62-4af0-b777-49fa65d387ea admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:30.519742 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afb413-e1fe-419e-badc-7aa65e1e2b84 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:30.530166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1042/2070] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:58:30.532536 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afb413-e1fe-419e-badc-7aa65e1e2b84 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:30.561982 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c5f4a-a4f7-402d-ade3-2532a805a6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:30.562667 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c5f4a-a4f7-402d-ade3-2532a805a6ba admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:30.562948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c5f4a-a4f7-402d-ade3-2532a805a6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:30.563316 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c5f4a-a4f7-402d-ade3-2532a805a6ba admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:30.563920 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c5f4a-a4f7-402d-ade3-2532a805a6ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:30.565911 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c5f4a-a4f7-402d-ade3-2532a805a6ba admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:30.725026 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1029/2071] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:30 2022] POST /identity/v3/projects => generated 361 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:30.729035 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54344e0-9c62-4af0-b777-49fa65d387ea admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:30.743969 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54344e0-9c62-4af0-b777-49fa65d387ea admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:30.817395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ece1a2-ceba-41f4-a1b1-47e64a600b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:30.818078 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ece1a2-ceba-41f4-a1b1-47e64a600b9f admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:30.818363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ece1a2-ceba-41f4-a1b1-47e64a600b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:30.818642 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ece1a2-ceba-41f4-a1b1-47e64a600b9f admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:30.819375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ece1a2-ceba-41f4-a1b1-47e64a600b9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:30.821362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ece1a2-ceba-41f4-a1b1-47e64a600b9f admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:30.945799 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1043/2072] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:30 2022] POST /identity/v3/users => generated 281 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:58:30.948962 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c5f4a-a4f7-402d-ade3-2532a805a6ba admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:30.960493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c5f4a-a4f7-402d-ade3-2532a805a6ba admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:30.968522 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ece1a2-ceba-41f4-a1b1-47e64a600b9f admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:30.969138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c30c0-a6f6-4604-bc5b-a9c9a0e2dabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:30.970229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c30c0-a6f6-4604-bc5b-a9c9a0e2dabe admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:30.970751 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d4ece1a2-ceba-41f4-a1b1-47e64a600b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:30.971461 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c30c0-a6f6-4604-bc5b-a9c9a0e2dabe admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:30.972773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c30c0-a6f6-4604-bc5b-a9c9a0e2dabe admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:30.973867 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c30c0-a6f6-4604-bc5b-a9c9a0e2dabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:30.975894 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c30c0-a6f6-4604-bc5b-a9c9a0e2dabe admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:31.004979 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ece1a2-ceba-41f4-a1b1-47e64a600b9f admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:31.006809 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1030/2073] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:31.010649 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c30c0-a6f6-4604-bc5b-a9c9a0e2dabe admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:31.011798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd1430-63ec-46ba-b80b-c005b6d0857a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:31.012903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd1430-63ec-46ba-b80b-c005b6d0857a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:31.014421 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd1430-63ec-46ba-b80b-c005b6d0857a admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:31.014825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd1430-63ec-46ba-b80b-c005b6d0857a admin admin] PATH_INFO: `/v3/projects/85ea5383fb15460889f9799bd7a33951` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:31.017710 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd1430-63ec-46ba-b80b-c005b6d0857a admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ea5383fb15460889f9799bd7a33951)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:31.020725 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd1430-63ec-46ba-b80b-c005b6d0857a admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:31.020974 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c30c0-a6f6-4604-bc5b-a9c9a0e2dabe admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:31.030467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5479099-6b80-42aa-9790-5a73460bd3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:31.032172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5479099-6b80-42aa-9790-5a73460bd3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:31.032663 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5479099-6b80-42aa-9790-5a73460bd3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:31.033835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5479099-6b80-42aa-9790-5a73460bd3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:31.035501 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5479099-6b80-42aa-9790-5a73460bd3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:31.038291 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5479099-6b80-42aa-9790-5a73460bd3b6 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:31.058308 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1031/2074] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:31.063262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5479099-6b80-42aa-9790-5a73460bd3b6 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:31.076231 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5479099-6b80-42aa-9790-5a73460bd3b6 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:31.082773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:31.088374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5afa49-7b1e-4749-bcfc-82ae0be78474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:31.089598 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5afa49-7b1e-4749-bcfc-82ae0be78474 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:31.089881 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5afa49-7b1e-4749-bcfc-82ae0be78474 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:31.090160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5afa49-7b1e-4749-bcfc-82ae0be78474 admin admin] PATH_INFO: `/v3/projects/483a8d9df85c400facb4de45752cca1d/users/e7d5adcf4a154e33b2d714bdd962bc99/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:31.118944 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5afa49-7b1e-4749-bcfc-82ae0be78474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=483a8d9df85c400facb4de45752cca1d, user_id=e7d5adcf4a154e33b2d714bdd962bc99, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:31.121679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5afa49-7b1e-4749-bcfc-82ae0be78474 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:31.201306 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1032/2075] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:31 2022] PUT /identity/v3/projects/483a8d9df85c400facb4de45752cca1d/users/e7d5adcf4a154e33b2d714bdd962bc99/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:31.214628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b660e-83c3-4527-8319-1b0c79963b46 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:31.214927 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b660e-83c3-4527-8319-1b0c79963b46 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:31.215215 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b660e-83c3-4527-8319-1b0c79963b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:31.217886 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-35cd1430-63ec-46ba-b80b-c005b6d0857a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ea5383fb15460889f9799bd7a33951', 'request_id': 'req-35cd1430-63ec-46ba-b80b-c005b6d0857a'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:31.224252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:31.233857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-35cd1430-63ec-46ba-b80b-c005b6d0857a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ea5383fb15460889f9799bd7a33951', 'request_id': 'req-35cd1430-63ec-46ba-b80b-c005b6d0857a'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:31.240905 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-35cd1430-63ec-46ba-b80b-c005b6d0857a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ea5383fb15460889f9799bd7a33951', 'request_id': 'req-35cd1430-63ec-46ba-b80b-c005b6d0857a'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:31.246068 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-a07b660e-83c3-4527-8319-1b0c79963b46 None None] MFA Rules not processed for user `e7d5adcf4a154e33b2d714bdd962bc99`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:31.247571 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-a07b660e-83c3-4527-8319-1b0c79963b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:31.328373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-35cd1430-63ec-46ba-b80b-c005b6d0857a admin admin] The token cache is being invalidate because project 85ea5383fb15460889f9799bd7a33951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:31.328672 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-35cd1430-63ec-46ba-b80b-c005b6d0857a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:31.329452 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-35cd1430-63ec-46ba-b80b-c005b6d0857a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:31.335680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1033/2076] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:31.335881 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1044/2077] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:30 2022] DELETE /identity/v3/projects/85ea5383fb15460889f9799bd7a33951 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:31.337955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc7c42-381e-4ba2-ac7d-e88aae90db81 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:31.338268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc7c42-381e-4ba2-ac7d-e88aae90db81 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:31.338893 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc7c42-381e-4ba2-ac7d-e88aae90db81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:31.358528 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-46fc7c42-381e-4ba2-ac7d-e88aae90db81 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:31.359742 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-46fc7c42-381e-4ba2-ac7d-e88aae90db81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:31.365016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd1430-63ec-46ba-b80b-c005b6d0857a admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:31.366397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-35cd1430-63ec-46ba-b80b-c005b6d0857a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:31.430094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1034/2078] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:58:31.430962 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc7c42-381e-4ba2-ac7d-e88aae90db81 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:31.432599 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-46fc7c42-381e-4ba2-ac7d-e88aae90db81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:31.448802 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd1430-63ec-46ba-b80b-c005b6d0857a admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:31.448802 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbd758-451c-4b93-9799-b587e31f93b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:31.448802 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbd758-451c-4b93-9799-b587e31f93b5 service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:31.448802 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbd758-451c-4b93-9799-b587e31f93b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:31.449947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbd758-451c-4b93-9799-b587e31f93b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:31.452025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-9abbd758-451c-4b93-9799-b587e31f93b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:31.456682 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc7c42-381e-4ba2-ac7d-e88aae90db81 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:31.461527 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65239686-ee2a-4323-a0f8-34bec7730e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:31.462510 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65239686-ee2a-4323-a0f8-34bec7730e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:31.462743 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65239686-ee2a-4323-a0f8-34bec7730e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:31.463019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65239686-ee2a-4323-a0f8-34bec7730e55 admin admin] PATH_INFO: `/v3/users/5c21a483d324416a95fbc0750005dc2c` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:31.464289 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65239686-ee2a-4323-a0f8-34bec7730e55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c21a483d324416a95fbc0750005dc2c)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:31.465325 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbd758-451c-4b93-9799-b587e31f93b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:31.466238 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65239686-ee2a-4323-a0f8-34bec7730e55 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:31.467747 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbd758-451c-4b93-9799-b587e31f93b5 service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:31.479690 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1045/2079] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:58:31.481047 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332d7cb-7cdb-4120-b7bd-a862fde4a8cd None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:31.481314 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332d7cb-7cdb-4120-b7bd-a862fde4a8cd None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:31.481600 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332d7cb-7cdb-4120-b7bd-a862fde4a8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:31.500520 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-0332d7cb-7cdb-4120-b7bd-a862fde4a8cd None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:31.501874 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0332d7cb-7cdb-4120-b7bd-a862fde4a8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:31.510130 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1046/2080] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:31.511013 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332d7cb-7cdb-4120-b7bd-a862fde4a8cd None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:31.512471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0332d7cb-7cdb-4120-b7bd-a862fde4a8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:31.527121 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332d7cb-7cdb-4120-b7bd-a862fde4a8cd None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:31.531757 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e40da6-959d-4af2-9950-e33093e989c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:31.532625 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e40da6-959d-4af2-9950-e33093e989c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:31.532910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e40da6-959d-4af2-9950-e33093e989c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:31.533219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e40da6-959d-4af2-9950-e33093e989c6 admin admin] PATH_INFO: `/v3/users/e7d5adcf4a154e33b2d714bdd962bc99` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:31.535548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e40da6-959d-4af2-9950-e33093e989c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7d5adcf4a154e33b2d714bdd962bc99)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:31.537525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e40da6-959d-4af2-9950-e33093e989c6 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:31.691460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-65239686-ee2a-4323-a0f8-34bec7730e55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c21a483d324416a95fbc0750005dc2c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:31.702888 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-65239686-ee2a-4323-a0f8-34bec7730e55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c21a483d324416a95fbc0750005dc2c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:31.756921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-74e40da6-959d-4af2-9950-e33093e989c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7d5adcf4a154e33b2d714bdd962bc99'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:31.768359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-74e40da6-959d-4af2-9950-e33093e989c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7d5adcf4a154e33b2d714bdd962bc99'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:31.884106 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-65239686-ee2a-4323-a0f8-34bec7730e55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c21a483d324416a95fbc0750005dc2c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:31.884653 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-65239686-ee2a-4323-a0f8-34bec7730e55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c21a483d324416a95fbc0750005dc2c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:31.892045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-65239686-ee2a-4323-a0f8-34bec7730e55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c21a483d324416a95fbc0750005dc2c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:31.898506 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1035/2081] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:31 2022] DELETE /identity/v3/users/5c21a483d324416a95fbc0750005dc2c => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:31.899444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65239686-ee2a-4323-a0f8-34bec7730e55 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:31.901102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-65239686-ee2a-4323-a0f8-34bec7730e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:31.949212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-74e40da6-959d-4af2-9950-e33093e989c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7d5adcf4a154e33b2d714bdd962bc99'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:31.949212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-74e40da6-959d-4af2-9950-e33093e989c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7d5adcf4a154e33b2d714bdd962bc99'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:31.958463 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-74e40da6-959d-4af2-9950-e33093e989c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7d5adcf4a154e33b2d714bdd962bc99'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:31.968145 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1047/2082] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:31 2022] DELETE /identity/v3/users/e7d5adcf4a154e33b2d714bdd962bc99 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:31.974128 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93420a4-ccbb-4331-944b-82adacdee261 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:31.974128 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93420a4-ccbb-4331-944b-82adacdee261 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:31.974128 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93420a4-ccbb-4331-944b-82adacdee261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:31.982708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65239686-ee2a-4323-a0f8-34bec7730e55 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:32.008299 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-f93420a4-ccbb-4331-944b-82adacdee261 None None] MFA Rules not processed for user `e8dba2c48a2145ab894681ec0720996e`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:32.009411 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f93420a4-ccbb-4331-944b-82adacdee261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:32.056778 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d5dcb-6cdf-4723-8eba-fbe717b4669f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:32.057643 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d5dcb-6cdf-4723-8eba-fbe717b4669f admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:32.057937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d5dcb-6cdf-4723-8eba-fbe717b4669f admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:32.058220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d5dcb-6cdf-4723-8eba-fbe717b4669f admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:32.058996 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d5dcb-6cdf-4723-8eba-fbe717b4669f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:58:32.059306 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d5dcb-6cdf-4723-8eba-fbe717b4669f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:32.060942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d5dcb-6cdf-4723-8eba-fbe717b4669f admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:32.073753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1036/2083] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:58:32.075031 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfc334-99b9-49df-b8fa-96bbb2ef861b None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:32.075435 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfc334-99b9-49df-b8fa-96bbb2ef861b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:32.075814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfc334-99b9-49df-b8fa-96bbb2ef861b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:32.083442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1048/2084] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:32.084647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93420a4-ccbb-4331-944b-82adacdee261 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:32.086317 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f93420a4-ccbb-4331-944b-82adacdee261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:32.104753 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93420a4-ccbb-4331-944b-82adacdee261 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:32.106275 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-f3cfc334-99b9-49df-b8fa-96bbb2ef861b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:32.108063 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f3cfc334-99b9-49df-b8fa-96bbb2ef861b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:32.111180 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be8b86-f333-4238-9937-011ec5a9a8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:32.112208 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be8b86-f333-4238-9937-011ec5a9a8df admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:32.113240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be8b86-f333-4238-9937-011ec5a9a8df admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:32.113682 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be8b86-f333-4238-9937-011ec5a9a8df admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:32.115021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be8b86-f333-4238-9937-011ec5a9a8df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:32.117612 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be8b86-f333-4238-9937-011ec5a9a8df admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:32.121004 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1037/2085] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:32.122666 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfc334-99b9-49df-b8fa-96bbb2ef861b None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:32.124208 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f3cfc334-99b9-49df-b8fa-96bbb2ef861b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:32.190206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfc334-99b9-49df-b8fa-96bbb2ef861b None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:32.194622 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf59640-d135-4f69-bea1-baa489087190 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:32.195274 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf59640-d135-4f69-bea1-baa489087190 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:32.195562 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf59640-d135-4f69-bea1-baa489087190 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:32.195845 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf59640-d135-4f69-bea1-baa489087190 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:32.204373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf59640-d135-4f69-bea1-baa489087190 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:32.206047 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf59640-d135-4f69-bea1-baa489087190 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:32.216186 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1038/2086] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:32.217294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf59640-d135-4f69-bea1-baa489087190 service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:32.218624 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ecf59640-d135-4f69-bea1-baa489087190 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:32.228581 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1049/2087] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:32 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:32.230027 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be8b86-f333-4238-9937-011ec5a9a8df admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:32.302607 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf59640-d135-4f69-bea1-baa489087190 service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:32.326407 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be8b86-f333-4238-9937-011ec5a9a8df admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:32.341335 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb08447-9fd1-4815-b8c1-b2a80c097192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:32.341335 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb08447-9fd1-4815-b8c1-b2a80c097192 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:32.341335 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb08447-9fd1-4815-b8c1-b2a80c097192 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:32.341335 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb08447-9fd1-4815-b8c1-b2a80c097192 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:32.343211 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb08447-9fd1-4815-b8c1-b2a80c097192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:32.345472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb08447-9fd1-4815-b8c1-b2a80c097192 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:32.372523 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dd025-5a19-425d-8831-50af76eaccde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:32.373205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dd025-5a19-425d-8831-50af76eaccde service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:32.373493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dd025-5a19-425d-8831-50af76eaccde service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:32.373771 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dd025-5a19-425d-8831-50af76eaccde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:32.383352 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dd025-5a19-425d-8831-50af76eaccde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:32.384780 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dd025-5a19-425d-8831-50af76eaccde service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:32.395335 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1039/2088] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:32.396141 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dd025-5a19-425d-8831-50af76eaccde service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:32.397476 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-c69dd025-5a19-425d-8831-50af76eaccde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:32.410498 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dd025-5a19-425d-8831-50af76eaccde service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:32.415357 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc4990-15ce-47cb-909c-046633321cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:32.416212 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc4990-15ce-47cb-909c-046633321cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:32.416496 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc4990-15ce-47cb-909c-046633321cec admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:32.416775 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc4990-15ce-47cb-909c-046633321cec admin admin] PATH_INFO: `/v3/projects/436fd73ddf1b4ff6b4485c5c06527ef6` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:32.417994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc4990-15ce-47cb-909c-046633321cec admin admin] RBAC: Authorizing `identity:delete_project(project_id=436fd73ddf1b4ff6b4485c5c06527ef6)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:32.419893 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc4990-15ce-47cb-909c-046633321cec admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:32.464620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1050/2089] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:32 2022] POST /identity/v3/users => generated 283 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:32.466064 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb08447-9fd1-4815-b8c1-b2a80c097192 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:32.477192 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb08447-9fd1-4815-b8c1-b2a80c097192 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:32.486350 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c9778-03ca-49f8-af1c-cbb247f351f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:32.491377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c9778-03ca-49f8-af1c-cbb247f351f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:32.492349 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c9778-03ca-49f8-af1c-cbb247f351f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:32.498902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c9778-03ca-49f8-af1c-cbb247f351f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:32.498902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c9778-03ca-49f8-af1c-cbb247f351f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:32.498902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c9778-03ca-49f8-af1c-cbb247f351f7 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:32.507862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1051/2090] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:32.511942 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c9778-03ca-49f8-af1c-cbb247f351f7 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:32.522683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c9778-03ca-49f8-af1c-cbb247f351f7 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:32.527478 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ade1a5-b9f1-4f7f-b47a-8e2325aae6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:32.528074 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ade1a5-b9f1-4f7f-b47a-8e2325aae6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:32.528701 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ade1a5-b9f1-4f7f-b47a-8e2325aae6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:32.528701 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ade1a5-b9f1-4f7f-b47a-8e2325aae6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:32.529438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ade1a5-b9f1-4f7f-b47a-8e2325aae6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:32.531076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ade1a5-b9f1-4f7f-b47a-8e2325aae6b6 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:32.541776 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1052/2091] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:58:32.545790 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ade1a5-b9f1-4f7f-b47a-8e2325aae6b6 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:32.556657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ade1a5-b9f1-4f7f-b47a-8e2325aae6b6 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:32.564698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-49fc4990-15ce-47cb-909c-046633321cec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436fd73ddf1b4ff6b4485c5c06527ef6', 'request_id': 'req-49fc4990-15ce-47cb-909c-046633321cec'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:32.572110 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-49fc4990-15ce-47cb-909c-046633321cec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436fd73ddf1b4ff6b4485c5c06527ef6', 'request_id': 'req-49fc4990-15ce-47cb-909c-046633321cec'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:32.578127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-49fc4990-15ce-47cb-909c-046633321cec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436fd73ddf1b4ff6b4485c5c06527ef6', 'request_id': 'req-49fc4990-15ce-47cb-909c-046633321cec'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:32.623780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735c8f8-58e1-4c3d-a7e8-366df84be372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:32.624693 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735c8f8-58e1-4c3d-a7e8-366df84be372 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:32.624994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735c8f8-58e1-4c3d-a7e8-366df84be372 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:32.625308 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735c8f8-58e1-4c3d-a7e8-366df84be372 admin admin] PATH_INFO: `/v3/projects/37fb0b88077442faa314315872de3a2b/users/d614472c81e34f1c82f4181dd8b9a3a9/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:32.646415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735c8f8-58e1-4c3d-a7e8-366df84be372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37fb0b88077442faa314315872de3a2b, user_id=d614472c81e34f1c82f4181dd8b9a3a9, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:32.649103 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735c8f8-58e1-4c3d-a7e8-366df84be372 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:32.671368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-49fc4990-15ce-47cb-909c-046633321cec admin admin] The token cache is being invalidate because project 436fd73ddf1b4ff6b4485c5c06527ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:32.671368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-49fc4990-15ce-47cb-909c-046633321cec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:32.671368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-49fc4990-15ce-47cb-909c-046633321cec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:32.671368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1040/2092] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:32 2022] DELETE /identity/v3/projects/436fd73ddf1b4ff6b4485c5c06527ef6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:32.676748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca07878-445d-48b1-b677-d5517a8ceae8 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:32.677039 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca07878-445d-48b1-b677-d5517a8ceae8 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:32.677352 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca07878-445d-48b1-b677-d5517a8ceae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:32.696820 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-2ca07878-445d-48b1-b677-d5517a8ceae8 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:32.698289 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-2ca07878-445d-48b1-b677-d5517a8ceae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:32.709189 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1041/2093] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:58:32.717213 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04a8f7-0bb5-4984-aabc-6ededf42abef None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:32.719820 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04a8f7-0bb5-4984-aabc-6ededf42abef None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:32.720141 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04a8f7-0bb5-4984-aabc-6ededf42abef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:32.741566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-de04a8f7-0bb5-4984-aabc-6ededf42abef None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:32.743429 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-de04a8f7-0bb5-4984-aabc-6ededf42abef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:32.744783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1053/2094] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:32 2022] PUT /identity/v3/projects/37fb0b88077442faa314315872de3a2b/users/d614472c81e34f1c82f4181dd8b9a3a9/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:58:32.746361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432d7e5-99e3-4c19-860f-89e6c10cc937 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:32.746662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432d7e5-99e3-4c19-860f-89e6c10cc937 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:32.746949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432d7e5-99e3-4c19-860f-89e6c10cc937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:32.789873 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-3432d7e5-99e3-4c19-860f-89e6c10cc937 None None] MFA Rules not processed for user `d614472c81e34f1c82f4181dd8b9a3a9`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:32.791571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-3432d7e5-99e3-4c19-860f-89e6c10cc937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:32.819558 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1042/2095] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:58:32.824732 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04a8f7-0bb5-4984-aabc-6ededf42abef None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:32.834452 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04a8f7-0bb5-4984-aabc-6ededf42abef None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:32.840262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85718c62-a83b-4aee-b797-66ac443dc28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:32.840945 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718c62-a83b-4aee-b797-66ac443dc28a admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:32.841309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718c62-a83b-4aee-b797-66ac443dc28a admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:32.841602 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718c62-a83b-4aee-b797-66ac443dc28a admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:32.842600 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85718c62-a83b-4aee-b797-66ac443dc28a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:58:32.842907 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85718c62-a83b-4aee-b797-66ac443dc28a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:32.844521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85718c62-a83b-4aee-b797-66ac443dc28a admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:32.860041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1043/2096] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:58:32.875173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85718c62-a83b-4aee-b797-66ac443dc28a admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:32.883382 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1054/2097] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:32.897244 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85718c62-a83b-4aee-b797-66ac443dc28a admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:32.899990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432d7e5-99e3-4c19-860f-89e6c10cc937 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:32.902355 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b3a61-856b-41c0-a01c-d05b9efbd08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:32.904410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b3a61-856b-41c0-a01c-d05b9efbd08d admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:32.904410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b3a61-856b-41c0-a01c-d05b9efbd08d admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:32.904410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b3a61-856b-41c0-a01c-d05b9efbd08d admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:32.904825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-3432d7e5-99e3-4c19-860f-89e6c10cc937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:32.904957 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b3a61-856b-41c0-a01c-d05b9efbd08d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:32.906703 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b3a61-856b-41c0-a01c-d05b9efbd08d admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:32.924788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:32.988696 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432d7e5-99e3-4c19-860f-89e6c10cc937 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:32.993124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9bf58-528d-4e7c-9977-b5150632f103 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f078219032be4b619119d1d9d59c499d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:32.993809 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9bf58-528d-4e7c-9977-b5150632f103 service glance] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:32.994154 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9bf58-528d-4e7c-9977-b5150632f103 service glance] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:32.994442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9bf58-528d-4e7c-9977-b5150632f103 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:33.005226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9bf58-528d-4e7c-9977-b5150632f103 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:33.006876 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9bf58-528d-4e7c-9977-b5150632f103 service glance] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:33.017284 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1055/2098] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:58:33.019458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9bf58-528d-4e7c-9977-b5150632f103 service glance] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:33.020810 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-a8d9bf58-528d-4e7c-9977-b5150632f103 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:33.035053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9bf58-528d-4e7c-9977-b5150632f103 service glance] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:33.041068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df9cf7-3d55-4dbb-9e23-71f53162c9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:33.041967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df9cf7-3d55-4dbb-9e23-71f53162c9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:33.042303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df9cf7-3d55-4dbb-9e23-71f53162c9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:33.042588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df9cf7-3d55-4dbb-9e23-71f53162c9c8 admin admin] PATH_INFO: `/v3/projects/483a8d9df85c400facb4de45752cca1d` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:33.048562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df9cf7-3d55-4dbb-9e23-71f53162c9c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=483a8d9df85c400facb4de45752cca1d)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:33.051488 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df9cf7-3d55-4dbb-9e23-71f53162c9c8 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:33.058855 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1044/2099] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:32 2022] POST /identity/v3/projects => generated 393 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:58:33.059212 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b3a61-856b-41c0-a01c-d05b9efbd08d admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:33.148423 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b3a61-856b-41c0-a01c-d05b9efbd08d admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:33.153828 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065465a-1ea9-417b-9146-10425ddfbe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:33.154499 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065465a-1ea9-417b-9146-10425ddfbe5f admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:33.154836 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065465a-1ea9-417b-9146-10425ddfbe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:33.155123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065465a-1ea9-417b-9146-10425ddfbe5f admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:33.155907 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065465a-1ea9-417b-9146-10425ddfbe5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:33.157846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065465a-1ea9-417b-9146-10425ddfbe5f admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:33.194579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d5df9cf7-3d55-4dbb-9e23-71f53162c9c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '483a8d9df85c400facb4de45752cca1d', 'request_id': 'req-d5df9cf7-3d55-4dbb-9e23-71f53162c9c8'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:33.201352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d5df9cf7-3d55-4dbb-9e23-71f53162c9c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '483a8d9df85c400facb4de45752cca1d', 'request_id': 'req-d5df9cf7-3d55-4dbb-9e23-71f53162c9c8'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:33.228710 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d5df9cf7-3d55-4dbb-9e23-71f53162c9c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '483a8d9df85c400facb4de45752cca1d', 'request_id': 'req-d5df9cf7-3d55-4dbb-9e23-71f53162c9c8'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:33.254528 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1045/2100] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:33 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:58:33.257764 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065465a-1ea9-417b-9146-10425ddfbe5f admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:33.268772 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065465a-1ea9-417b-9146-10425ddfbe5f admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:33.339323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6a639-ce0b-4f88-8a71-a6f263b2e25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:33.340205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6a639-ce0b-4f88-8a71-a6f263b2e25d admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:33.340499 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6a639-ce0b-4f88-8a71-a6f263b2e25d admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:33.340964 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6a639-ce0b-4f88-8a71-a6f263b2e25d admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:33.341783 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6a639-ce0b-4f88-8a71-a6f263b2e25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:33.346213 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6a639-ce0b-4f88-8a71-a6f263b2e25d admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:33.348558 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d5df9cf7-3d55-4dbb-9e23-71f53162c9c8 admin admin] The token cache is being invalidate because project 483a8d9df85c400facb4de45752cca1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:33.349078 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d5df9cf7-3d55-4dbb-9e23-71f53162c9c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:33.350141 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d5df9cf7-3d55-4dbb-9e23-71f53162c9c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:33.354044 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1056/2101] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:33 2022] DELETE /identity/v3/projects/483a8d9df85c400facb4de45752cca1d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:33.359860 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b52f2-5eb8-4f84-ac67-2b757176c483 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:33.360796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b52f2-5eb8-4f84-ac67-2b757176c483 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:33.361837 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b52f2-5eb8-4f84-ac67-2b757176c483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:33.363938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1046/2102] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:33.366622 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6a639-ce0b-4f88-8a71-a6f263b2e25d admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:33.368660 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-52f6a639-ce0b-4f88-8a71-a6f263b2e25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:33.383767 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6a639-ce0b-4f88-8a71-a6f263b2e25d admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:33.384464 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-c07b52f2-5eb8-4f84-ac67-2b757176c483 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:33.385851 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c07b52f2-5eb8-4f84-ac67-2b757176c483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:33.396318 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1d648-1242-4600-a24f-df681fbb036f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:33.397122 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1d648-1242-4600-a24f-df681fbb036f admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:33.397453 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1d648-1242-4600-a24f-df681fbb036f admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:33.397769 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1d648-1242-4600-a24f-df681fbb036f admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:33.398678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1d648-1242-4600-a24f-df681fbb036f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:33.399749 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1057/2103] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:33.400328 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1d648-1242-4600-a24f-df681fbb036f admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:33.407378 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b186fc-340d-4d38-bd1f-086f58b248ed None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:33.407668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b186fc-340d-4d38-bd1f-086f58b248ed None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:33.407955 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b186fc-340d-4d38-bd1f-086f58b248ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:33.413291 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1047/2104] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:58:33.416048 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1d648-1242-4600-a24f-df681fbb036f admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:33.426274 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1d648-1242-4600-a24f-df681fbb036f admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:33.430935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-b0b186fc-340d-4d38-bd1f-086f58b248ed None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:33.431059 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aae44b-44fc-4299-a806-df822df2db0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:33.431629 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aae44b-44fc-4299-a806-df822df2db0c admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:33.431914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aae44b-44fc-4299-a806-df822df2db0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:33.432039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-b0b186fc-340d-4d38-bd1f-086f58b248ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:33.432183 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aae44b-44fc-4299-a806-df822df2db0c admin admin] PATH_INFO: `/v3/projects/cc166d65903448cc81553c3410943745/users/93501679612c4fc4bfa079af8bb6cfd0/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:33.441842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1058/2105] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:58:33.444996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b186fc-340d-4d38-bd1f-086f58b248ed None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:33.449509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aae44b-44fc-4299-a806-df822df2db0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc166d65903448cc81553c3410943745, user_id=93501679612c4fc4bfa079af8bb6cfd0, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:33.452218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aae44b-44fc-4299-a806-df822df2db0c admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:33.454318 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b186fc-340d-4d38-bd1f-086f58b248ed None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:33.459144 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f0672-c0e5-43a2-8719-c67bed9072c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:33.459794 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f0672-c0e5-43a2-8719-c67bed9072c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:33.460075 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f0672-c0e5-43a2-8719-c67bed9072c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:33.460354 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f0672-c0e5-43a2-8719-c67bed9072c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:33.461079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f0672-c0e5-43a2-8719-c67bed9072c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:58:33.461418 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f0672-c0e5-43a2-8719-c67bed9072c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:33.463008 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f0672-c0e5-43a2-8719-c67bed9072c8 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:33.473470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:33.478995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1059/2106] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:58:33.480031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f0672-c0e5-43a2-8719-c67bed9072c8 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:33.490498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f0672-c0e5-43a2-8719-c67bed9072c8 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:33.495291 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ea37f-e230-42a3-a7b3-a144e0e54423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:33.495933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ea37f-e230-42a3-a7b3-a144e0e54423 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:33.499414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ea37f-e230-42a3-a7b3-a144e0e54423 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:33.499414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ea37f-e230-42a3-a7b3-a144e0e54423 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:33.499414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ea37f-e230-42a3-a7b3-a144e0e54423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:33.499414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ea37f-e230-42a3-a7b3-a144e0e54423 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:33.524434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1048/2107] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:33 2022] PUT /identity/v3/projects/cc166d65903448cc81553c3410943745/users/93501679612c4fc4bfa079af8bb6cfd0/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:58:33.529279 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c4cd8-7678-4c7d-bf5d-41942462ece7 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:33.529571 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c4cd8-7678-4c7d-bf5d-41942462ece7 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:33.529851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c4cd8-7678-4c7d-bf5d-41942462ece7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:33.546995 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-091c4cd8-7678-4c7d-bf5d-41942462ece7 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:33.548348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-091c4cd8-7678-4c7d-bf5d-41942462ece7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:33.596304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1060/2108] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:33 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:33.601608 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ea37f-e230-42a3-a7b3-a144e0e54423 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:33.608006 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1049/2109] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:58:33.618662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c4cd8-7678-4c7d-bf5d-41942462ece7 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:33.621249 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-091c4cd8-7678-4c7d-bf5d-41942462ece7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:33.676041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ea37f-e230-42a3-a7b3-a144e0e54423 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:33.680983 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b88b6-fd7a-43b0-8df9-f67202e38932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:33.681628 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b88b6-fd7a-43b0-8df9-f67202e38932 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:33.681922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b88b6-fd7a-43b0-8df9-f67202e38932 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:33.682207 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b88b6-fd7a-43b0-8df9-f67202e38932 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:33.682909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b88b6-fd7a-43b0-8df9-f67202e38932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:33.683120 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c4cd8-7678-4c7d-bf5d-41942462ece7 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:33.684989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b88b6-fd7a-43b0-8df9-f67202e38932 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:33.733211 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da74ce0-85d3-4d10-9f35-b5493ca08dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:33.733871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74ce0-85d3-4d10-9f35-b5493ca08dda service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:33.734157 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74ce0-85d3-4d10-9f35-b5493ca08dda service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:33.734438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74ce0-85d3-4d10-9f35-b5493ca08dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:33.744093 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da74ce0-85d3-4d10-9f35-b5493ca08dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:33.745577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da74ce0-85d3-4d10-9f35-b5493ca08dda service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:33.754865 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1050/2110] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:33.800165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1061/2111] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:33 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:58:33.804302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da74ce0-85d3-4d10-9f35-b5493ca08dda service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:33.813924 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da74ce0-85d3-4d10-9f35-b5493ca08dda service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:33.818719 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92390e-1ef3-4c65-9c3c-1b29f8aef3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:33.819372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92390e-1ef3-4c65-9c3c-1b29f8aef3ab admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:33.819658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92390e-1ef3-4c65-9c3c-1b29f8aef3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:33.819962 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92390e-1ef3-4c65-9c3c-1b29f8aef3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:33.820685 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92390e-1ef3-4c65-9c3c-1b29f8aef3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:33.830672 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92390e-1ef3-4c65-9c3c-1b29f8aef3ab admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:33.842918 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1051/2112] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:33.847503 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b88b6-fd7a-43b0-8df9-f67202e38932 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:33.859906 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b88b6-fd7a-43b0-8df9-f67202e38932 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:33.863004 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5dd37-b115-4448-8aa3-4b33b24bb09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:33.863790 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5dd37-b115-4448-8aa3-4b33b24bb09f admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:33.864314 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5dd37-b115-4448-8aa3-4b33b24bb09f admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:33.864597 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5dd37-b115-4448-8aa3-4b33b24bb09f admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:33.865402 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5dd37-b115-4448-8aa3-4b33b24bb09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:33.867151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5dd37-b115-4448-8aa3-4b33b24bb09f admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:33.877752 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1062/2113] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:58:33.883286 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92390e-1ef3-4c65-9c3c-1b29f8aef3ab admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:33.896146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92390e-1ef3-4c65-9c3c-1b29f8aef3ab admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:33.906175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c573127-1b69-4333-a6ba-d2acf4779792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:33.907048 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c573127-1b69-4333-a6ba-d2acf4779792 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:33.907335 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c573127-1b69-4333-a6ba-d2acf4779792 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:33.907620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c573127-1b69-4333-a6ba-d2acf4779792 admin admin] PATH_INFO: `/v3/projects/f44d39542a9449babe5c7e9c43418f9d/users/63755662d9a84fc4829e3e759d240c7a/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:33.925007 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c573127-1b69-4333-a6ba-d2acf4779792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44d39542a9449babe5c7e9c43418f9d, user_id=63755662d9a84fc4829e3e759d240c7a, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:33.927696 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c573127-1b69-4333-a6ba-d2acf4779792 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:34.014167 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1052/2114] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:33 2022] PUT /identity/v3/projects/f44d39542a9449babe5c7e9c43418f9d/users/63755662d9a84fc4829e3e759d240c7a/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:34.020328 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52eac3-0707-4a4d-aecd-5e8d6821caa0 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:34.020625 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52eac3-0707-4a4d-aecd-5e8d6821caa0 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:34.020915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52eac3-0707-4a4d-aecd-5e8d6821caa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:34.047826 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-2f52eac3-0707-4a4d-aecd-5e8d6821caa0 None None] MFA Rules not processed for user `63755662d9a84fc4829e3e759d240c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:34.049052 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-2f52eac3-0707-4a4d-aecd-5e8d6821caa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:34.135375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1063/2115] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:34.150454 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c573127-1b69-4333-a6ba-d2acf4779792 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:34.150454 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-8c573127-1b69-4333-a6ba-d2acf4779792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:34.216939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c573127-1b69-4333-a6ba-d2acf4779792 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:34.220753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159e384-dbcb-4edf-b5e1-a2094db88767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:34.221463 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159e384-dbcb-4edf-b5e1-a2094db88767 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:34.222318 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159e384-dbcb-4edf-b5e1-a2094db88767 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:34.222838 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159e384-dbcb-4edf-b5e1-a2094db88767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:34.231087 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159e384-dbcb-4edf-b5e1-a2094db88767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:34.232505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159e384-dbcb-4edf-b5e1-a2094db88767 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:34.242284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1053/2116] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:35.127966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893df5f-7395-463c-9db2-9ae37de8ca57 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:35.128588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893df5f-7395-463c-9db2-9ae37de8ca57 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:35.128826 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893df5f-7395-463c-9db2-9ae37de8ca57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:35.150256 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-a893df5f-7395-463c-9db2-9ae37de8ca57 None None] MFA Rules not processed for user `e8dba2c48a2145ab894681ec0720996e`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:35.151428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-a893df5f-7395-463c-9db2-9ae37de8ca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:35.209068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1064/2117] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:36.029250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:36.976329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:38.892516 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:38.959346 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:41.063200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:41.120204 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:41.133599 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159e384-dbcb-4edf-b5e1-a2094db88767 service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:41.187940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138820c4-d4a5-42a1-b7dd-2e26238f1c3b None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:41.188296 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138820c4-d4a5-42a1-b7dd-2e26238f1c3b None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:41.188590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138820c4-d4a5-42a1-b7dd-2e26238f1c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:41.235900 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-138820c4-d4a5-42a1-b7dd-2e26238f1c3b None None] MFA Rules not processed for user `93501679612c4fc4bfa079af8bb6cfd0`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:41.237869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-138820c4-d4a5-42a1-b7dd-2e26238f1c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:41.259507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159e384-dbcb-4edf-b5e1-a2094db88767 service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:41.267793 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cb24a-90cd-42ec-9028-5b064cfc8b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:41.270396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cb24a-90cd-42ec-9028-5b064cfc8b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:41.270690 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cb24a-90cd-42ec-9028-5b064cfc8b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:41.270977 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cb24a-90cd-42ec-9028-5b064cfc8b0f admin admin] PATH_INFO: `/v3/users/63755662d9a84fc4829e3e759d240c7a` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:41.272285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cb24a-90cd-42ec-9028-5b064cfc8b0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=63755662d9a84fc4829e3e759d240c7a)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:41.275281 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cb24a-90cd-42ec-9028-5b064cfc8b0f admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:41.344378 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1065/2118] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:58:41.364091 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975214f-4f34-4336-aa0f-0a81435aac93 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:41.364486 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975214f-4f34-4336-aa0f-0a81435aac93 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:41.364789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975214f-4f34-4336-aa0f-0a81435aac93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:41.394739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-d975214f-4f34-4336-aa0f-0a81435aac93 None None] MFA Rules not processed for user `93501679612c4fc4bfa079af8bb6cfd0`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:41.396092 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d975214f-4f34-4336-aa0f-0a81435aac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:41.409639 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1066/2119] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:58:41.417493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975214f-4f34-4336-aa0f-0a81435aac93 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:41.421915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d975214f-4f34-4336-aa0f-0a81435aac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:41.509391 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975214f-4f34-4336-aa0f-0a81435aac93 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:41.514401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-444cb24a-90cd-42ec-9028-5b064cfc8b0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63755662d9a84fc4829e3e759d240c7a'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:41.516802 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe0c7a-db0a-4f05-b4f8-23ee9dd80958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:41.517539 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe0c7a-db0a-4f05-b4f8-23ee9dd80958 service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:41.517818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe0c7a-db0a-4f05-b4f8-23ee9dd80958 service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:41.518160 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe0c7a-db0a-4f05-b4f8-23ee9dd80958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:41.527222 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe0c7a-db0a-4f05-b4f8-23ee9dd80958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:41.528862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe0c7a-db0a-4f05-b4f8-23ee9dd80958 service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:41.540268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1067/2120] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:41.556056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-444cb24a-90cd-42ec-9028-5b064cfc8b0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63755662d9a84fc4829e3e759d240c7a'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:41.651659 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-444cb24a-90cd-42ec-9028-5b064cfc8b0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63755662d9a84fc4829e3e759d240c7a'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:41.652567 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-444cb24a-90cd-42ec-9028-5b064cfc8b0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63755662d9a84fc4829e3e759d240c7a'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:41.665587 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-444cb24a-90cd-42ec-9028-5b064cfc8b0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63755662d9a84fc4829e3e759d240c7a'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:41.670754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1054/2121] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:41 2022] DELETE /identity/v3/users/63755662d9a84fc4829e3e759d240c7a => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:41.675455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18660f6a-bcc0-45d6-b041-4836924da96c None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:41.675754 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18660f6a-bcc0-45d6-b041-4836924da96c None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:41.676045 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18660f6a-bcc0-45d6-b041-4836924da96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:41.714121 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-18660f6a-bcc0-45d6-b041-4836924da96c None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:41.715678 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-18660f6a-bcc0-45d6-b041-4836924da96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:41.808235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1068/2122] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:41.818307 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cb24a-90cd-42ec-9028-5b064cfc8b0f admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:41.820162 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-444cb24a-90cd-42ec-9028-5b064cfc8b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:41.898919 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cb24a-90cd-42ec-9028-5b064cfc8b0f admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:41.903146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f43cf-caf5-4724-a2bf-27fe7ff4b897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:41.903942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f43cf-caf5-4724-a2bf-27fe7ff4b897 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:41.904831 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f43cf-caf5-4724-a2bf-27fe7ff4b897 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:41.904831 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f43cf-caf5-4724-a2bf-27fe7ff4b897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:41.924646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f43cf-caf5-4724-a2bf-27fe7ff4b897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:41.924646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f43cf-caf5-4724-a2bf-27fe7ff4b897 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:41.936547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1055/2123] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:42.543738 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:42.569021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18660f6a-bcc0-45d6-b041-4836924da96c None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:42.570556 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-18660f6a-bcc0-45d6-b041-4836924da96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:42.583655 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203596a8-6502-4514-81da-c6046182e467 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:42.585132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203596a8-6502-4514-81da-c6046182e467 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:42.585956 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203596a8-6502-4514-81da-c6046182e467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:42.627555 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-203596a8-6502-4514-81da-c6046182e467 None None] MFA Rules not processed for user `93501679612c4fc4bfa079af8bb6cfd0`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:42.635615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-203596a8-6502-4514-81da-c6046182e467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:42.770759 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18660f6a-bcc0-45d6-b041-4836924da96c None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:42.775484 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cb65e-60d0-4e3f-8fe0-fbfd4a7aa30b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:42.778310 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cb65e-60d0-4e3f-8fe0-fbfd4a7aa30b service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:42.778310 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cb65e-60d0-4e3f-8fe0-fbfd4a7aa30b service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:42.778310 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cb65e-60d0-4e3f-8fe0-fbfd4a7aa30b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:42.778613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-442cb65e-60d0-4e3f-8fe0-fbfd4a7aa30b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:42.791297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1056/2124] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:42.791297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203596a8-6502-4514-81da-c6046182e467 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:42.795293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-203596a8-6502-4514-81da-c6046182e467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:42.826057 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203596a8-6502-4514-81da-c6046182e467 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:42.839025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238ff70-98ac-47d0-9c7c-f688e93c3643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:42.840027 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238ff70-98ac-47d0-9c7c-f688e93c3643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:42.840186 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238ff70-98ac-47d0-9c7c-f688e93c3643 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:42.840463 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238ff70-98ac-47d0-9c7c-f688e93c3643 admin admin] PATH_INFO: `/v3/projects/f44d39542a9449babe5c7e9c43418f9d` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:42.844040 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238ff70-98ac-47d0-9c7c-f688e93c3643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f44d39542a9449babe5c7e9c43418f9d)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:42.846169 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238ff70-98ac-47d0-9c7c-f688e93c3643 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:42.922511 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cb65e-60d0-4e3f-8fe0-fbfd4a7aa30b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:42.924215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cb65e-60d0-4e3f-8fe0-fbfd4a7aa30b service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:42.937965 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1069/2125] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:43.063318 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f238ff70-98ac-47d0-9c7c-f688e93c3643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f44d39542a9449babe5c7e9c43418f9d', 'request_id': 'req-f238ff70-98ac-47d0-9c7c-f688e93c3643'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:43.072702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f238ff70-98ac-47d0-9c7c-f688e93c3643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f44d39542a9449babe5c7e9c43418f9d', 'request_id': 'req-f238ff70-98ac-47d0-9c7c-f688e93c3643'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:43.093672 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f238ff70-98ac-47d0-9c7c-f688e93c3643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f44d39542a9449babe5c7e9c43418f9d', 'request_id': 'req-f238ff70-98ac-47d0-9c7c-f688e93c3643'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:43.247457 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f238ff70-98ac-47d0-9c7c-f688e93c3643 admin admin] The token cache is being invalidate because project f44d39542a9449babe5c7e9c43418f9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:43.248035 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f238ff70-98ac-47d0-9c7c-f688e93c3643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:43.249834 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f238ff70-98ac-47d0-9c7c-f688e93c3643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:43.270686 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1057/2126] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:42 2022] DELETE /identity/v3/projects/f44d39542a9449babe5c7e9c43418f9d => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:43.274363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151acf7e-60f6-44df-b85d-2b0fd0c0d35f None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:43.274664 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151acf7e-60f6-44df-b85d-2b0fd0c0d35f None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:43.274953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151acf7e-60f6-44df-b85d-2b0fd0c0d35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:43.319370 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-151acf7e-60f6-44df-b85d-2b0fd0c0d35f None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:43.322452 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-151acf7e-60f6-44df-b85d-2b0fd0c0d35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:43.457897 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:43.494229 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1070/2127] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:43.495218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fab238-3d57-49f6-8c8e-eae6118ec008 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:43.495719 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fab238-3d57-49f6-8c8e-eae6118ec008 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:43.495981 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fab238-3d57-49f6-8c8e-eae6118ec008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:43.549563 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-d8fab238-3d57-49f6-8c8e-eae6118ec008 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:43.552291 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d8fab238-3d57-49f6-8c8e-eae6118ec008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:43.587183 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151acf7e-60f6-44df-b85d-2b0fd0c0d35f None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:43.598517 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1058/2128] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:58:43.603711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151acf7e-60f6-44df-b85d-2b0fd0c0d35f None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:43.616902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4839f6-2d7a-4338-a033-1bb92949036f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:43.617679 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4839f6-2d7a-4338-a033-1bb92949036f admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:43.618403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4839f6-2d7a-4338-a033-1bb92949036f admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:43.619590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4839f6-2d7a-4338-a033-1bb92949036f admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:43.620530 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4839f6-2d7a-4338-a033-1bb92949036f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:58:43.621243 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4839f6-2d7a-4338-a033-1bb92949036f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:43.623472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4839f6-2d7a-4338-a033-1bb92949036f admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:43.644981 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1071/2129] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:58:43.649094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fab238-3d57-49f6-8c8e-eae6118ec008 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:43.661054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fab238-3d57-49f6-8c8e-eae6118ec008 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:43.666522 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b555480-0b45-45d3-b2de-62fb1d82eb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:43.667702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b555480-0b45-45d3-b2de-62fb1d82eb78 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:43.668282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b555480-0b45-45d3-b2de-62fb1d82eb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:43.668959 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b555480-0b45-45d3-b2de-62fb1d82eb78 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:43.670051 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b555480-0b45-45d3-b2de-62fb1d82eb78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:43.672328 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b555480-0b45-45d3-b2de-62fb1d82eb78 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:43.816183 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1059/2130] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:43 2022] POST /identity/v3/projects => generated 369 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:43.820369 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4839f6-2d7a-4338-a033-1bb92949036f admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:43.840515 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4839f6-2d7a-4338-a033-1bb92949036f admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:43.966517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fbfdd-0bf2-4911-95ac-e0c3c9ec2e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:43.967476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fbfdd-0bf2-4911-95ac-e0c3c9ec2e6f admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:43.968345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fbfdd-0bf2-4911-95ac-e0c3c9ec2e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:43.968345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fbfdd-0bf2-4911-95ac-e0c3c9ec2e6f admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:43.968976 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fbfdd-0bf2-4911-95ac-e0c3c9ec2e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:43.971052 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fbfdd-0bf2-4911-95ac-e0c3c9ec2e6f admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:44.086465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1072/2131] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:43 2022] POST /identity/v3/users => generated 285 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:44.088658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b555480-0b45-45d3-b2de-62fb1d82eb78 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:44.145939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b555480-0b45-45d3-b2de-62fb1d82eb78 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:44.174300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc55672-65ba-4386-a2b4-f09fe5885b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:44.181237 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc55672-65ba-4386-a2b4-f09fe5885b23 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:44.181751 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc55672-65ba-4386-a2b4-f09fe5885b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:44.183653 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc55672-65ba-4386-a2b4-f09fe5885b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:44.185685 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc55672-65ba-4386-a2b4-f09fe5885b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:44.193908 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc55672-65ba-4386-a2b4-f09fe5885b23 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:44.258054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1060/2132] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:44.260933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fbfdd-0bf2-4911-95ac-e0c3c9ec2e6f admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:44.275628 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fbfdd-0bf2-4911-95ac-e0c3c9ec2e6f admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:44.303858 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb14660-741f-480a-8cc5-5981e6b5980a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:44.311669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb14660-741f-480a-8cc5-5981e6b5980a admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:44.311669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb14660-741f-480a-8cc5-5981e6b5980a admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:44.311669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb14660-741f-480a-8cc5-5981e6b5980a admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:44.311669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb14660-741f-480a-8cc5-5981e6b5980a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:44.311669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb14660-741f-480a-8cc5-5981e6b5980a admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:44.327566 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1073/2133] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:44.332030 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc55672-65ba-4386-a2b4-f09fe5885b23 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:44.343928 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc55672-65ba-4386-a2b4-f09fe5885b23 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:44.357145 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c8d69-a019-4a97-b634-2c58e29e3b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:44.358094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c8d69-a019-4a97-b634-2c58e29e3b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:44.358385 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c8d69-a019-4a97-b634-2c58e29e3b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:44.358728 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c8d69-a019-4a97-b634-2c58e29e3b49 admin admin] PATH_INFO: `/v3/projects/579e891be8e748d0bae1990fd84860e5/users/4b745f9a3c924557ac9b11154d72bb50/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:44.370602 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:44.396922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c8d69-a019-4a97-b634-2c58e29e3b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=579e891be8e748d0bae1990fd84860e5, user_id=4b745f9a3c924557ac9b11154d72bb50, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:44.402852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c8d69-a019-4a97-b634-2c58e29e3b49 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:44.598725 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1061/2134] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:44 2022] PUT /identity/v3/projects/579e891be8e748d0bae1990fd84860e5/users/4b745f9a3c924557ac9b11154d72bb50/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:44.614866 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2b7a3-e50f-4df5-8fde-7f5eca4c9413 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:44.616543 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2b7a3-e50f-4df5-8fde-7f5eca4c9413 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:44.617217 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2b7a3-e50f-4df5-8fde-7f5eca4c9413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:44.708384 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-7ee2b7a3-e50f-4df5-8fde-7f5eca4c9413 None None] MFA Rules not processed for user `4b745f9a3c924557ac9b11154d72bb50`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:44.719541 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7ee2b7a3-e50f-4df5-8fde-7f5eca4c9413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:44.953631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1074/2135] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:44.979815 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c8d69-a019-4a97-b634-2c58e29e3b49 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:44.981702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-a31c8d69-a019-4a97-b634-2c58e29e3b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:45.288620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c8d69-a019-4a97-b634-2c58e29e3b49 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:45.322836 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa55c15-87df-412d-96ef-a0a619e41221 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f078219032be4b619119d1d9d59c499d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:45.324885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa55c15-87df-412d-96ef-a0a619e41221 service glance] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:45.325241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa55c15-87df-412d-96ef-a0a619e41221 service glance] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:45.330000 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa55c15-87df-412d-96ef-a0a619e41221 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:45.369109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa55c15-87df-412d-96ef-a0a619e41221 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:45.370602 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa55c15-87df-412d-96ef-a0a619e41221 service glance] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:45.386527 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1062/2136] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:45.457223 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:47.385354 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2b7a3-e50f-4df5-8fde-7f5eca4c9413 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:47.387796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7ee2b7a3-e50f-4df5-8fde-7f5eca4c9413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:47.481607 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2b7a3-e50f-4df5-8fde-7f5eca4c9413 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:47.487446 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ffd8b-7583-4567-97d6-90621912b0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:47.488821 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ffd8b-7583-4567-97d6-90621912b0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:47.489323 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ffd8b-7583-4567-97d6-90621912b0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:47.489548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ffd8b-7583-4567-97d6-90621912b0e5 admin admin] PATH_INFO: `/v3/users/877c1ed322d644f7909ed0293f0eddd5` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:47.491217 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ffd8b-7583-4567-97d6-90621912b0e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=877c1ed322d644f7909ed0293f0eddd5)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:47.493561 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ffd8b-7583-4567-97d6-90621912b0e5 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:47.702454 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7e5ffd8b-7583-4567-97d6-90621912b0e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '877c1ed322d644f7909ed0293f0eddd5'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:47.721055 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7e5ffd8b-7583-4567-97d6-90621912b0e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '877c1ed322d644f7909ed0293f0eddd5'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:47.789780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:47.795317 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7e5ffd8b-7583-4567-97d6-90621912b0e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '877c1ed322d644f7909ed0293f0eddd5'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:47.795317 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7e5ffd8b-7583-4567-97d6-90621912b0e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '877c1ed322d644f7909ed0293f0eddd5'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:47.802864 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7e5ffd8b-7583-4567-97d6-90621912b0e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '877c1ed322d644f7909ed0293f0eddd5'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:47.815470 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1075/2137] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:47 2022] DELETE /identity/v3/users/877c1ed322d644f7909ed0293f0eddd5 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:47.816562 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e62261-2961-4b7e-bf5c-1e4850b6f020 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:47.817063 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e62261-2961-4b7e-bf5c-1e4850b6f020 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:47.817256 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e62261-2961-4b7e-bf5c-1e4850b6f020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:47.837325 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-53e62261-2961-4b7e-bf5c-1e4850b6f020 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:47.838508 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-53e62261-2961-4b7e-bf5c-1e4850b6f020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:47.941019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1063/2138] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:58:47.951615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ffd8b-7583-4567-97d6-90621912b0e5 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:47.953289 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7e5ffd8b-7583-4567-97d6-90621912b0e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:48.034925 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ffd8b-7583-4567-97d6-90621912b0e5 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:48.039504 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f344e17-8c3b-41fa-8867-65b72db6741c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:48.040319 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f344e17-8c3b-41fa-8867-65b72db6741c service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:48.040713 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f344e17-8c3b-41fa-8867-65b72db6741c service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:48.041101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f344e17-8c3b-41fa-8867-65b72db6741c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:48.055492 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f344e17-8c3b-41fa-8867-65b72db6741c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:48.057425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f344e17-8c3b-41fa-8867-65b72db6741c service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:48.070137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1076/2139] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:48.463349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:48.841337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e62261-2961-4b7e-bf5c-1e4850b6f020 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:48.842170 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-53e62261-2961-4b7e-bf5c-1e4850b6f020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:48.870324 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e62261-2961-4b7e-bf5c-1e4850b6f020 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:48.899211 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95e77c-9205-4e12-a469-2376477796d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:48.900121 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95e77c-9205-4e12-a469-2376477796d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:48.900414 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95e77c-9205-4e12-a469-2376477796d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:48.900698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95e77c-9205-4e12-a469-2376477796d2 admin admin] PATH_INFO: `/v3/projects/cdfc3fdcc33a46ec99fd82a900a7f796` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:48.904013 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95e77c-9205-4e12-a469-2376477796d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdfc3fdcc33a46ec99fd82a900a7f796)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:48.914847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95e77c-9205-4e12-a469-2376477796d2 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:49.111707 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6f95e77c-9205-4e12-a469-2376477796d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdfc3fdcc33a46ec99fd82a900a7f796', 'request_id': 'req-6f95e77c-9205-4e12-a469-2376477796d2'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:49.120488 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6f95e77c-9205-4e12-a469-2376477796d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdfc3fdcc33a46ec99fd82a900a7f796', 'request_id': 'req-6f95e77c-9205-4e12-a469-2376477796d2'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:49.131580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6f95e77c-9205-4e12-a469-2376477796d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdfc3fdcc33a46ec99fd82a900a7f796', 'request_id': 'req-6f95e77c-9205-4e12-a469-2376477796d2'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:49.231256 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6f95e77c-9205-4e12-a469-2376477796d2 admin admin] The token cache is being invalidate because project cdfc3fdcc33a46ec99fd82a900a7f796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:49.231256 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6f95e77c-9205-4e12-a469-2376477796d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:49.231256 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6f95e77c-9205-4e12-a469-2376477796d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:49.231256 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1064/2140] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:48 2022] DELETE /identity/v3/projects/cdfc3fdcc33a46ec99fd82a900a7f796 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:49.233931 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f344e17-8c3b-41fa-8867-65b72db6741c service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:49.246469 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f344e17-8c3b-41fa-8867-65b72db6741c service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:49.308815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648bb71b-199d-474c-be00-3a87eac21df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:49.308815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bb71b-199d-474c-be00-3a87eac21df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:49.309097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bb71b-199d-474c-be00-3a87eac21df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:49.309376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bb71b-199d-474c-be00-3a87eac21df9 admin admin] PATH_INFO: `/v3/users/4bf1c37e4191412d8873536edfbbe5e6` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:49.311501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648bb71b-199d-474c-be00-3a87eac21df9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bf1c37e4191412d8873536edfbbe5e6)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:49.313483 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648bb71b-199d-474c-be00-3a87eac21df9 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:49.530550 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-648bb71b-199d-474c-be00-3a87eac21df9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bf1c37e4191412d8873536edfbbe5e6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:49.546232 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-648bb71b-199d-474c-be00-3a87eac21df9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bf1c37e4191412d8873536edfbbe5e6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:49.657101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-648bb71b-199d-474c-be00-3a87eac21df9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bf1c37e4191412d8873536edfbbe5e6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:49.657761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-648bb71b-199d-474c-be00-3a87eac21df9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bf1c37e4191412d8873536edfbbe5e6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:49.666320 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-648bb71b-199d-474c-be00-3a87eac21df9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bf1c37e4191412d8873536edfbbe5e6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:49.672685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1077/2141] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:49 2022] DELETE /identity/v3/users/4bf1c37e4191412d8873536edfbbe5e6 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:58:49.845906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:49.907993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:50.480686 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95e77c-9205-4e12-a469-2376477796d2 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:50.484372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-6f95e77c-9205-4e12-a469-2376477796d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:50.540708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95e77c-9205-4e12-a469-2376477796d2 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:50.626580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc786dc5-27d9-4cf2-9e36-f3500f4a0ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:50.627544 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc786dc5-27d9-4cf2-9e36-f3500f4a0ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:50.627944 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc786dc5-27d9-4cf2-9e36-f3500f4a0ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:50.628441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc786dc5-27d9-4cf2-9e36-f3500f4a0ee0 admin admin] PATH_INFO: `/v3/projects/1b0bee5b728842f497538891a27bd6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:50.630514 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc786dc5-27d9-4cf2-9e36-f3500f4a0ee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b0bee5b728842f497538891a27bd6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:50.633049 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc786dc5-27d9-4cf2-9e36-f3500f4a0ee0 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:50.829672 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-fc786dc5-27d9-4cf2-9e36-f3500f4a0ee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b0bee5b728842f497538891a27bd6e8', 'request_id': 'req-fc786dc5-27d9-4cf2-9e36-f3500f4a0ee0'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:50.837346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-fc786dc5-27d9-4cf2-9e36-f3500f4a0ee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b0bee5b728842f497538891a27bd6e8', 'request_id': 'req-fc786dc5-27d9-4cf2-9e36-f3500f4a0ee0'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:50.843483 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-fc786dc5-27d9-4cf2-9e36-f3500f4a0ee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b0bee5b728842f497538891a27bd6e8', 'request_id': 'req-fc786dc5-27d9-4cf2-9e36-f3500f4a0ee0'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:50.954881 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-fc786dc5-27d9-4cf2-9e36-f3500f4a0ee0 admin admin] The token cache is being invalidate because project 1b0bee5b728842f497538891a27bd6e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:58:50.955951 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-fc786dc5-27d9-4cf2-9e36-f3500f4a0ee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:50.958450 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-fc786dc5-27d9-4cf2-9e36-f3500f4a0ee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:50.960386 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1065/2142] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:58:50 2022] DELETE /identity/v3/projects/1b0bee5b728842f497538891a27bd6e8 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:58:50.967624 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01965a-21cb-4291-8e9d-27ebc1f88697 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:50.968543 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01965a-21cb-4291-8e9d-27ebc1f88697 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:50.968921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01965a-21cb-4291-8e9d-27ebc1f88697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:50.991942 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-0f01965a-21cb-4291-8e9d-27ebc1f88697 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:50.993243 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0f01965a-21cb-4291-8e9d-27ebc1f88697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:51.068049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1078/2143] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:51.075762 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fabff6-741e-4c17-8859-4ed80995c5cc None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:51.076058 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fabff6-741e-4c17-8859-4ed80995c5cc None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:51.077422 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fabff6-741e-4c17-8859-4ed80995c5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:51.105104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-f6fabff6-741e-4c17-8859-4ed80995c5cc None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:51.106667 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f6fabff6-741e-4c17-8859-4ed80995c5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:51.118863 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1066/2144] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:51.123523 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01965a-21cb-4291-8e9d-27ebc1f88697 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:51.136587 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01965a-21cb-4291-8e9d-27ebc1f88697 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:51.142306 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcaa1f-487f-44a1-b1ab-929f4e66fc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:51.143841 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcaa1f-487f-44a1-b1ab-929f4e66fc4d admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:51.144336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcaa1f-487f-44a1-b1ab-929f4e66fc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:51.144620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcaa1f-487f-44a1-b1ab-929f4e66fc4d admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:51.145383 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcaa1f-487f-44a1-b1ab-929f4e66fc4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:58:51.145826 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcaa1f-487f-44a1-b1ab-929f4e66fc4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:51.147754 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcaa1f-487f-44a1-b1ab-929f4e66fc4d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:51.165986 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1079/2145] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:58:51.173012 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fabff6-741e-4c17-8859-4ed80995c5cc None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:51.185267 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fabff6-741e-4c17-8859-4ed80995c5cc None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:51.191301 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf343be-c4f2-4007-bee9-bbf371181a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:51.192364 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf343be-c4f2-4007-bee9-bbf371181a91 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:51.192732 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf343be-c4f2-4007-bee9-bbf371181a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:51.193270 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf343be-c4f2-4007-bee9-bbf371181a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:51.194186 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf343be-c4f2-4007-bee9-bbf371181a91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:51.196491 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf343be-c4f2-4007-bee9-bbf371181a91 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:51.327223 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1067/2146] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:51 2022] POST /identity/v3/projects => generated 399 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:51.332546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcaa1f-487f-44a1-b1ab-929f4e66fc4d admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:51.355407 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcaa1f-487f-44a1-b1ab-929f4e66fc4d admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:51.378220 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:51.465551 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0398156-be8f-4d6a-800d-183e27a5a554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:51.468004 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0398156-be8f-4d6a-800d-183e27a5a554 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:51.469417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0398156-be8f-4d6a-800d-183e27a5a554 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:51.469857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0398156-be8f-4d6a-800d-183e27a5a554 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:51.470747 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0398156-be8f-4d6a-800d-183e27a5a554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:51.473718 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0398156-be8f-4d6a-800d-183e27a5a554 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:51.611539 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1080/2147] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:51 2022] POST /identity/v3/users => generated 300 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:51.616111 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf343be-c4f2-4007-bee9-bbf371181a91 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:51.630487 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf343be-c4f2-4007-bee9-bbf371181a91 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:51.635835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84741c1d-c703-4934-8cf8-1019b374ca79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:51.636629 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84741c1d-c703-4934-8cf8-1019b374ca79 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:51.637009 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84741c1d-c703-4934-8cf8-1019b374ca79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:51.637388 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84741c1d-c703-4934-8cf8-1019b374ca79 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:51.638577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84741c1d-c703-4934-8cf8-1019b374ca79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:51.640728 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84741c1d-c703-4934-8cf8-1019b374ca79 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:51.656095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1068/2148] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:58:51.657324 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0398156-be8f-4d6a-800d-183e27a5a554 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:51.667928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0398156-be8f-4d6a-800d-183e27a5a554 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:51.673318 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40df89-07be-4aa6-8e26-214a2ea93ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:51.673988 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40df89-07be-4aa6-8e26-214a2ea93ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:51.674280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40df89-07be-4aa6-8e26-214a2ea93ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:51.674622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40df89-07be-4aa6-8e26-214a2ea93ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:51.675374 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40df89-07be-4aa6-8e26-214a2ea93ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:51.677049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40df89-07be-4aa6-8e26-214a2ea93ea1 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:51.691774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1081/2149] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:51.697340 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84741c1d-c703-4934-8cf8-1019b374ca79 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:51.703932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84741c1d-c703-4934-8cf8-1019b374ca79 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:51.710247 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e45eac-47d6-45e9-af18-7fbbcc9d7530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:51.711143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e45eac-47d6-45e9-af18-7fbbcc9d7530 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:51.711430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e45eac-47d6-45e9-af18-7fbbcc9d7530 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:51.711735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e45eac-47d6-45e9-af18-7fbbcc9d7530 admin admin] PATH_INFO: `/v3/projects/43acd8bee6eb47c7a1300f191e306577/users/0881ee49234641b29f304c3be9bbb994/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:51.728767 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e45eac-47d6-45e9-af18-7fbbcc9d7530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43acd8bee6eb47c7a1300f191e306577, user_id=0881ee49234641b29f304c3be9bbb994, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:51.731985 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e45eac-47d6-45e9-af18-7fbbcc9d7530 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:51.911945 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1069/2150] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:51 2022] PUT /identity/v3/projects/43acd8bee6eb47c7a1300f191e306577/users/0881ee49234641b29f304c3be9bbb994/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:51.914952 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dd6ab-b138-45f4-b775-8000e800c8cb None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:51.917799 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dd6ab-b138-45f4-b775-8000e800c8cb None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:51.917799 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dd6ab-b138-45f4-b775-8000e800c8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:51.955964 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-7e8dd6ab-b138-45f4-b775-8000e800c8cb None None] MFA Rules not processed for user `0881ee49234641b29f304c3be9bbb994`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:51.957691 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7e8dd6ab-b138-45f4-b775-8000e800c8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:52.043923 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1082/2151] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:52.048493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e45eac-47d6-45e9-af18-7fbbcc9d7530 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:52.085879 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:INSERT=4,keystone:DELETE=6,keystone:SELECT=90 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:52.170469 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e45eac-47d6-45e9-af18-7fbbcc9d7530 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:52.176439 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb2341-f91b-4fdd-8b3a-5141ac699867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:52.177096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb2341-f91b-4fdd-8b3a-5141ac699867 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:52.177695 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb2341-f91b-4fdd-8b3a-5141ac699867 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:52.177980 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb2341-f91b-4fdd-8b3a-5141ac699867 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:52.178730 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb2341-f91b-4fdd-8b3a-5141ac699867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:52.180729 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb2341-f91b-4fdd-8b3a-5141ac699867 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:52.376795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1070/2152] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:58:52 2022] POST /identity/v3/projects => generated 401 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:58:52.380576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dd6ab-b138-45f4-b775-8000e800c8cb None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:52.398011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dd6ab-b138-45f4-b775-8000e800c8cb None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:52.505528 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf741662-8dd2-4082-b306-6e3340327707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:52.508337 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf741662-8dd2-4082-b306-6e3340327707 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:52.508337 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf741662-8dd2-4082-b306-6e3340327707 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:52.508337 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf741662-8dd2-4082-b306-6e3340327707 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:52.508337 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf741662-8dd2-4082-b306-6e3340327707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:52.509669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf741662-8dd2-4082-b306-6e3340327707 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:52.611571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1083/2153] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:58:52 2022] POST /identity/v3/users => generated 307 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:58:52.613544 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb2341-f91b-4fdd-8b3a-5141ac699867 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:52.624928 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb2341-f91b-4fdd-8b3a-5141ac699867 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:52.635897 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7faf9f-4a5c-465d-946f-e14707336fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:52.636913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7faf9f-4a5c-465d-946f-e14707336fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:52.637336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7faf9f-4a5c-465d-946f-e14707336fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:52.637619 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7faf9f-4a5c-465d-946f-e14707336fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:52.638390 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7faf9f-4a5c-465d-946f-e14707336fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:52.639989 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7faf9f-4a5c-465d-946f-e14707336fb0 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:52.656503 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1071/2154] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:58:52.657700 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf741662-8dd2-4082-b306-6e3340327707 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:52.670718 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf741662-8dd2-4082-b306-6e3340327707 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:52.682348 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ee1ff-25ab-43bd-b097-6d529f84af8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:52.683176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ee1ff-25ab-43bd-b097-6d529f84af8a admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:52.683465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ee1ff-25ab-43bd-b097-6d529f84af8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:52.683746 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ee1ff-25ab-43bd-b097-6d529f84af8a admin admin] PATH_INFO: `/v3/projects/d09417e70ef94f7a9e0e071a7e967235/users/1243fd53a73b4e1f96ddec94a0ad8467/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:52.703379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ee1ff-25ab-43bd-b097-6d529f84af8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09417e70ef94f7a9e0e071a7e967235, user_id=1243fd53a73b4e1f96ddec94a0ad8467, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:52.706828 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ee1ff-25ab-43bd-b097-6d529f84af8a admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:52.840666 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1084/2155] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:52 2022] PUT /identity/v3/projects/d09417e70ef94f7a9e0e071a7e967235/users/1243fd53a73b4e1f96ddec94a0ad8467/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:52.845228 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7faf9f-4a5c-465d-946f-e14707336fb0 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:52.855907 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7faf9f-4a5c-465d-946f-e14707336fb0 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:52.920990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf11fe4-14f0-43c2-b0b9-cc8ce69b33dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:52.921801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf11fe4-14f0-43c2-b0b9-cc8ce69b33dd admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:52.922170 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf11fe4-14f0-43c2-b0b9-cc8ce69b33dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:52.922494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf11fe4-14f0-43c2-b0b9-cc8ce69b33dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:52.923354 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf11fe4-14f0-43c2-b0b9-cc8ce69b33dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:52.926821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf11fe4-14f0-43c2-b0b9-cc8ce69b33dd admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:52.937637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1072/2156] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:58:52.942072 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ee1ff-25ab-43bd-b097-6d529f84af8a admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:52.953482 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ee1ff-25ab-43bd-b097-6d529f84af8a admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:52.960024 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa68ce-55d7-4fc2-86f3-02cdd4d69885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:52.961752 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa68ce-55d7-4fc2-86f3-02cdd4d69885 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:52.962252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa68ce-55d7-4fc2-86f3-02cdd4d69885 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:52.962751 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa68ce-55d7-4fc2-86f3-02cdd4d69885 admin admin] PATH_INFO: `/v3/projects/d09417e70ef94f7a9e0e071a7e967235/users/1243fd53a73b4e1f96ddec94a0ad8467/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:52.966484 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa68ce-55d7-4fc2-86f3-02cdd4d69885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09417e70ef94f7a9e0e071a7e967235, user_id=1243fd53a73b4e1f96ddec94a0ad8467, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:52.972628 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa68ce-55d7-4fc2-86f3-02cdd4d69885 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:52.986566 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1085/2157] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:58:52 2022] PUT /identity/v3/projects/d09417e70ef94f7a9e0e071a7e967235/users/1243fd53a73b4e1f96ddec94a0ad8467/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:53.001792 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a48eeb-aefb-43a0-bf74-6b4434c8b54b None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:53.002084 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a48eeb-aefb-43a0-bf74-6b4434c8b54b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:53.002387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a48eeb-aefb-43a0-bf74-6b4434c8b54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:53.031416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-b6a48eeb-aefb-43a0-bf74-6b4434c8b54b None None] MFA Rules not processed for user `1243fd53a73b4e1f96ddec94a0ad8467`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:53.032659 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-b6a48eeb-aefb-43a0-bf74-6b4434c8b54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:53.110718 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1073/2158] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:53 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:53.121588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa68ce-55d7-4fc2-86f3-02cdd4d69885 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:53.123327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e6fa68ce-55d7-4fc2-86f3-02cdd4d69885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:53.191729 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa68ce-55d7-4fc2-86f3-02cdd4d69885 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:53.195511 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362f0c6-c4d0-4bb8-9ffe-2fd39d0eca04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:53.196165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362f0c6-c4d0-4bb8-9ffe-2fd39d0eca04 service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:53.196488 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362f0c6-c4d0-4bb8-9ffe-2fd39d0eca04 service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:53.196774 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362f0c6-c4d0-4bb8-9ffe-2fd39d0eca04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:53.207092 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362f0c6-c4d0-4bb8-9ffe-2fd39d0eca04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:53.208598 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362f0c6-c4d0-4bb8-9ffe-2fd39d0eca04 service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:53.218849 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1086/2159] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:53 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:53.401639 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a48eeb-aefb-43a0-bf74-6b4434c8b54b None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:53.411529 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a48eeb-aefb-43a0-bf74-6b4434c8b54b None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:53.415168 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf32dc-a150-4181-abdf-1da23a0014a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:53.415959 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf32dc-a150-4181-abdf-1da23a0014a9 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:53.416184 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf32dc-a150-4181-abdf-1da23a0014a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:53.416467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf32dc-a150-4181-abdf-1da23a0014a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:53.477703 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf32dc-a150-4181-abdf-1da23a0014a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:53.479197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf32dc-a150-4181-abdf-1da23a0014a9 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:53.493375 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1074/2160] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:58:54.062728 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:54.920586 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:56.286969 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:58:58.219849 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727d578-6ff2-4da7-96e0-88782554e57c None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:58.220494 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727d578-6ff2-4da7-96e0-88782554e57c None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:58.220822 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727d578-6ff2-4da7-96e0-88782554e57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:58.246889 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-2727d578-6ff2-4da7-96e0-88782554e57c None None] MFA Rules not processed for user `e8dba2c48a2145ab894681ec0720996e`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:58.246889 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-2727d578-6ff2-4da7-96e0-88782554e57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:58.310383 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1087/2161] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:58:59.054989 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf32dc-a150-4181-abdf-1da23a0014a9 service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:59.156106 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf32dc-a150-4181-abdf-1da23a0014a9 service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:59.164351 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdb252-3c22-4deb-bc2a-0089d8055d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:59.165849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdb252-3c22-4deb-bc2a-0089d8055d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:59.166504 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdb252-3c22-4deb-bc2a-0089d8055d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:59.167216 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdb252-3c22-4deb-bc2a-0089d8055d72 admin admin] PATH_INFO: `/v3/users/0881ee49234641b29f304c3be9bbb994` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:59.168891 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdb252-3c22-4deb-bc2a-0089d8055d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0881ee49234641b29f304c3be9bbb994)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:59.171515 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdb252-3c22-4deb-bc2a-0089d8055d72 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:59.438021 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-7dcdb252-3c22-4deb-bc2a-0089d8055d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0881ee49234641b29f304c3be9bbb994'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:59.452395 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-7dcdb252-3c22-4deb-bc2a-0089d8055d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0881ee49234641b29f304c3be9bbb994'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:59.592854 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-7dcdb252-3c22-4deb-bc2a-0089d8055d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0881ee49234641b29f304c3be9bbb994'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:59.601476 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-7dcdb252-3c22-4deb-bc2a-0089d8055d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0881ee49234641b29f304c3be9bbb994'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:59.602896 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-7dcdb252-3c22-4deb-bc2a-0089d8055d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0881ee49234641b29f304c3be9bbb994'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:58:59.609025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1075/2162] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:58:59 2022] DELETE /identity/v3/users/0881ee49234641b29f304c3be9bbb994 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:58:59.618536 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec67a9a-9ace-4bda-91eb-74c28215d877 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:59.618974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec67a9a-9ace-4bda-91eb-74c28215d877 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:59.619151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec67a9a-9ace-4bda-91eb-74c28215d877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:59.642266 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-bec67a9a-9ace-4bda-91eb-74c28215d877 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:58:59.643540 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-bec67a9a-9ace-4bda-91eb-74c28215d877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:59.729509 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1088/2163] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:58:59.741925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdb252-3c22-4deb-bc2a-0089d8055d72 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:58:59.743997 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-7dcdb252-3c22-4deb-bc2a-0089d8055d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:58:59.814459 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdb252-3c22-4deb-bc2a-0089d8055d72 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:58:59.821130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbd73b-5d56-443a-9804-02c71b27a5fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:58:59.822132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbd73b-5d56-443a-9804-02c71b27a5fb service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:58:59.822422 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbd73b-5d56-443a-9804-02c71b27a5fb service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:58:59.822755 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbd73b-5d56-443a-9804-02c71b27a5fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:58:59.839699 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbd73b-5d56-443a-9804-02c71b27a5fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:58:59.841266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbd73b-5d56-443a-9804-02c71b27a5fb service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:58:59.855848 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1076/2164] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:58:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:59:00.441843 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec67a9a-9ace-4bda-91eb-74c28215d877 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:00.444169 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-bec67a9a-9ace-4bda-91eb-74c28215d877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:00.472544 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec67a9a-9ace-4bda-91eb-74c28215d877 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:00.478279 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed969a6f-9c79-42e3-a054-53d64ea855a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:00.479213 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed969a6f-9c79-42e3-a054-53d64ea855a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:00.479680 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed969a6f-9c79-42e3-a054-53d64ea855a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:00.480137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed969a6f-9c79-42e3-a054-53d64ea855a8 admin admin] PATH_INFO: `/v3/projects/43acd8bee6eb47c7a1300f191e306577` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:00.481644 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed969a6f-9c79-42e3-a054-53d64ea855a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43acd8bee6eb47c7a1300f191e306577)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:00.484666 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed969a6f-9c79-42e3-a054-53d64ea855a8 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:00.642402 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ed969a6f-9c79-42e3-a054-53d64ea855a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43acd8bee6eb47c7a1300f191e306577', 'request_id': 'req-ed969a6f-9c79-42e3-a054-53d64ea855a8'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:00.655972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ed969a6f-9c79-42e3-a054-53d64ea855a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43acd8bee6eb47c7a1300f191e306577', 'request_id': 'req-ed969a6f-9c79-42e3-a054-53d64ea855a8'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:00.664504 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ed969a6f-9c79-42e3-a054-53d64ea855a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43acd8bee6eb47c7a1300f191e306577', 'request_id': 'req-ed969a6f-9c79-42e3-a054-53d64ea855a8'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:00.758408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:00.811175 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ed969a6f-9c79-42e3-a054-53d64ea855a8 admin admin] The token cache is being invalidate because project 43acd8bee6eb47c7a1300f191e306577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:59:00.811790 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ed969a6f-9c79-42e3-a054-53d64ea855a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:00.812664 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ed969a6f-9c79-42e3-a054-53d64ea855a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:00.814746 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1089/2165] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:59:00 2022] DELETE /identity/v3/projects/43acd8bee6eb47c7a1300f191e306577 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:00.820101 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbd73b-5d56-443a-9804-02c71b27a5fb service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:00.831178 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbd73b-5d56-443a-9804-02c71b27a5fb service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:00.903508 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80ff6a-845d-4e5e-abaa-2283b548387a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:00.904486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80ff6a-845d-4e5e-abaa-2283b548387a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:00.904671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80ff6a-845d-4e5e-abaa-2283b548387a admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:00.905124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80ff6a-845d-4e5e-abaa-2283b548387a admin admin] PATH_INFO: `/v3/users/1243fd53a73b4e1f96ddec94a0ad8467` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:00.906419 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80ff6a-845d-4e5e-abaa-2283b548387a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1243fd53a73b4e1f96ddec94a0ad8467)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:00.908780 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80ff6a-845d-4e5e-abaa-2283b548387a admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:01.156256 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8b80ff6a-845d-4e5e-abaa-2283b548387a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1243fd53a73b4e1f96ddec94a0ad8467'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:01.176069 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8b80ff6a-845d-4e5e-abaa-2283b548387a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1243fd53a73b4e1f96ddec94a0ad8467'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:01.268067 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8b80ff6a-845d-4e5e-abaa-2283b548387a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1243fd53a73b4e1f96ddec94a0ad8467'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:01.268766 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8b80ff6a-845d-4e5e-abaa-2283b548387a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1243fd53a73b4e1f96ddec94a0ad8467'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:01.277678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8b80ff6a-845d-4e5e-abaa-2283b548387a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1243fd53a73b4e1f96ddec94a0ad8467'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:01.294627 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1077/2166] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:59:00 2022] DELETE /identity/v3/users/1243fd53a73b4e1f96ddec94a0ad8467 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:01.801914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed969a6f-9c79-42e3-a054-53d64ea855a8 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:01.803506 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ed969a6f-9c79-42e3-a054-53d64ea855a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:01.816450 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed969a6f-9c79-42e3-a054-53d64ea855a8 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:01.878136 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d26f73-83ca-4e89-baef-f1fde94bf5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:01.879055 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d26f73-83ca-4e89-baef-f1fde94bf5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:01.879493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d26f73-83ca-4e89-baef-f1fde94bf5de admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:01.879793 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d26f73-83ca-4e89-baef-f1fde94bf5de admin admin] PATH_INFO: `/v3/projects/d09417e70ef94f7a9e0e071a7e967235` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:01.881021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d26f73-83ca-4e89-baef-f1fde94bf5de admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09417e70ef94f7a9e0e071a7e967235)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:01.883049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d26f73-83ca-4e89-baef-f1fde94bf5de admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:02.003896 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-21d26f73-83ca-4e89-baef-f1fde94bf5de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09417e70ef94f7a9e0e071a7e967235', 'request_id': 'req-21d26f73-83ca-4e89-baef-f1fde94bf5de'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:02.010210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-21d26f73-83ca-4e89-baef-f1fde94bf5de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09417e70ef94f7a9e0e071a7e967235', 'request_id': 'req-21d26f73-83ca-4e89-baef-f1fde94bf5de'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:02.015531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-21d26f73-83ca-4e89-baef-f1fde94bf5de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09417e70ef94f7a9e0e071a7e967235', 'request_id': 'req-21d26f73-83ca-4e89-baef-f1fde94bf5de'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:02.113057 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-21d26f73-83ca-4e89-baef-f1fde94bf5de admin admin] The token cache is being invalidate because project d09417e70ef94f7a9e0e071a7e967235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:59:02.113482 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-21d26f73-83ca-4e89-baef-f1fde94bf5de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:02.114700 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-21d26f73-83ca-4e89-baef-f1fde94bf5de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:02.116459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1090/2167] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:59:01 2022] DELETE /identity/v3/projects/d09417e70ef94f7a9e0e071a7e967235 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:02.121703 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280ac26-d547-45a4-ab35-8b39428d8a73 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:02.122157 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280ac26-d547-45a4-ab35-8b39428d8a73 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:02.122282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280ac26-d547-45a4-ab35-8b39428d8a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:02.140686 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-e280ac26-d547-45a4-ab35-8b39428d8a73 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:02.141930 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e280ac26-d547-45a4-ab35-8b39428d8a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:02.207002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1078/2168] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:02.209656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622461cc-848d-42f6-801b-2dbfc487a582 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:02.210045 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622461cc-848d-42f6-801b-2dbfc487a582 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:02.210384 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622461cc-848d-42f6-801b-2dbfc487a582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:02.231375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-622461cc-848d-42f6-801b-2dbfc487a582 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:02.232819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-622461cc-848d-42f6-801b-2dbfc487a582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:02.251255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1091/2169] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:02.255788 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280ac26-d547-45a4-ab35-8b39428d8a73 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:02.267686 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280ac26-d547-45a4-ab35-8b39428d8a73 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:02.273616 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f2db6-5cee-49f7-bec7-4902da604829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:02.277846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f2db6-5cee-49f7-bec7-4902da604829 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:02.277846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f2db6-5cee-49f7-bec7-4902da604829 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:02.277846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f2db6-5cee-49f7-bec7-4902da604829 admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:02.277846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f2db6-5cee-49f7-bec7-4902da604829 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:59:02.277846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f2db6-5cee-49f7-bec7-4902da604829 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:02.278264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f2db6-5cee-49f7-bec7-4902da604829 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:02.290572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1079/2170] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:59:02.294971 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622461cc-848d-42f6-801b-2dbfc487a582 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:02.308742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622461cc-848d-42f6-801b-2dbfc487a582 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:02.314263 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393012d-511d-430c-891d-1971080082a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:02.314979 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393012d-511d-430c-891d-1971080082a7 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:02.315263 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393012d-511d-430c-891d-1971080082a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:02.315534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393012d-511d-430c-891d-1971080082a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:02.316418 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393012d-511d-430c-891d-1971080082a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:02.320054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393012d-511d-430c-891d-1971080082a7 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:02.430296 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1092/2171] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:59:02 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:59:02.434368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f2db6-5cee-49f7-bec7-4902da604829 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:02.451955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f2db6-5cee-49f7-bec7-4902da604829 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:02.518751 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2217085-c4fa-4666-bc00-c54c70e257d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:02.519572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2217085-c4fa-4666-bc00-c54c70e257d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:02.519858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2217085-c4fa-4666-bc00-c54c70e257d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:02.520683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2217085-c4fa-4666-bc00-c54c70e257d3 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:02.521688 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2217085-c4fa-4666-bc00-c54c70e257d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:02.523342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2217085-c4fa-4666-bc00-c54c70e257d3 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:02.672015 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1080/2172] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:59:02 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:59:02.682612 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393012d-511d-430c-891d-1971080082a7 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:02.696473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393012d-511d-430c-891d-1971080082a7 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:02.701491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:02.707213 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93101bc0-d2f1-4248-9ec5-c2d448359825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:02.710077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93101bc0-d2f1-4248-9ec5-c2d448359825 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:02.710341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93101bc0-d2f1-4248-9ec5-c2d448359825 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:02.710623 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93101bc0-d2f1-4248-9ec5-c2d448359825 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:02.711424 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93101bc0-d2f1-4248-9ec5-c2d448359825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:02.713246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93101bc0-d2f1-4248-9ec5-c2d448359825 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:02.724718 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1093/2173] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:59:02.728849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2217085-c4fa-4666-bc00-c54c70e257d3 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:02.740291 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2217085-c4fa-4666-bc00-c54c70e257d3 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:02.746014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958ca0b-1f10-4385-b2f4-89b6c166ac2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:02.746738 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958ca0b-1f10-4385-b2f4-89b6c166ac2b admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:02.747008 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958ca0b-1f10-4385-b2f4-89b6c166ac2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:02.747293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958ca0b-1f10-4385-b2f4-89b6c166ac2b admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:02.748023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958ca0b-1f10-4385-b2f4-89b6c166ac2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:02.749699 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958ca0b-1f10-4385-b2f4-89b6c166ac2b admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:02.763045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1081/2174] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:59:02.767536 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93101bc0-d2f1-4248-9ec5-c2d448359825 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:02.780398 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93101bc0-d2f1-4248-9ec5-c2d448359825 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:02.785125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32523340-593c-4eee-89ef-54711fede0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:02.786156 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32523340-593c-4eee-89ef-54711fede0dc admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:02.786424 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32523340-593c-4eee-89ef-54711fede0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:02.786705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32523340-593c-4eee-89ef-54711fede0dc admin admin] PATH_INFO: `/v3/projects/50f6cdbe571149fb8e3bf3c73e2782ab/users/6f7a0e00d5df42a8a9a13bbb233f9344/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:02.801656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32523340-593c-4eee-89ef-54711fede0dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f6cdbe571149fb8e3bf3c73e2782ab, user_id=6f7a0e00d5df42a8a9a13bbb233f9344, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:02.804350 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32523340-593c-4eee-89ef-54711fede0dc admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:02.900358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1094/2175] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:59:02 2022] PUT /identity/v3/projects/50f6cdbe571149fb8e3bf3c73e2782ab/users/6f7a0e00d5df42a8a9a13bbb233f9344/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:02.911751 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754655c-2cb5-4366-b9e6-e3eeed9a6422 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:02.912142 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754655c-2cb5-4366-b9e6-e3eeed9a6422 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:02.916446 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754655c-2cb5-4366-b9e6-e3eeed9a6422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:02.964041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-0754655c-2cb5-4366-b9e6-e3eeed9a6422 None None] MFA Rules not processed for user `6f7a0e00d5df42a8a9a13bbb233f9344`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:02.965302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-0754655c-2cb5-4366-b9e6-e3eeed9a6422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:03.032753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1082/2176] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:03.038110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32523340-593c-4eee-89ef-54711fede0dc admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:03.120234 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32523340-593c-4eee-89ef-54711fede0dc admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:03.125392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ec92b-df3c-446e-b3bd-b11e1df41dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:03.126074 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ec92b-df3c-446e-b3bd-b11e1df41dce admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:03.126362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ec92b-df3c-446e-b3bd-b11e1df41dce admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:03.126644 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ec92b-df3c-446e-b3bd-b11e1df41dce admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:03.127372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ec92b-df3c-446e-b3bd-b11e1df41dce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:03.131275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ec92b-df3c-446e-b3bd-b11e1df41dce admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:03.252981 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1095/2177] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:59:03 2022] POST /identity/v3/projects => generated 381 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:59:03.257847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754655c-2cb5-4366-b9e6-e3eeed9a6422 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:03.270266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754655c-2cb5-4366-b9e6-e3eeed9a6422 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:03.363121 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8ad94-89ff-41a5-8171-e54321af043c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:03.364968 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8ad94-89ff-41a5-8171-e54321af043c admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:03.365502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8ad94-89ff-41a5-8171-e54321af043c admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:03.365805 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8ad94-89ff-41a5-8171-e54321af043c admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:03.366863 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8ad94-89ff-41a5-8171-e54321af043c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:03.371769 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8ad94-89ff-41a5-8171-e54321af043c admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:03.456951 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1083/2178] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:59:03 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:59:03.464713 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ec92b-df3c-446e-b3bd-b11e1df41dce admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:03.476832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ec92b-df3c-446e-b3bd-b11e1df41dce admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:03.482844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812181c-7260-4915-adec-061814145057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:03.484163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812181c-7260-4915-adec-061814145057 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:03.484621 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812181c-7260-4915-adec-061814145057 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:03.485750 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812181c-7260-4915-adec-061814145057 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:03.486809 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812181c-7260-4915-adec-061814145057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:03.491504 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812181c-7260-4915-adec-061814145057 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:03.506118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1096/2179] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:59:03.510811 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8ad94-89ff-41a5-8171-e54321af043c admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:03.524441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8ad94-89ff-41a5-8171-e54321af043c admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:03.532467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0715450-92c7-4900-a1d1-f520f1e1d962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:03.547494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0715450-92c7-4900-a1d1-f520f1e1d962 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:03.547863 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0715450-92c7-4900-a1d1-f520f1e1d962 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:03.548218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0715450-92c7-4900-a1d1-f520f1e1d962 admin admin] PATH_INFO: `/v3/projects/554a055632914eb3a46a965327bbc8c6/users/7c83861b66f1485faefb7838bce33e68/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:03.588146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0715450-92c7-4900-a1d1-f520f1e1d962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=554a055632914eb3a46a965327bbc8c6, user_id=7c83861b66f1485faefb7838bce33e68, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:03.590897 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0715450-92c7-4900-a1d1-f520f1e1d962 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:03.692484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1084/2180] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:59:03 2022] PUT /identity/v3/projects/554a055632914eb3a46a965327bbc8c6/users/7c83861b66f1485faefb7838bce33e68/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:03.696616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812181c-7260-4915-adec-061814145057 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:03.708206 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812181c-7260-4915-adec-061814145057 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:03.784823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f0ed2-1a3d-4256-b38b-92121b8dfdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:03.785876 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f0ed2-1a3d-4256-b38b-92121b8dfdac admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:03.786530 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f0ed2-1a3d-4256-b38b-92121b8dfdac admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:03.786974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f0ed2-1a3d-4256-b38b-92121b8dfdac admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:03.788070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f0ed2-1a3d-4256-b38b-92121b8dfdac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:03.789890 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f0ed2-1a3d-4256-b38b-92121b8dfdac admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:03.804629 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1097/2181] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:59:03.806388 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0715450-92c7-4900-a1d1-f520f1e1d962 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:03.819706 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0715450-92c7-4900-a1d1-f520f1e1d962 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:03.837102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224d63f-463d-41b6-a5ea-f7b557d88883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:03.838097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224d63f-463d-41b6-a5ea-f7b557d88883 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:03.838392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224d63f-463d-41b6-a5ea-f7b557d88883 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:03.838674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224d63f-463d-41b6-a5ea-f7b557d88883 admin admin] PATH_INFO: `/v3/projects/554a055632914eb3a46a965327bbc8c6/users/7c83861b66f1485faefb7838bce33e68/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:03.843462 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224d63f-463d-41b6-a5ea-f7b557d88883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=554a055632914eb3a46a965327bbc8c6, user_id=7c83861b66f1485faefb7838bce33e68, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:03.854160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224d63f-463d-41b6-a5ea-f7b557d88883 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:03.866921 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1085/2182] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:59:03 2022] PUT /identity/v3/projects/554a055632914eb3a46a965327bbc8c6/users/7c83861b66f1485faefb7838bce33e68/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:03.880195 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4053d-674c-4c5d-952b-dfe5e6ce49bb None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:03.880562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4053d-674c-4c5d-952b-dfe5e6ce49bb None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:03.880846 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4053d-674c-4c5d-952b-dfe5e6ce49bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:03.918630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-dcf4053d-674c-4c5d-952b-dfe5e6ce49bb None None] MFA Rules not processed for user `7c83861b66f1485faefb7838bce33e68`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:03.920242 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-dcf4053d-674c-4c5d-952b-dfe5e6ce49bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:04.008824 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1098/2183] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:04.020015 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224d63f-463d-41b6-a5ea-f7b557d88883 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:04.022245 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-6224d63f-463d-41b6-a5ea-f7b557d88883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:04.086269 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224d63f-463d-41b6-a5ea-f7b557d88883 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:04.090206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ee2d1-0223-4964-aa56-093d48f62aa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:04.090944 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ee2d1-0223-4964-aa56-093d48f62aa0 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:04.091239 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ee2d1-0223-4964-aa56-093d48f62aa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:04.091867 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ee2d1-0223-4964-aa56-093d48f62aa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:04.102610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ee2d1-0223-4964-aa56-093d48f62aa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:04.104076 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ee2d1-0223-4964-aa56-093d48f62aa0 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:04.114520 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1086/2184] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:59:05.291286 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:05.399295 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4053d-674c-4c5d-952b-dfe5e6ce49bb None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:05.474874 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4053d-674c-4c5d-952b-dfe5e6ce49bb None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:05.479606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b72c21-389f-4ee0-9ce9-d24390f253ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:05.480496 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b72c21-389f-4ee0-9ce9-d24390f253ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:05.480785 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b72c21-389f-4ee0-9ce9-d24390f253ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:05.481070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b72c21-389f-4ee0-9ce9-d24390f253ca admin admin] PATH_INFO: `/v3/users/6f7a0e00d5df42a8a9a13bbb233f9344` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:05.482326 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b72c21-389f-4ee0-9ce9-d24390f253ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f7a0e00d5df42a8a9a13bbb233f9344)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:05.484333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b72c21-389f-4ee0-9ce9-d24390f253ca admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:05.751604 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d9b72c21-389f-4ee0-9ce9-d24390f253ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f7a0e00d5df42a8a9a13bbb233f9344'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:05.765397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d9b72c21-389f-4ee0-9ce9-d24390f253ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f7a0e00d5df42a8a9a13bbb233f9344'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:05.902626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d9b72c21-389f-4ee0-9ce9-d24390f253ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f7a0e00d5df42a8a9a13bbb233f9344'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:05.903258 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d9b72c21-389f-4ee0-9ce9-d24390f253ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f7a0e00d5df42a8a9a13bbb233f9344'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:05.912419 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d9b72c21-389f-4ee0-9ce9-d24390f253ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f7a0e00d5df42a8a9a13bbb233f9344'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:05.918076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1099/2185] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:59:05 2022] DELETE /identity/v3/users/6f7a0e00d5df42a8a9a13bbb233f9344 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:59:05.922734 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57e177-c62b-4263-8538-16f466471f15 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:05.922946 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57e177-c62b-4263-8538-16f466471f15 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:05.923242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57e177-c62b-4263-8538-16f466471f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:05.950809 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-1e57e177-c62b-4263-8538-16f466471f15 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:05.952513 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-1e57e177-c62b-4263-8538-16f466471f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:06.029836 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1087/2186] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:06.041599 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b72c21-389f-4ee0-9ce9-d24390f253ca admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:06.043031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d9b72c21-389f-4ee0-9ce9-d24390f253ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:06.109626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b72c21-389f-4ee0-9ce9-d24390f253ca admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:06.114788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aeaa7a-ff5e-404e-8e9c-46c167efc45e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:06.115527 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aeaa7a-ff5e-404e-8e9c-46c167efc45e service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:06.116069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aeaa7a-ff5e-404e-8e9c-46c167efc45e service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:06.119310 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aeaa7a-ff5e-404e-8e9c-46c167efc45e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:06.136579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aeaa7a-ff5e-404e-8e9c-46c167efc45e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:06.138166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aeaa7a-ff5e-404e-8e9c-46c167efc45e service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:06.152341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1100/2187] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:59:06.318173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57e177-c62b-4263-8538-16f466471f15 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:06.320356 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-1e57e177-c62b-4263-8538-16f466471f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:06.356409 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57e177-c62b-4263-8538-16f466471f15 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:06.365389 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5e4d8-3193-47bb-9cad-e64eb70dbb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:06.366648 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5e4d8-3193-47bb-9cad-e64eb70dbb25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:06.367122 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5e4d8-3193-47bb-9cad-e64eb70dbb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:06.367568 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5e4d8-3193-47bb-9cad-e64eb70dbb25 admin admin] PATH_INFO: `/v3/users/d614472c81e34f1c82f4181dd8b9a3a9` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:06.369949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5e4d8-3193-47bb-9cad-e64eb70dbb25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d614472c81e34f1c82f4181dd8b9a3a9)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:06.376679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5e4d8-3193-47bb-9cad-e64eb70dbb25 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:06.438812 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:06.646477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-62a5e4d8-3193-47bb-9cad-e64eb70dbb25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd614472c81e34f1c82f4181dd8b9a3a9'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:06.662339 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-62a5e4d8-3193-47bb-9cad-e64eb70dbb25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd614472c81e34f1c82f4181dd8b9a3a9'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:06.781290 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-62a5e4d8-3193-47bb-9cad-e64eb70dbb25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd614472c81e34f1c82f4181dd8b9a3a9'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:06.782198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-62a5e4d8-3193-47bb-9cad-e64eb70dbb25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd614472c81e34f1c82f4181dd8b9a3a9'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:06.790193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-62a5e4d8-3193-47bb-9cad-e64eb70dbb25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd614472c81e34f1c82f4181dd8b9a3a9'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:06.796333 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1088/2188] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:59:06 2022] DELETE /identity/v3/users/d614472c81e34f1c82f4181dd8b9a3a9 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:06.800866 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e10461-80d1-4a92-be7c-fd504d4a7bed None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:06.802029 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e10461-80d1-4a92-be7c-fd504d4a7bed None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:06.802488 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e10461-80d1-4a92-be7c-fd504d4a7bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:06.822773 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-e1e10461-80d1-4a92-be7c-fd504d4a7bed None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:06.824036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e1e10461-80d1-4a92-be7c-fd504d4a7bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:06.886001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5e4d8-3193-47bb-9cad-e64eb70dbb25 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:06.887886 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-62a5e4d8-3193-47bb-9cad-e64eb70dbb25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:06.891472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1101/2189] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:06.903797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e10461-80d1-4a92-be7c-fd504d4a7bed None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:06.906072 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e1e10461-80d1-4a92-be7c-fd504d4a7bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:06.909321 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5e4d8-3193-47bb-9cad-e64eb70dbb25 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:06.923364 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2e26c-edd9-418f-8332-ce751b1deb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:06.923364 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2e26c-edd9-418f-8332-ce751b1deb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:06.923364 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2e26c-edd9-418f-8332-ce751b1deb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:06.923364 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2e26c-edd9-418f-8332-ce751b1deb7e admin admin] PATH_INFO: `/v3/projects/50f6cdbe571149fb8e3bf3c73e2782ab` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:06.923812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2e26c-edd9-418f-8332-ce751b1deb7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f6cdbe571149fb8e3bf3c73e2782ab)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:06.925540 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2e26c-edd9-418f-8332-ce751b1deb7e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:06.982448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e10461-80d1-4a92-be7c-fd504d4a7bed None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:06.987285 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b313b1-44ee-4bcc-a75a-08a6670bcd1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:06.988622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b313b1-44ee-4bcc-a75a-08a6670bcd1f service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:06.989659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b313b1-44ee-4bcc-a75a-08a6670bcd1f service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:06.990096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b313b1-44ee-4bcc-a75a-08a6670bcd1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:06.999720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b313b1-44ee-4bcc-a75a-08a6670bcd1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:07.001324 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b313b1-44ee-4bcc-a75a-08a6670bcd1f service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:07.013321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1102/2190] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:59:07.085383 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-47f2e26c-edd9-418f-8332-ce751b1deb7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f6cdbe571149fb8e3bf3c73e2782ab', 'request_id': 'req-47f2e26c-edd9-418f-8332-ce751b1deb7e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:07.106288 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-47f2e26c-edd9-418f-8332-ce751b1deb7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f6cdbe571149fb8e3bf3c73e2782ab', 'request_id': 'req-47f2e26c-edd9-418f-8332-ce751b1deb7e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:07.115505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-47f2e26c-edd9-418f-8332-ce751b1deb7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f6cdbe571149fb8e3bf3c73e2782ab', 'request_id': 'req-47f2e26c-edd9-418f-8332-ce751b1deb7e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:07.141621 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:07.194211 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-47f2e26c-edd9-418f-8332-ce751b1deb7e admin admin] The token cache is being invalidate because project 50f6cdbe571149fb8e3bf3c73e2782ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:59:07.198348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-47f2e26c-edd9-418f-8332-ce751b1deb7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:07.198348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-47f2e26c-edd9-418f-8332-ce751b1deb7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:07.198348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1089/2191] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:59:06 2022] DELETE /identity/v3/projects/50f6cdbe571149fb8e3bf3c73e2782ab => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:59:07.201203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b313b1-44ee-4bcc-a75a-08a6670bcd1f service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:07.211849 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b313b1-44ee-4bcc-a75a-08a6670bcd1f service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:07.280411 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5111a0-6f5f-470e-8ff4-d18e5a5d7765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:07.281332 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5111a0-6f5f-470e-8ff4-d18e5a5d7765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:07.281625 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5111a0-6f5f-470e-8ff4-d18e5a5d7765 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:07.281907 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5111a0-6f5f-470e-8ff4-d18e5a5d7765 admin admin] PATH_INFO: `/v3/users/7c83861b66f1485faefb7838bce33e68` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:07.283207 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5111a0-6f5f-470e-8ff4-d18e5a5d7765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c83861b66f1485faefb7838bce33e68)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:07.285225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5111a0-6f5f-470e-8ff4-d18e5a5d7765 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:07.587117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-db5111a0-6f5f-470e-8ff4-d18e5a5d7765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c83861b66f1485faefb7838bce33e68'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:07.600824 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-db5111a0-6f5f-470e-8ff4-d18e5a5d7765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c83861b66f1485faefb7838bce33e68'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:07.624066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2e26c-edd9-418f-8332-ce751b1deb7e admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:07.628619 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-47f2e26c-edd9-418f-8332-ce751b1deb7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:07.642640 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2e26c-edd9-418f-8332-ce751b1deb7e admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:07.656812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9729d-0925-4e0f-ad0f-e7e34eee45f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:07.658231 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9729d-0925-4e0f-ad0f-e7e34eee45f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:07.658519 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9729d-0925-4e0f-ad0f-e7e34eee45f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:07.658798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9729d-0925-4e0f-ad0f-e7e34eee45f6 admin admin] PATH_INFO: `/v3/projects/37fb0b88077442faa314315872de3a2b` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:07.660007 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9729d-0925-4e0f-ad0f-e7e34eee45f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37fb0b88077442faa314315872de3a2b)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:07.663095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9729d-0925-4e0f-ad0f-e7e34eee45f6 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:07.690614 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-db5111a0-6f5f-470e-8ff4-d18e5a5d7765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c83861b66f1485faefb7838bce33e68'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:07.691227 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-db5111a0-6f5f-470e-8ff4-d18e5a5d7765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c83861b66f1485faefb7838bce33e68'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:07.699254 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-db5111a0-6f5f-470e-8ff4-d18e5a5d7765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c83861b66f1485faefb7838bce33e68'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:07.705626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1103/2192] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:59:07 2022] DELETE /identity/v3/users/7c83861b66f1485faefb7838bce33e68 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:07.836946 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-52a9729d-0925-4e0f-ad0f-e7e34eee45f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37fb0b88077442faa314315872de3a2b', 'request_id': 'req-52a9729d-0925-4e0f-ad0f-e7e34eee45f6'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:07.846655 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-52a9729d-0925-4e0f-ad0f-e7e34eee45f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37fb0b88077442faa314315872de3a2b', 'request_id': 'req-52a9729d-0925-4e0f-ad0f-e7e34eee45f6'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:07.854043 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-52a9729d-0925-4e0f-ad0f-e7e34eee45f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37fb0b88077442faa314315872de3a2b', 'request_id': 'req-52a9729d-0925-4e0f-ad0f-e7e34eee45f6'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:08.004309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-52a9729d-0925-4e0f-ad0f-e7e34eee45f6 admin admin] The token cache is being invalidate because project 37fb0b88077442faa314315872de3a2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:59:08.004309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-52a9729d-0925-4e0f-ad0f-e7e34eee45f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:08.004309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-52a9729d-0925-4e0f-ad0f-e7e34eee45f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:08.004309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1090/2193] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:59:07 2022] DELETE /identity/v3/projects/37fb0b88077442faa314315872de3a2b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:59:08.009669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2fa82-f4c6-425b-9879-89ac07369ec3 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:08.010647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2fa82-f4c6-425b-9879-89ac07369ec3 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:08.011115 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2fa82-f4c6-425b-9879-89ac07369ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:08.034067 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-b3c2fa82-f4c6-425b-9879-89ac07369ec3 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:08.038356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-b3c2fa82-f4c6-425b-9879-89ac07369ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:08.110082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1104/2194] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:08.118395 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa54e7-26b4-43b7-bc7d-87be5c26fe8c None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:08.118751 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa54e7-26b4-43b7-bc7d-87be5c26fe8c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:08.119179 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa54e7-26b4-43b7-bc7d-87be5c26fe8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:08.143482 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-96fa54e7-26b4-43b7-bc7d-87be5c26fe8c None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:08.145713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-96fa54e7-26b4-43b7-bc7d-87be5c26fe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:08.168188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1091/2195] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:08.172223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2fa82-f4c6-425b-9879-89ac07369ec3 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:08.183556 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2fa82-f4c6-425b-9879-89ac07369ec3 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:08.189381 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8d65c-5eda-466f-a8a8-64194b792f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:08.190047 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8d65c-5eda-466f-a8a8-64194b792f0d admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:08.190333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8d65c-5eda-466f-a8a8-64194b792f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:08.190609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8d65c-5eda-466f-a8a8-64194b792f0d admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:08.191507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8d65c-5eda-466f-a8a8-64194b792f0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:59:08.191815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8d65c-5eda-466f-a8a8-64194b792f0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:08.193809 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8d65c-5eda-466f-a8a8-64194b792f0d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:08.205700 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:08.210490 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1105/2196] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:59:08.213605 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa54e7-26b4-43b7-bc7d-87be5c26fe8c None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:08.224487 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa54e7-26b4-43b7-bc7d-87be5c26fe8c None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:08.229514 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4679b7-b088-4866-a8ec-013d5b5c667c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:08.230160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4679b7-b088-4866-a8ec-013d5b5c667c admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:08.230455 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4679b7-b088-4866-a8ec-013d5b5c667c admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:08.230735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4679b7-b088-4866-a8ec-013d5b5c667c admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:08.231431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4679b7-b088-4866-a8ec-013d5b5c667c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:08.233391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4679b7-b088-4866-a8ec-013d5b5c667c admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:08.303012 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8d65c-5eda-466f-a8a8-64194b792f0d admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:08.304956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-24e8d65c-5eda-466f-a8a8-64194b792f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:08.319271 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8d65c-5eda-466f-a8a8-64194b792f0d admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:08.324689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4623a8-fb16-41e9-95f5-5c39ac409ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:08.325642 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4623a8-fb16-41e9-95f5-5c39ac409ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:08.326063 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4623a8-fb16-41e9-95f5-5c39ac409ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:08.326345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4623a8-fb16-41e9-95f5-5c39ac409ed9 admin admin] PATH_INFO: `/v3/projects/554a055632914eb3a46a965327bbc8c6` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:08.327684 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4623a8-fb16-41e9-95f5-5c39ac409ed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=554a055632914eb3a46a965327bbc8c6)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:08.329684 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4623a8-fb16-41e9-95f5-5c39ac409ed9 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:08.370003 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1092/2197] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:59:08 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:59:08.371019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4679b7-b088-4866-a8ec-013d5b5c667c admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:08.443645 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4679b7-b088-4866-a8ec-013d5b5c667c admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:08.450158 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6c4623a8-fb16-41e9-95f5-5c39ac409ed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '554a055632914eb3a46a965327bbc8c6', 'request_id': 'req-6c4623a8-fb16-41e9-95f5-5c39ac409ed9'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:08.460875 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6c4623a8-fb16-41e9-95f5-5c39ac409ed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '554a055632914eb3a46a965327bbc8c6', 'request_id': 'req-6c4623a8-fb16-41e9-95f5-5c39ac409ed9'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:08.463935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6c4623a8-fb16-41e9-95f5-5c39ac409ed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '554a055632914eb3a46a965327bbc8c6', 'request_id': 'req-6c4623a8-fb16-41e9-95f5-5c39ac409ed9'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:08.520695 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407d65e-4d01-4e00-9efa-b8355004f4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:08.521794 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407d65e-4d01-4e00-9efa-b8355004f4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:08.522254 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407d65e-4d01-4e00-9efa-b8355004f4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:08.522596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407d65e-4d01-4e00-9efa-b8355004f4c5 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:08.523381 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407d65e-4d01-4e00-9efa-b8355004f4c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:08.525656 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407d65e-4d01-4e00-9efa-b8355004f4c5 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:08.549191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6c4623a8-fb16-41e9-95f5-5c39ac409ed9 admin admin] The token cache is being invalidate because project 554a055632914eb3a46a965327bbc8c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:59:08.549538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6c4623a8-fb16-41e9-95f5-5c39ac409ed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:08.550298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6c4623a8-fb16-41e9-95f5-5c39ac409ed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:08.557666 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1106/2198] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:59:08 2022] DELETE /identity/v3/projects/554a055632914eb3a46a965327bbc8c6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:59:08.560080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979815-f329-4765-870f-96fbcc8757ac None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:08.560430 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979815-f329-4765-870f-96fbcc8757ac None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:08.561097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979815-f329-4765-870f-96fbcc8757ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:08.583937 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-38979815-f329-4765-870f-96fbcc8757ac None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:08.585487 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-38979815-f329-4765-870f-96fbcc8757ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:08.596033 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1107/2199] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:08.604891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043a2b4-ccad-478d-a3e1-eda25a53850b None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:08.605204 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043a2b4-ccad-478d-a3e1-eda25a53850b None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:08.610671 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043a2b4-ccad-478d-a3e1-eda25a53850b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:08.635143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1093/2200] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:59:08 2022] POST /identity/v3/users => generated 287 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:59:08.636775 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407d65e-4d01-4e00-9efa-b8355004f4c5 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:08.638834 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-8407d65e-4d01-4e00-9efa-b8355004f4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:08.647537 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-d043a2b4-ccad-478d-a3e1-eda25a53850b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:08.666700 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d043a2b4-ccad-478d-a3e1-eda25a53850b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:08.667030 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407d65e-4d01-4e00-9efa-b8355004f4c5 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:08.667112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1108/2201] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:08.667201 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec0011-624a-4f0f-92f4-25760523d5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:08.667201 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec0011-624a-4f0f-92f4-25760523d5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:08.667201 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec0011-624a-4f0f-92f4-25760523d5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:08.667201 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec0011-624a-4f0f-92f4-25760523d5e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:08.667486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec0011-624a-4f0f-92f4-25760523d5e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:08.667486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec0011-624a-4f0f-92f4-25760523d5e7 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:08.669524 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043a2b4-ccad-478d-a3e1-eda25a53850b None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:08.683096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043a2b4-ccad-478d-a3e1-eda25a53850b None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:08.688631 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1094/2202] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:59:08.688833 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04053a-5d7c-428b-b6d3-0663f64b6eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:08.689829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04053a-5d7c-428b-b6d3-0663f64b6eab admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:08.690185 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04053a-5d7c-428b-b6d3-0663f64b6eab admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:08.690535 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04053a-5d7c-428b-b6d3-0663f64b6eab admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:08.690702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec0011-624a-4f0f-92f4-25760523d5e7 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:08.691401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04053a-5d7c-428b-b6d3-0663f64b6eab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:59:08.691779 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04053a-5d7c-428b-b6d3-0663f64b6eab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:08.693711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04053a-5d7c-428b-b6d3-0663f64b6eab admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:08.702862 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec0011-624a-4f0f-92f4-25760523d5e7 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:08.709773 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1109/2203] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:59:08.714349 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04053a-5d7c-428b-b6d3-0663f64b6eab admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:08.716033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c58835-5339-4407-927d-9fefd460d98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:08.716715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c58835-5339-4407-927d-9fefd460d98c admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:08.717004 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c58835-5339-4407-927d-9fefd460d98c admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:08.717324 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c58835-5339-4407-927d-9fefd460d98c admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:08.718318 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c58835-5339-4407-927d-9fefd460d98c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:08.719937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c58835-5339-4407-927d-9fefd460d98c admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:08.735281 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04053a-5d7c-428b-b6d3-0663f64b6eab admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:08.738792 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1095/2204] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:59:08.739759 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c58835-5339-4407-927d-9fefd460d98c admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:08.747444 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2716c-04d8-4f63-b4f1-5910d75693f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:08.748121 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2716c-04d8-4f63-b4f1-5910d75693f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:08.748404 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2716c-04d8-4f63-b4f1-5910d75693f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:08.748675 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2716c-04d8-4f63-b4f1-5910d75693f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:08.749414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2716c-04d8-4f63-b4f1-5910d75693f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:08.750514 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c58835-5339-4407-927d-9fefd460d98c admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:08.752015 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2716c-04d8-4f63-b4f1-5910d75693f6 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:08.756442 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d25b6-e75d-496a-ac33-a54f6e217dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:08.757478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d25b6-e75d-496a-ac33-a54f6e217dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:08.757836 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d25b6-e75d-496a-ac33-a54f6e217dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:08.758187 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d25b6-e75d-496a-ac33-a54f6e217dd2 admin admin] PATH_INFO: `/v3/projects/451606bb2d8941bc83e452aa9e60e4d2/users/26aaee3ba3ae48069ae62122eb8647cd/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:08.779708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d25b6-e75d-496a-ac33-a54f6e217dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=451606bb2d8941bc83e452aa9e60e4d2, user_id=26aaee3ba3ae48069ae62122eb8647cd, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:08.782479 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d25b6-e75d-496a-ac33-a54f6e217dd2 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:08.889211 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1110/2205] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:59:08 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:59:08.892751 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2716c-04d8-4f63-b4f1-5910d75693f6 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:08.949433 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1096/2206] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:59:08 2022] PUT /identity/v3/projects/451606bb2d8941bc83e452aa9e60e4d2/users/26aaee3ba3ae48069ae62122eb8647cd/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:08.960470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bed24-f83d-403f-94d7-6289b8bada7b None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:08.960769 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bed24-f83d-403f-94d7-6289b8bada7b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:08.961247 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bed24-f83d-403f-94d7-6289b8bada7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:08.965254 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2716c-04d8-4f63-b4f1-5910d75693f6 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:09.003017 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-a13bed24-f83d-403f-94d7-6289b8bada7b None None] MFA Rules not processed for user `26aaee3ba3ae48069ae62122eb8647cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:09.004260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-a13bed24-f83d-403f-94d7-6289b8bada7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:09.048668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec194a-0f1f-4770-8dfd-3e7d3dd82bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:09.049301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec194a-0f1f-4770-8dfd-3e7d3dd82bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:09.049591 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec194a-0f1f-4770-8dfd-3e7d3dd82bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:09.049873 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec194a-0f1f-4770-8dfd-3e7d3dd82bf6 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:09.050825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec194a-0f1f-4770-8dfd-3e7d3dd82bf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:09.053290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec194a-0f1f-4770-8dfd-3e7d3dd82bf6 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:09.078424 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1097/2207] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:09.089387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bed24-f83d-403f-94d7-6289b8bada7b None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:09.090758 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-a13bed24-f83d-403f-94d7-6289b8bada7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:09.138498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1111/2208] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:59:08 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:59:09.142509 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec194a-0f1f-4770-8dfd-3e7d3dd82bf6 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:09.154265 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec194a-0f1f-4770-8dfd-3e7d3dd82bf6 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:09.156031 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bed24-f83d-403f-94d7-6289b8bada7b None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:09.159035 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327e66b-4b27-42ef-996f-82d2c0479c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:09.159694 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327e66b-4b27-42ef-996f-82d2c0479c0b admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:09.159809 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a3cb2-1a06-4b79-82df-f3afd614e82b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:09.160006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327e66b-4b27-42ef-996f-82d2c0479c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:09.160283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327e66b-4b27-42ef-996f-82d2c0479c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:09.160390 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3cb2-1a06-4b79-82df-f3afd614e82b service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:09.160669 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3cb2-1a06-4b79-82df-f3afd614e82b service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:09.160953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3cb2-1a06-4b79-82df-f3afd614e82b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:09.161733 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327e66b-4b27-42ef-996f-82d2c0479c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:09.163343 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327e66b-4b27-42ef-996f-82d2c0479c0b admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:09.169527 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a3cb2-1a06-4b79-82df-f3afd614e82b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:09.170962 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a3cb2-1a06-4b79-82df-f3afd614e82b service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:09.177238 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1112/2209] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:59:09.184432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327e66b-4b27-42ef-996f-82d2c0479c0b admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:09.188914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1098/2210] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:59:09.197304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327e66b-4b27-42ef-996f-82d2c0479c0b admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:09.202109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148ea01-43e2-41b1-b50e-430aff37fe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:09.202815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ea01-43e2-41b1-b50e-430aff37fe3c admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:09.203099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ea01-43e2-41b1-b50e-430aff37fe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:09.203375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ea01-43e2-41b1-b50e-430aff37fe3c admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:09.204226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148ea01-43e2-41b1-b50e-430aff37fe3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:09.205886 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148ea01-43e2-41b1-b50e-430aff37fe3c admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:09.219589 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1113/2211] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:59:09.223351 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a3cb2-1a06-4b79-82df-f3afd614e82b service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:09.237031 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a3cb2-1a06-4b79-82df-f3afd614e82b service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:09.239618 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c827a6-f68b-4488-9698-9eae5d7b7df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:09.240617 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c827a6-f68b-4488-9698-9eae5d7b7df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:09.240904 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c827a6-f68b-4488-9698-9eae5d7b7df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:09.241365 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c827a6-f68b-4488-9698-9eae5d7b7df1 admin admin] PATH_INFO: `/v3/projects/40da4adb3fab4e438339ff29212d9de5/users/78869b4ad1644e8f972357e01943172a/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:09.272984 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c827a6-f68b-4488-9698-9eae5d7b7df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40da4adb3fab4e438339ff29212d9de5, user_id=78869b4ad1644e8f972357e01943172a, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:09.276344 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c827a6-f68b-4488-9698-9eae5d7b7df1 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:09.387963 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1099/2212] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:59:09 2022] PUT /identity/v3/projects/40da4adb3fab4e438339ff29212d9de5/users/78869b4ad1644e8f972357e01943172a/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:09.389312 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389de0f4-656f-44c1-bf8d-b0072e3c4e8f None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:09.389672 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389de0f4-656f-44c1-bf8d-b0072e3c4e8f None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:09.389986 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389de0f4-656f-44c1-bf8d-b0072e3c4e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:09.425376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-389de0f4-656f-44c1-bf8d-b0072e3c4e8f None None] MFA Rules not processed for user `78869b4ad1644e8f972357e01943172a`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:09.427284 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-389de0f4-656f-44c1-bf8d-b0072e3c4e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:09.506102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1114/2213] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:09.510353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c827a6-f68b-4488-9698-9eae5d7b7df1 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:09.580977 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c827a6-f68b-4488-9698-9eae5d7b7df1 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:09.585686 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3277bb-3a9f-435b-a08e-17ea765eac15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:09.586374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3277bb-3a9f-435b-a08e-17ea765eac15 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:09.586720 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3277bb-3a9f-435b-a08e-17ea765eac15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:09.587038 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3277bb-3a9f-435b-a08e-17ea765eac15 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:09.587744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3277bb-3a9f-435b-a08e-17ea765eac15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:09.589690 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3277bb-3a9f-435b-a08e-17ea765eac15 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:09.710813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1100/2214] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:59:09 2022] POST /identity/v3/projects => generated 375 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:59:09.714469 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389de0f4-656f-44c1-bf8d-b0072e3c4e8f None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:09.726877 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389de0f4-656f-44c1-bf8d-b0072e3c4e8f None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:09.786465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964de461-b915-4192-aa10-bdadb0452fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:09.787153 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964de461-b915-4192-aa10-bdadb0452fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:09.787436 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964de461-b915-4192-aa10-bdadb0452fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:09.787713 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964de461-b915-4192-aa10-bdadb0452fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:09.788412 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964de461-b915-4192-aa10-bdadb0452fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:09.790418 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964de461-b915-4192-aa10-bdadb0452fd4 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:09.949352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1115/2215] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:59:09 2022] POST /identity/v3/users => generated 288 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:59:09.953303 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3277bb-3a9f-435b-a08e-17ea765eac15 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:09.966353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3277bb-3a9f-435b-a08e-17ea765eac15 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:09.972837 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cfe93-728a-4678-a514-9bcbce085af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:09.974468 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cfe93-728a-4678-a514-9bcbce085af7 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:09.974842 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cfe93-728a-4678-a514-9bcbce085af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:09.975183 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cfe93-728a-4678-a514-9bcbce085af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:09.976396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cfe93-728a-4678-a514-9bcbce085af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:09.977823 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cfe93-728a-4678-a514-9bcbce085af7 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:09.989913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1101/2216] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:59:09.993665 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964de461-b915-4192-aa10-bdadb0452fd4 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:10.003986 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964de461-b915-4192-aa10-bdadb0452fd4 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:10.008836 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec0ce4-54b8-4cf8-8ae9-d36787932538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:10.009738 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec0ce4-54b8-4cf8-8ae9-d36787932538 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:10.010194 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec0ce4-54b8-4cf8-8ae9-d36787932538 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:10.010486 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec0ce4-54b8-4cf8-8ae9-d36787932538 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:10.021535 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec0ce4-54b8-4cf8-8ae9-d36787932538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:10.021535 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec0ce4-54b8-4cf8-8ae9-d36787932538 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:10.026757 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1116/2217] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:59:10.029936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cfe93-728a-4678-a514-9bcbce085af7 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:10.040812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cfe93-728a-4678-a514-9bcbce085af7 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:10.045307 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25012862-29c5-47c7-ae8f-fdfe2c53aea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:10.046171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25012862-29c5-47c7-ae8f-fdfe2c53aea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:10.046450 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25012862-29c5-47c7-ae8f-fdfe2c53aea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:10.046726 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25012862-29c5-47c7-ae8f-fdfe2c53aea4 admin admin] PATH_INFO: `/v3/projects/7c235030194b4a439ff0c7eb2609e627/users/30b5c94c03ee46beb80b15a6b29ff7ae/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:10.061343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25012862-29c5-47c7-ae8f-fdfe2c53aea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c235030194b4a439ff0c7eb2609e627, user_id=30b5c94c03ee46beb80b15a6b29ff7ae, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:10.063970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25012862-29c5-47c7-ae8f-fdfe2c53aea4 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:10.158211 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c699c1a-bf7f-43a5-a187-130ba96bde8d None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:10.158495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c699c1a-bf7f-43a5-a187-130ba96bde8d None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:10.158781 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c699c1a-bf7f-43a5-a187-130ba96bde8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:10.165650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:10.173430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1102/2218] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:59:10 2022] PUT /identity/v3/projects/7c235030194b4a439ff0c7eb2609e627/users/30b5c94c03ee46beb80b15a6b29ff7ae/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:10.184083 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4e342-754b-4f51-a211-6ecb5795ddc8 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:10.184372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4e342-754b-4f51-a211-6ecb5795ddc8 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:10.184668 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4e342-754b-4f51-a211-6ecb5795ddc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:10.195137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-9c699c1a-bf7f-43a5-a187-130ba96bde8d None None] MFA Rules not processed for user `d5157ad1d56246a185f5a25cc6771a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:10.196548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-9c699c1a-bf7f-43a5-a187-130ba96bde8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:10.215125 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-63b4e342-754b-4f51-a211-6ecb5795ddc8 None None] MFA Rules not processed for user `30b5c94c03ee46beb80b15a6b29ff7ae`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:10.216392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-63b4e342-754b-4f51-a211-6ecb5795ddc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:10.243478 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:10.260751 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1117/2219] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:59:10.303731 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1103/2220] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:59:10.304913 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c699c1a-bf7f-43a5-a187-130ba96bde8d None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:10.383449 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c699c1a-bf7f-43a5-a187-130ba96bde8d None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:10.394693 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba0f84-020e-4d02-b3d9-61a8e543787d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:10.394693 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba0f84-020e-4d02-b3d9-61a8e543787d admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:10.394693 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba0f84-020e-4d02-b3d9-61a8e543787d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:10.394693 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba0f84-020e-4d02-b3d9-61a8e543787d admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:10.396416 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba0f84-020e-4d02-b3d9-61a8e543787d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:10.396416 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba0f84-020e-4d02-b3d9-61a8e543787d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:10.554197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4e342-754b-4f51-a211-6ecb5795ddc8 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:10.568773 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1118/2221] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:59:10 2022] POST /identity/v3/projects => generated 375 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:59:10.576097 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4e342-754b-4f51-a211-6ecb5795ddc8 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:10.653711 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414bf18-ca9f-480e-996c-e2be58d9a309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:10.654595 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414bf18-ca9f-480e-996c-e2be58d9a309 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:10.654941 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414bf18-ca9f-480e-996c-e2be58d9a309 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:10.655281 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414bf18-ca9f-480e-996c-e2be58d9a309 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:10.656148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414bf18-ca9f-480e-996c-e2be58d9a309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:10.658102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414bf18-ca9f-480e-996c-e2be58d9a309 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:10.843235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1104/2222] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:59:10 2022] POST /identity/v3/users => generated 294 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:59:10.846952 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba0f84-020e-4d02-b3d9-61a8e543787d admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:10.858127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba0f84-020e-4d02-b3d9-61a8e543787d admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:10.863840 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675c2cc-0b7c-46a0-a931-f9f53ac653a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:10.864537 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675c2cc-0b7c-46a0-a931-f9f53ac653a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:10.864800 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675c2cc-0b7c-46a0-a931-f9f53ac653a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:10.865081 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675c2cc-0b7c-46a0-a931-f9f53ac653a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:10.865983 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675c2cc-0b7c-46a0-a931-f9f53ac653a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:10.867641 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675c2cc-0b7c-46a0-a931-f9f53ac653a8 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:10.889907 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1119/2223] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:59:10.891007 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414bf18-ca9f-480e-996c-e2be58d9a309 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:10.926275 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414bf18-ca9f-480e-996c-e2be58d9a309 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:10.938696 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9420e6-d62f-4b40-8fa0-884eaf11d845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:10.939609 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9420e6-d62f-4b40-8fa0-884eaf11d845 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:10.939898 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9420e6-d62f-4b40-8fa0-884eaf11d845 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:10.940179 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9420e6-d62f-4b40-8fa0-884eaf11d845 admin admin] PATH_INFO: `/v3/projects/dbb1f8d11f01439abd6682f6e0a62648/users/fe31cb3bd19d443293be8b0458667619/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:10.970943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9420e6-d62f-4b40-8fa0-884eaf11d845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb1f8d11f01439abd6682f6e0a62648, user_id=fe31cb3bd19d443293be8b0458667619, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:10.975448 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9420e6-d62f-4b40-8fa0-884eaf11d845 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:11.064094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1105/2224] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:59:10 2022] PUT /identity/v3/projects/dbb1f8d11f01439abd6682f6e0a62648/users/fe31cb3bd19d443293be8b0458667619/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:59:11.064794 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675c2cc-0b7c-46a0-a931-f9f53ac653a8 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:11.083270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675c2cc-0b7c-46a0-a931-f9f53ac653a8 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:11.197105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7810ed-89f9-4163-bfc9-cc46d48029b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:11.201636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7810ed-89f9-4163-bfc9-cc46d48029b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:11.202285 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7810ed-89f9-4163-bfc9-cc46d48029b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:11.202851 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7810ed-89f9-4163-bfc9-cc46d48029b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:11.204195 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7810ed-89f9-4163-bfc9-cc46d48029b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:11.208575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7810ed-89f9-4163-bfc9-cc46d48029b0 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:11.252005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9420e6-d62f-4b40-8fa0-884eaf11d845 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:11.261335 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1120/2225] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:59:11.275701 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9420e6-d62f-4b40-8fa0-884eaf11d845 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:11.284217 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59be856-5ee0-436a-9941-e081b338b8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:11.286829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59be856-5ee0-436a-9941-e081b338b8d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:11.287323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59be856-5ee0-436a-9941-e081b338b8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:11.288794 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59be856-5ee0-436a-9941-e081b338b8d7 admin admin] PATH_INFO: `/v3/projects/dbb1f8d11f01439abd6682f6e0a62648/users/fe31cb3bd19d443293be8b0458667619/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:11.293202 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59be856-5ee0-436a-9941-e081b338b8d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb1f8d11f01439abd6682f6e0a62648, user_id=fe31cb3bd19d443293be8b0458667619, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:11.305068 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59be856-5ee0-436a-9941-e081b338b8d7 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:11.329857 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1106/2226] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:59:11 2022] PUT /identity/v3/projects/dbb1f8d11f01439abd6682f6e0a62648/users/fe31cb3bd19d443293be8b0458667619/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:11.372789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c3c21-707c-4ed0-8f1a-0cb0b2a471a5 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:11.373144 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c3c21-707c-4ed0-8f1a-0cb0b2a471a5 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:11.373442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e0219-8ddc-41e5-967c-5a1d635d02db None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:11.373616 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c3c21-707c-4ed0-8f1a-0cb0b2a471a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:11.373962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e0219-8ddc-41e5-967c-5a1d635d02db None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:11.374425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e0219-8ddc-41e5-967c-5a1d635d02db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:11.421397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-939e0219-8ddc-41e5-967c-5a1d635d02db None None] MFA Rules not processed for user `26aaee3ba3ae48069ae62122eb8647cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:11.421397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-939e0219-8ddc-41e5-967c-5a1d635d02db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:11.425509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-ba1c3c21-707c-4ed0-8f1a-0cb0b2a471a5 None None] MFA Rules not processed for user `fe31cb3bd19d443293be8b0458667619`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:11.429104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ba1c3c21-707c-4ed0-8f1a-0cb0b2a471a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:11.491603 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1121/2227] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:11.545454 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1107/2228] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:11.734730 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e0219-8ddc-41e5-967c-5a1d635d02db None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:11.796923 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e0219-8ddc-41e5-967c-5a1d635d02db None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:11.801391 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856abfa6-9468-4eb2-917f-9af2f5c3c143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:11.802451 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856abfa6-9468-4eb2-917f-9af2f5c3c143 service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:11.802451 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856abfa6-9468-4eb2-917f-9af2f5c3c143 service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:11.803317 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856abfa6-9468-4eb2-917f-9af2f5c3c143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:11.881579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856abfa6-9468-4eb2-917f-9af2f5c3c143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:11.886662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856abfa6-9468-4eb2-917f-9af2f5c3c143 service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:11.905332 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1122/2229] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:59:14.130821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c3c21-707c-4ed0-8f1a-0cb0b2a471a5 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:14.140405 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c3c21-707c-4ed0-8f1a-0cb0b2a471a5 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:14.145364 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75255e78-51a0-40e0-b21b-56f4a729405b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:14.146092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75255e78-51a0-40e0-b21b-56f4a729405b service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:14.146387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75255e78-51a0-40e0-b21b-56f4a729405b service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:14.146674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75255e78-51a0-40e0-b21b-56f4a729405b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:14.200056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:14.217313 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:14.218115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75255e78-51a0-40e0-b21b-56f4a729405b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:14.219440 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75255e78-51a0-40e0-b21b-56f4a729405b service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:14.234202 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1108/2230] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:59:16.421886 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856abfa6-9468-4eb2-917f-9af2f5c3c143 service cinder] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:16.433720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856abfa6-9468-4eb2-917f-9af2f5c3c143 service cinder] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:16.444698 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd1e6c-431c-4921-8c20-5c3981d3a86f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:16.465517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd1e6c-431c-4921-8c20-5c3981d3a86f service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:16.467535 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd1e6c-431c-4921-8c20-5c3981d3a86f service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:16.467866 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd1e6c-431c-4921-8c20-5c3981d3a86f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:16.493981 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd1e6c-431c-4921-8c20-5c3981d3a86f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:16.495713 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd1e6c-431c-4921-8c20-5c3981d3a86f service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:16.509869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1123/2231] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:59:16.542962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:16.948595 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75255e78-51a0-40e0-b21b-56f4a729405b service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:16.950218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-75255e78-51a0-40e0-b21b-56f4a729405b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:17.048004 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75255e78-51a0-40e0-b21b-56f4a729405b service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:17.053887 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521f43b-584d-45fb-b5f6-f6ba10b1d072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:17.056422 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521f43b-584d-45fb-b5f6-f6ba10b1d072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:17.056422 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521f43b-584d-45fb-b5f6-f6ba10b1d072 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:17.056422 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521f43b-584d-45fb-b5f6-f6ba10b1d072 admin admin] PATH_INFO: `/v3/users/78e7abd036fe405bafcbf7f8017136d8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:17.057605 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521f43b-584d-45fb-b5f6-f6ba10b1d072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78e7abd036fe405bafcbf7f8017136d8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:17.059823 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521f43b-584d-45fb-b5f6-f6ba10b1d072 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:17.221707 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:17.272969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8521f43b-584d-45fb-b5f6-f6ba10b1d072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78e7abd036fe405bafcbf7f8017136d8'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:17.285576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8521f43b-584d-45fb-b5f6-f6ba10b1d072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78e7abd036fe405bafcbf7f8017136d8'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:17.370771 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8521f43b-584d-45fb-b5f6-f6ba10b1d072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78e7abd036fe405bafcbf7f8017136d8'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:17.371646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8521f43b-584d-45fb-b5f6-f6ba10b1d072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78e7abd036fe405bafcbf7f8017136d8'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:17.380655 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8521f43b-584d-45fb-b5f6-f6ba10b1d072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78e7abd036fe405bafcbf7f8017136d8'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:17.391422 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1109/2232] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:59:16 2022] DELETE /identity/v3/users/78e7abd036fe405bafcbf7f8017136d8 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:17.761368 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd1e6c-431c-4921-8c20-5c3981d3a86f service cinder] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:17.773570 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd1e6c-431c-4921-8c20-5c3981d3a86f service cinder] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:17.892724 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731529df-3c9d-494a-afcf-c17ae4bf7e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:17.893822 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731529df-3c9d-494a-afcf-c17ae4bf7e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:17.894285 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731529df-3c9d-494a-afcf-c17ae4bf7e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:17.894565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731529df-3c9d-494a-afcf-c17ae4bf7e99 admin admin] PATH_INFO: `/v3/projects/cfb016f2a8cf4a1bb5cae40f643168c8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:17.899669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731529df-3c9d-494a-afcf-c17ae4bf7e99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfb016f2a8cf4a1bb5cae40f643168c8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:17.899669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731529df-3c9d-494a-afcf-c17ae4bf7e99 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:18.058017 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:18.062873 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-731529df-3c9d-494a-afcf-c17ae4bf7e99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfb016f2a8cf4a1bb5cae40f643168c8', 'request_id': 'req-731529df-3c9d-494a-afcf-c17ae4bf7e99'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:18.073251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-731529df-3c9d-494a-afcf-c17ae4bf7e99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfb016f2a8cf4a1bb5cae40f643168c8', 'request_id': 'req-731529df-3c9d-494a-afcf-c17ae4bf7e99'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:18.080196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-731529df-3c9d-494a-afcf-c17ae4bf7e99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfb016f2a8cf4a1bb5cae40f643168c8', 'request_id': 'req-731529df-3c9d-494a-afcf-c17ae4bf7e99'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:18.172721 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-731529df-3c9d-494a-afcf-c17ae4bf7e99 admin admin] The token cache is being invalidate because project cfb016f2a8cf4a1bb5cae40f643168c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:59:18.173098 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-731529df-3c9d-494a-afcf-c17ae4bf7e99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:18.178618 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-731529df-3c9d-494a-afcf-c17ae4bf7e99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:18.184832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1124/2233] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:59:17 2022] DELETE /identity/v3/projects/cfb016f2a8cf4a1bb5cae40f643168c8 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:18.188641 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521f43b-584d-45fb-b5f6-f6ba10b1d072 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:18.193543 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-8521f43b-584d-45fb-b5f6-f6ba10b1d072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:18.214832 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521f43b-584d-45fb-b5f6-f6ba10b1d072 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:18.284222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee2e1d-ee3a-484f-8e56-1fbbef88f924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:18.285407 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee2e1d-ee3a-484f-8e56-1fbbef88f924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:18.285886 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee2e1d-ee3a-484f-8e56-1fbbef88f924 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:18.286323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee2e1d-ee3a-484f-8e56-1fbbef88f924 admin admin] PATH_INFO: `/v3/users/d8b1ced278f443a691d7506cdb8d5db8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:18.287841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee2e1d-ee3a-484f-8e56-1fbbef88f924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8b1ced278f443a691d7506cdb8d5db8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:18.290765 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee2e1d-ee3a-484f-8e56-1fbbef88f924 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:18.518426 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5bee2e1d-ee3a-484f-8e56-1fbbef88f924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8b1ced278f443a691d7506cdb8d5db8'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:18.533898 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5bee2e1d-ee3a-484f-8e56-1fbbef88f924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8b1ced278f443a691d7506cdb8d5db8'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:18.679387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5bee2e1d-ee3a-484f-8e56-1fbbef88f924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8b1ced278f443a691d7506cdb8d5db8'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:18.680041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5bee2e1d-ee3a-484f-8e56-1fbbef88f924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8b1ced278f443a691d7506cdb8d5db8'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:18.688983 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5bee2e1d-ee3a-484f-8e56-1fbbef88f924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8b1ced278f443a691d7506cdb8d5db8'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:18.698543 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1110/2234] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:59:18 2022] DELETE /identity/v3/users/d8b1ced278f443a691d7506cdb8d5db8 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:19.341991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731529df-3c9d-494a-afcf-c17ae4bf7e99 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:19.341991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-731529df-3c9d-494a-afcf-c17ae4bf7e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:19.355551 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731529df-3c9d-494a-afcf-c17ae4bf7e99 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:19.420363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34092fb8-881c-44c2-9e6e-247328db23be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:19.421324 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34092fb8-881c-44c2-9e6e-247328db23be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:19.424802 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34092fb8-881c-44c2-9e6e-247328db23be admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:19.424802 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34092fb8-881c-44c2-9e6e-247328db23be admin admin] PATH_INFO: `/v3/projects/bcee92d79d3c4e0285aa3bc12d8375df` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:19.424802 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34092fb8-881c-44c2-9e6e-247328db23be admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcee92d79d3c4e0285aa3bc12d8375df)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:19.426035 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34092fb8-881c-44c2-9e6e-247328db23be admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:19.563220 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-34092fb8-881c-44c2-9e6e-247328db23be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcee92d79d3c4e0285aa3bc12d8375df', 'request_id': 'req-34092fb8-881c-44c2-9e6e-247328db23be'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:19.569472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-34092fb8-881c-44c2-9e6e-247328db23be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcee92d79d3c4e0285aa3bc12d8375df', 'request_id': 'req-34092fb8-881c-44c2-9e6e-247328db23be'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:19.574946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-34092fb8-881c-44c2-9e6e-247328db23be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcee92d79d3c4e0285aa3bc12d8375df', 'request_id': 'req-34092fb8-881c-44c2-9e6e-247328db23be'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:19.662380 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:19.667381 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-34092fb8-881c-44c2-9e6e-247328db23be admin admin] The token cache is being invalidate because project bcee92d79d3c4e0285aa3bc12d8375df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:59:19.668159 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-34092fb8-881c-44c2-9e6e-247328db23be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:19.668305 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-34092fb8-881c-44c2-9e6e-247328db23be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:19.669892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1125/2235] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:59:19 2022] DELETE /identity/v3/projects/bcee92d79d3c4e0285aa3bc12d8375df => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:19.675593 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5499120-1716-47ee-a6a3-017172df0292 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:19.675886 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5499120-1716-47ee-a6a3-017172df0292 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:19.676770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5499120-1716-47ee-a6a3-017172df0292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:19.695243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-b5499120-1716-47ee-a6a3-017172df0292 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:19.696457 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-b5499120-1716-47ee-a6a3-017172df0292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:19.770992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1111/2236] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:19.772541 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b715e-2e52-454d-a7c2-8037b2567659 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:19.772836 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b715e-2e52-454d-a7c2-8037b2567659 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:19.773117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b715e-2e52-454d-a7c2-8037b2567659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:19.806526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-ed5b715e-2e52-454d-a7c2-8037b2567659 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:19.808563 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ed5b715e-2e52-454d-a7c2-8037b2567659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:19.831773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5499120-1716-47ee-a6a3-017172df0292 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:19.831965 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1126/2237] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:19.842589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5499120-1716-47ee-a6a3-017172df0292 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:19.849096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1ef6c-51f2-41af-acd0-3a12d00e6f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:19.855250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1ef6c-51f2-41af-acd0-3a12d00e6f9e admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:19.855250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1ef6c-51f2-41af-acd0-3a12d00e6f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:19.855250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1ef6c-51f2-41af-acd0-3a12d00e6f9e admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:19.855250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1ef6c-51f2-41af-acd0-3a12d00e6f9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:59:19.855250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1ef6c-51f2-41af-acd0-3a12d00e6f9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:19.855250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1ef6c-51f2-41af-acd0-3a12d00e6f9e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:19.867689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1112/2238] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:59:19.872075 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b715e-2e52-454d-a7c2-8037b2567659 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:19.888315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b715e-2e52-454d-a7c2-8037b2567659 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:19.893049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3c016-5f6b-458b-b008-c45b5d681ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:19.893794 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3c016-5f6b-458b-b008-c45b5d681ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:19.894131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3c016-5f6b-458b-b008-c45b5d681ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:19.894397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3c016-5f6b-458b-b008-c45b5d681ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:19.897374 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3c016-5f6b-458b-b008-c45b5d681ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:19.899530 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3c016-5f6b-458b-b008-c45b5d681ff6 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:20.050116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1127/2239] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:59:19 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:59:20.052492 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1ef6c-51f2-41af-acd0-3a12d00e6f9e admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:20.063151 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1ef6c-51f2-41af-acd0-3a12d00e6f9e admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:20.121542 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b4f4b-a171-413d-9b04-115ab51d04fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:20.122223 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b4f4b-a171-413d-9b04-115ab51d04fe admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:20.122512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b4f4b-a171-413d-9b04-115ab51d04fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:20.122798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b4f4b-a171-413d-9b04-115ab51d04fe admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:20.125637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b4f4b-a171-413d-9b04-115ab51d04fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:20.127687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b4f4b-a171-413d-9b04-115ab51d04fe admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:20.215957 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1113/2240] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:59:20 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:59:20.221471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3c016-5f6b-458b-b008-c45b5d681ff6 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:20.232524 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3c016-5f6b-458b-b008-c45b5d681ff6 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:20.237688 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a33cae-e757-45a7-8f76-41f48e3c09c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:20.241740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a33cae-e757-45a7-8f76-41f48e3c09c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:20.241740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a33cae-e757-45a7-8f76-41f48e3c09c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:20.241740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a33cae-e757-45a7-8f76-41f48e3c09c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:20.241740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a33cae-e757-45a7-8f76-41f48e3c09c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:20.242322 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a33cae-e757-45a7-8f76-41f48e3c09c9 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:20.256853 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1128/2241] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:59:20.258095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b4f4b-a171-413d-9b04-115ab51d04fe admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:20.267875 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b4f4b-a171-413d-9b04-115ab51d04fe admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:20.273269 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8248f-0417-4993-a3d7-8d09b2aa50f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:20.273985 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8248f-0417-4993-a3d7-8d09b2aa50f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:20.274276 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8248f-0417-4993-a3d7-8d09b2aa50f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:20.274557 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8248f-0417-4993-a3d7-8d09b2aa50f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:20.275316 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8248f-0417-4993-a3d7-8d09b2aa50f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:20.276961 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8248f-0417-4993-a3d7-8d09b2aa50f1 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:20.292671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1114/2242] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:59:20.295810 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a33cae-e757-45a7-8f76-41f48e3c09c9 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:20.306667 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a33cae-e757-45a7-8f76-41f48e3c09c9 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:20.311550 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc12aa0-88e2-4592-bb8d-5b8306b7751f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:20.312530 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc12aa0-88e2-4592-bb8d-5b8306b7751f admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:20.312816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc12aa0-88e2-4592-bb8d-5b8306b7751f admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:20.313090 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc12aa0-88e2-4592-bb8d-5b8306b7751f admin admin] PATH_INFO: `/v3/projects/415851de1a154d818421bc83036ea3aa/users/a20f752f144f413eb7b6991089993cfc/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:20.328737 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc12aa0-88e2-4592-bb8d-5b8306b7751f admin admin] RBAC: Authorizing `identity:create_grant(project_id=415851de1a154d818421bc83036ea3aa, user_id=a20f752f144f413eb7b6991089993cfc, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:20.333309 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc12aa0-88e2-4592-bb8d-5b8306b7751f admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:20.382836 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:20.471247 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1129/2243] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:59:20 2022] PUT /identity/v3/projects/415851de1a154d818421bc83036ea3aa/users/a20f752f144f413eb7b6991089993cfc/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:20.482101 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe4a17-e9e1-454d-8ed6-584992797cc6 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:20.482402 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe4a17-e9e1-454d-8ed6-584992797cc6 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:20.482697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe4a17-e9e1-454d-8ed6-584992797cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:20.510266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-47fe4a17-e9e1-454d-8ed6-584992797cc6 None None] MFA Rules not processed for user `a20f752f144f413eb7b6991089993cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:20.511543 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-47fe4a17-e9e1-454d-8ed6-584992797cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:20.576976 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1115/2244] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:20.588668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc12aa0-88e2-4592-bb8d-5b8306b7751f admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:20.590476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-afc12aa0-88e2-4592-bb8d-5b8306b7751f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:20.658040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc12aa0-88e2-4592-bb8d-5b8306b7751f admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:20.662484 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e84b7-cada-440c-b769-4adf4b60063b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:20.663208 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e84b7-cada-440c-b769-4adf4b60063b service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:20.663572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e84b7-cada-440c-b769-4adf4b60063b service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:20.663914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e84b7-cada-440c-b769-4adf4b60063b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:20.673128 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e84b7-cada-440c-b769-4adf4b60063b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:20.674767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e84b7-cada-440c-b769-4adf4b60063b service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:20.685059 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1130/2245] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:59:21.612409 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe4a17-e9e1-454d-8ed6-584992797cc6 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:21.614449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-47fe4a17-e9e1-454d-8ed6-584992797cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:21.680295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe4a17-e9e1-454d-8ed6-584992797cc6 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:21.684700 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95d43e-1369-40cc-b811-a5a678a50206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:21.685607 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95d43e-1369-40cc-b811-a5a678a50206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:21.685892 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95d43e-1369-40cc-b811-a5a678a50206 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:21.686171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95d43e-1369-40cc-b811-a5a678a50206 admin admin] PATH_INFO: `/v3/users/78869b4ad1644e8f972357e01943172a` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:21.687399 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95d43e-1369-40cc-b811-a5a678a50206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78869b4ad1644e8f972357e01943172a)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:21.689403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95d43e-1369-40cc-b811-a5a678a50206 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:21.735973 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:21.929708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-0e95d43e-1369-40cc-b811-a5a678a50206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78869b4ad1644e8f972357e01943172a'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:21.945026 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-0e95d43e-1369-40cc-b811-a5a678a50206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78869b4ad1644e8f972357e01943172a'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:22.069042 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-0e95d43e-1369-40cc-b811-a5a678a50206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78869b4ad1644e8f972357e01943172a'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:22.070148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-0e95d43e-1369-40cc-b811-a5a678a50206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78869b4ad1644e8f972357e01943172a'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:22.078478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-0e95d43e-1369-40cc-b811-a5a678a50206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78869b4ad1644e8f972357e01943172a'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:22.085201 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1116/2246] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:59:21 2022] DELETE /identity/v3/users/78869b4ad1644e8f972357e01943172a => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:22.091092 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478422db-d549-421f-a830-d7a6c92228a7 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:22.091092 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478422db-d549-421f-a830-d7a6c92228a7 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:22.091092 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478422db-d549-421f-a830-d7a6c92228a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:22.120811 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-478422db-d549-421f-a830-d7a6c92228a7 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:22.121618 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-478422db-d549-421f-a830-d7a6c92228a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:22.190909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1131/2247] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:22.198233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95d43e-1369-40cc-b811-a5a678a50206 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:22.199781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-0e95d43e-1369-40cc-b811-a5a678a50206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:22.260594 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95d43e-1369-40cc-b811-a5a678a50206 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:22.264216 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54c533-1b57-4814-8c3c-b03e01d0543f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:22.264868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54c533-1b57-4814-8c3c-b03e01d0543f service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:22.265146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54c533-1b57-4814-8c3c-b03e01d0543f service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:22.265449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54c533-1b57-4814-8c3c-b03e01d0543f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:22.276851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54c533-1b57-4814-8c3c-b03e01d0543f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:22.278439 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54c533-1b57-4814-8c3c-b03e01d0543f service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:22.295171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1117/2248] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:59:22.497203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478422db-d549-421f-a830-d7a6c92228a7 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:22.498630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-478422db-d549-421f-a830-d7a6c92228a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:22.511430 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478422db-d549-421f-a830-d7a6c92228a7 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:22.534037 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f3c18-4045-4cbc-9a02-ed1617694e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:22.538823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f3c18-4045-4cbc-9a02-ed1617694e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:22.539136 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f3c18-4045-4cbc-9a02-ed1617694e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:22.539429 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f3c18-4045-4cbc-9a02-ed1617694e10 admin admin] PATH_INFO: `/v3/users/4b745f9a3c924557ac9b11154d72bb50` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:22.541819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f3c18-4045-4cbc-9a02-ed1617694e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b745f9a3c924557ac9b11154d72bb50)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:22.543991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f3c18-4045-4cbc-9a02-ed1617694e10 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:22.784805 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:22.796477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54c533-1b57-4814-8c3c-b03e01d0543f service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:22.798258 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-9a54c533-1b57-4814-8c3c-b03e01d0543f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:22.828914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54c533-1b57-4814-8c3c-b03e01d0543f service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:22.841305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb884e1-107c-470c-a19d-7a9d29db767f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:22.842186 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb884e1-107c-470c-a19d-7a9d29db767f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:22.842472 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb884e1-107c-470c-a19d-7a9d29db767f admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:22.842749 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb884e1-107c-470c-a19d-7a9d29db767f admin admin] PATH_INFO: `/v3/projects/40da4adb3fab4e438339ff29212d9de5` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:22.845000 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb884e1-107c-470c-a19d-7a9d29db767f admin admin] RBAC: Authorizing `identity:delete_project(project_id=40da4adb3fab4e438339ff29212d9de5)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:22.846941 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb884e1-107c-470c-a19d-7a9d29db767f admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:22.917851 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-4b5f3c18-4045-4cbc-9a02-ed1617694e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b745f9a3c924557ac9b11154d72bb50'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:22.930051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-4b5f3c18-4045-4cbc-9a02-ed1617694e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b745f9a3c924557ac9b11154d72bb50'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:22.983697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-dbb884e1-107c-470c-a19d-7a9d29db767f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40da4adb3fab4e438339ff29212d9de5', 'request_id': 'req-dbb884e1-107c-470c-a19d-7a9d29db767f'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:22.991213 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-dbb884e1-107c-470c-a19d-7a9d29db767f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40da4adb3fab4e438339ff29212d9de5', 'request_id': 'req-dbb884e1-107c-470c-a19d-7a9d29db767f'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:22.996990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-dbb884e1-107c-470c-a19d-7a9d29db767f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40da4adb3fab4e438339ff29212d9de5', 'request_id': 'req-dbb884e1-107c-470c-a19d-7a9d29db767f'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:23.018235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-4b5f3c18-4045-4cbc-9a02-ed1617694e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b745f9a3c924557ac9b11154d72bb50'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:23.019045 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-4b5f3c18-4045-4cbc-9a02-ed1617694e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b745f9a3c924557ac9b11154d72bb50'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:23.027699 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-4b5f3c18-4045-4cbc-9a02-ed1617694e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b745f9a3c924557ac9b11154d72bb50'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:23.033943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1132/2249] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:59:22 2022] DELETE /identity/v3/users/4b745f9a3c924557ac9b11154d72bb50 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:23.039797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb506bf-a4ca-47f5-9302-df7d96fb8b6a None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:23.044014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb506bf-a4ca-47f5-9302-df7d96fb8b6a None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:23.044014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb506bf-a4ca-47f5-9302-df7d96fb8b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:23.058765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-3eb506bf-a4ca-47f5-9302-df7d96fb8b6a None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:23.060095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-3eb506bf-a4ca-47f5-9302-df7d96fb8b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:23.124796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1133/2250] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:23.131918 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb506bf-a4ca-47f5-9302-df7d96fb8b6a None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:23.133640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-3eb506bf-a4ca-47f5-9302-df7d96fb8b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:23.138083 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-dbb884e1-107c-470c-a19d-7a9d29db767f admin admin] The token cache is being invalidate because project 40da4adb3fab4e438339ff29212d9de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:59:23.138456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-dbb884e1-107c-470c-a19d-7a9d29db767f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:23.139700 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-dbb884e1-107c-470c-a19d-7a9d29db767f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:23.142363 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1118/2251] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:59:22 2022] DELETE /identity/v3/projects/40da4adb3fab4e438339ff29212d9de5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:23.146148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb884e1-107c-470c-a19d-7a9d29db767f admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:23.147737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-dbb884e1-107c-470c-a19d-7a9d29db767f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:23.247080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb506bf-a4ca-47f5-9302-df7d96fb8b6a None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:23.257540 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb884e1-107c-470c-a19d-7a9d29db767f admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:23.257954 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a7e2b-ce88-446e-9682-5c00f8070789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:23.258701 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a7e2b-ce88-446e-9682-5c00f8070789 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:23.259050 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a7e2b-ce88-446e-9682-5c00f8070789 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:23.259501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a7e2b-ce88-446e-9682-5c00f8070789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:23.262537 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-9e4a7e2b-ce88-446e-9682-5c00f8070789 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:23.262994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b59b7-c1ff-4d30-a237-3d4e4624dcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:23.263957 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b59b7-c1ff-4d30-a237-3d4e4624dcb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:23.264578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b59b7-c1ff-4d30-a237-3d4e4624dcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:23.264578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b59b7-c1ff-4d30-a237-3d4e4624dcb4 admin admin] PATH_INFO: `/v3/users/30b5c94c03ee46beb80b15a6b29ff7ae` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:23.266196 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b59b7-c1ff-4d30-a237-3d4e4624dcb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30b5c94c03ee46beb80b15a6b29ff7ae)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:23.268609 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b59b7-c1ff-4d30-a237-3d4e4624dcb4 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:23.281404 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a7e2b-ce88-446e-9682-5c00f8070789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:23.283924 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a7e2b-ce88-446e-9682-5c00f8070789 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:23.307371 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1134/2252] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:59:23.510416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-ef6b59b7-c1ff-4d30-a237-3d4e4624dcb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30b5c94c03ee46beb80b15a6b29ff7ae'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:23.522753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-ef6b59b7-c1ff-4d30-a237-3d4e4624dcb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30b5c94c03ee46beb80b15a6b29ff7ae'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:23.605507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-ef6b59b7-c1ff-4d30-a237-3d4e4624dcb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30b5c94c03ee46beb80b15a6b29ff7ae'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:23.606198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-ef6b59b7-c1ff-4d30-a237-3d4e4624dcb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30b5c94c03ee46beb80b15a6b29ff7ae'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:23.617282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-ef6b59b7-c1ff-4d30-a237-3d4e4624dcb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30b5c94c03ee46beb80b15a6b29ff7ae'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:23.631194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1119/2253] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:59:23 2022] DELETE /identity/v3/users/30b5c94c03ee46beb80b15a6b29ff7ae => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:59:23.849221 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a7e2b-ce88-446e-9682-5c00f8070789 service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:23.852440 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-9e4a7e2b-ce88-446e-9682-5c00f8070789 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:23.885110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a7e2b-ce88-446e-9682-5c00f8070789 service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:23.966996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05b543-2dee-40a2-8678-f5da82c5d974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:23.968004 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05b543-2dee-40a2-8678-f5da82c5d974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:23.968614 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05b543-2dee-40a2-8678-f5da82c5d974 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:23.969187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05b543-2dee-40a2-8678-f5da82c5d974 admin admin] PATH_INFO: `/v3/projects/579e891be8e748d0bae1990fd84860e5` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:23.970392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05b543-2dee-40a2-8678-f5da82c5d974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=579e891be8e748d0bae1990fd84860e5)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:23.972427 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05b543-2dee-40a2-8678-f5da82c5d974 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:24.077033 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-4b05b543-2dee-40a2-8678-f5da82c5d974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '579e891be8e748d0bae1990fd84860e5', 'request_id': 'req-4b05b543-2dee-40a2-8678-f5da82c5d974'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:24.084189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-4b05b543-2dee-40a2-8678-f5da82c5d974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '579e891be8e748d0bae1990fd84860e5', 'request_id': 'req-4b05b543-2dee-40a2-8678-f5da82c5d974'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:24.091783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-4b05b543-2dee-40a2-8678-f5da82c5d974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '579e891be8e748d0bae1990fd84860e5', 'request_id': 'req-4b05b543-2dee-40a2-8678-f5da82c5d974'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:24.138805 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b59b7-c1ff-4d30-a237-3d4e4624dcb4 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:24.140360 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ef6b59b7-c1ff-4d30-a237-3d4e4624dcb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:24.155888 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b59b7-c1ff-4d30-a237-3d4e4624dcb4 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:24.161489 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-4b05b543-2dee-40a2-8678-f5da82c5d974 admin admin] The token cache is being invalidate because project 579e891be8e748d0bae1990fd84860e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:59:24.161978 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-4b05b543-2dee-40a2-8678-f5da82c5d974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:24.168927 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-4b05b543-2dee-40a2-8678-f5da82c5d974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:24.168927 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1135/2254] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:59:23 2022] DELETE /identity/v3/projects/579e891be8e748d0bae1990fd84860e5 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:24.170485 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bf8f4-c5d1-4dd0-9d1d-2142ef5cfcb3 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:24.170784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bf8f4-c5d1-4dd0-9d1d-2142ef5cfcb3 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:24.171087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bf8f4-c5d1-4dd0-9d1d-2142ef5cfcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:24.192751 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-f29bf8f4-c5d1-4dd0-9d1d-2142ef5cfcb3 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:24.194663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f29bf8f4-c5d1-4dd0-9d1d-2142ef5cfcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:24.219149 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5b2da-cb7c-412c-bb95-21d3298b9dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:24.220275 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5b2da-cb7c-412c-bb95-21d3298b9dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:24.220275 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5b2da-cb7c-412c-bb95-21d3298b9dec admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:24.220581 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5b2da-cb7c-412c-bb95-21d3298b9dec admin admin] PATH_INFO: `/v3/projects/7c235030194b4a439ff0c7eb2609e627` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:24.221876 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5b2da-cb7c-412c-bb95-21d3298b9dec admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c235030194b4a439ff0c7eb2609e627)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:24.224113 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5b2da-cb7c-412c-bb95-21d3298b9dec admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:24.271737 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1136/2255] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:24.279506 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a02cb3-8570-4ba3-9273-b07a38b6bedb None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:24.279798 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a02cb3-8570-4ba3-9273-b07a38b6bedb None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:24.280073 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a02cb3-8570-4ba3-9273-b07a38b6bedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:24.297780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-01a02cb3-8570-4ba3-9273-b07a38b6bedb None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:24.298970 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-01a02cb3-8570-4ba3-9273-b07a38b6bedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:24.307688 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1137/2256] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:24.311775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a02cb3-8570-4ba3-9273-b07a38b6bedb None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:24.322202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a02cb3-8570-4ba3-9273-b07a38b6bedb None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:24.328010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2f3bb-96bf-4a48-b5d1-72c813f51df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:24.328667 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2f3bb-96bf-4a48-b5d1-72c813f51df1 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:24.328940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2f3bb-96bf-4a48-b5d1-72c813f51df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:24.329256 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2f3bb-96bf-4a48-b5d1-72c813f51df1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:24.330019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2f3bb-96bf-4a48-b5d1-72c813f51df1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:59:24.330330 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2f3bb-96bf-4a48-b5d1-72c813f51df1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:24.331925 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2f3bb-96bf-4a48-b5d1-72c813f51df1 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:24.343872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1138/2257] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 19:59:24.348642 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2f3bb-96bf-4a48-b5d1-72c813f51df1 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:24.358061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2f3bb-96bf-4a48-b5d1-72c813f51df1 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:24.362837 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7b287-2024-4ad6-8bb9-c16413d9ddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:24.363482 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7b287-2024-4ad6-8bb9-c16413d9ddc8 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:24.364914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7b287-2024-4ad6-8bb9-c16413d9ddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:24.365239 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7b287-2024-4ad6-8bb9-c16413d9ddc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:24.365944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7b287-2024-4ad6-8bb9-c16413d9ddc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:24.367848 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7b287-2024-4ad6-8bb9-c16413d9ddc8 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:24.404613 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-37f5b2da-cb7c-412c-bb95-21d3298b9dec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c235030194b4a439ff0c7eb2609e627', 'request_id': 'req-37f5b2da-cb7c-412c-bb95-21d3298b9dec'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:24.411453 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-37f5b2da-cb7c-412c-bb95-21d3298b9dec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c235030194b4a439ff0c7eb2609e627', 'request_id': 'req-37f5b2da-cb7c-412c-bb95-21d3298b9dec'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:24.416974 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-37f5b2da-cb7c-412c-bb95-21d3298b9dec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c235030194b4a439ff0c7eb2609e627', 'request_id': 'req-37f5b2da-cb7c-412c-bb95-21d3298b9dec'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:24.495545 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1139/2258] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:59:24 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:59:24.500989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7b287-2024-4ad6-8bb9-c16413d9ddc8 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:24.514826 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-37f5b2da-cb7c-412c-bb95-21d3298b9dec admin admin] The token cache is being invalidate because project 7c235030194b4a439ff0c7eb2609e627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:59:24.515125 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-37f5b2da-cb7c-412c-bb95-21d3298b9dec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:24.517110 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-37f5b2da-cb7c-412c-bb95-21d3298b9dec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:24.519989 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1120/2259] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:59:24 2022] DELETE /identity/v3/projects/7c235030194b4a439ff0c7eb2609e627 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:24.525001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5b2da-cb7c-412c-bb95-21d3298b9dec admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:24.526587 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-37f5b2da-cb7c-412c-bb95-21d3298b9dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:24.606271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5b2da-cb7c-412c-bb95-21d3298b9dec admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:24.610372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7b287-2024-4ad6-8bb9-c16413d9ddc8 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:24.616843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229d531-8d1e-4e9d-bcbc-ebdd781f1251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:24.617821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229d531-8d1e-4e9d-bcbc-ebdd781f1251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:24.618307 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229d531-8d1e-4e9d-bcbc-ebdd781f1251 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:24.618744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229d531-8d1e-4e9d-bcbc-ebdd781f1251 admin admin] PATH_INFO: `/v3/users/fe31cb3bd19d443293be8b0458667619` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:24.620136 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229d531-8d1e-4e9d-bcbc-ebdd781f1251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe31cb3bd19d443293be8b0458667619)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:24.622264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229d531-8d1e-4e9d-bcbc-ebdd781f1251 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:24.624346 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95e6f9-bf71-4cbe-a42a-51be65ed7c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:24.625886 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95e6f9-bf71-4cbe-a42a-51be65ed7c74 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:24.626469 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95e6f9-bf71-4cbe-a42a-51be65ed7c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:24.626469 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95e6f9-bf71-4cbe-a42a-51be65ed7c74 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:24.627890 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95e6f9-bf71-4cbe-a42a-51be65ed7c74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:24.630049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95e6f9-bf71-4cbe-a42a-51be65ed7c74 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:24.740656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1140/2260] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:59:24 2022] POST /identity/v3/users => generated 288 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:59:24.742883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95e6f9-bf71-4cbe-a42a-51be65ed7c74 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:24.746914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ea95e6f9-bf71-4cbe-a42a-51be65ed7c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:24.792198 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95e6f9-bf71-4cbe-a42a-51be65ed7c74 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:24.808138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b62b2-b6c7-4e1f-b5e1-2e175b1ef7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:24.808842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b62b2-b6c7-4e1f-b5e1-2e175b1ef7fe admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:24.809130 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b62b2-b6c7-4e1f-b5e1-2e175b1ef7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:24.809432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b62b2-b6c7-4e1f-b5e1-2e175b1ef7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:24.810182 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b62b2-b6c7-4e1f-b5e1-2e175b1ef7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:24.811832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b62b2-b6c7-4e1f-b5e1-2e175b1ef7fe admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:24.824187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1141/2261] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:59:24.828401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b62b2-b6c7-4e1f-b5e1-2e175b1ef7fe admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:24.838312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4229d531-8d1e-4e9d-bcbc-ebdd781f1251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe31cb3bd19d443293be8b0458667619'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:24.842271 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b62b2-b6c7-4e1f-b5e1-2e175b1ef7fe admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:24.850954 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f979d-a934-46c1-8276-673c46daee5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:24.852040 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f979d-a934-46c1-8276-673c46daee5a admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:24.852560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f979d-a934-46c1-8276-673c46daee5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:24.852773 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f979d-a934-46c1-8276-673c46daee5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:24.853715 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f979d-a934-46c1-8276-673c46daee5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:24.855572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f979d-a934-46c1-8276-673c46daee5a admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:24.859105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4229d531-8d1e-4e9d-bcbc-ebdd781f1251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe31cb3bd19d443293be8b0458667619'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:24.873122 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1142/2262] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:59:24.874143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f979d-a934-46c1-8276-673c46daee5a admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:24.886160 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f979d-a934-46c1-8276-673c46daee5a admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:24.892425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f80ae-f141-45a4-9180-2049e24fe291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:24.897026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f80ae-f141-45a4-9180-2049e24fe291 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:24.897026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f80ae-f141-45a4-9180-2049e24fe291 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:24.897026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f80ae-f141-45a4-9180-2049e24fe291 admin admin] PATH_INFO: `/v3/projects/f64d555a0eac48e88cd74f5f1f17005b/users/ad798f450046406cac3b466ab942eb41/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:24.930758 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f80ae-f141-45a4-9180-2049e24fe291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64d555a0eac48e88cd74f5f1f17005b, user_id=ad798f450046406cac3b466ab942eb41, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:24.934465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f80ae-f141-45a4-9180-2049e24fe291 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:24.986639 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4229d531-8d1e-4e9d-bcbc-ebdd781f1251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe31cb3bd19d443293be8b0458667619'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:24.987478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4229d531-8d1e-4e9d-bcbc-ebdd781f1251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe31cb3bd19d443293be8b0458667619'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:24.996511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4229d531-8d1e-4e9d-bcbc-ebdd781f1251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe31cb3bd19d443293be8b0458667619'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:25.006945 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1121/2263] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:59:24 2022] DELETE /identity/v3/users/fe31cb3bd19d443293be8b0458667619 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:25.006945 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f655c07-bd86-49fe-aa81-537d75a9e4d6 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:25.006945 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f655c07-bd86-49fe-aa81-537d75a9e4d6 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:25.006945 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f655c07-bd86-49fe-aa81-537d75a9e4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:25.026627 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-4f655c07-bd86-49fe-aa81-537d75a9e4d6 None None] MFA Rules not processed for user `fec6c1cbf48a44f9922bd82e714861c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:25.027857 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-4f655c07-bd86-49fe-aa81-537d75a9e4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:25.106376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1143/2264] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:59:24 2022] PUT /identity/v3/projects/f64d555a0eac48e88cd74f5f1f17005b/users/ad798f450046406cac3b466ab942eb41/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:25.116041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1122/2265] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 19:59:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:25.117912 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76dd0e-5880-404a-b7fe-859127fae96a None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:25.118371 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76dd0e-5880-404a-b7fe-859127fae96a None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:25.118876 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76dd0e-5880-404a-b7fe-859127fae96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:25.161236 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-9e76dd0e-5880-404a-b7fe-859127fae96a None None] MFA Rules not processed for user `ad798f450046406cac3b466ab942eb41`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:25.162257 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-9e76dd0e-5880-404a-b7fe-859127fae96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:25.181986 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f655c07-bd86-49fe-aa81-537d75a9e4d6 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:25.183959 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-4f655c07-bd86-49fe-aa81-537d75a9e4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:25.273932 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1144/2266] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:59:25.281482 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76dd0e-5880-404a-b7fe-859127fae96a None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:25.282921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-9e76dd0e-5880-404a-b7fe-859127fae96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:25.283753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f655c07-bd86-49fe-aa81-537d75a9e4d6 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:25.390935 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb434535-2aa9-4f2b-ab34-4495f13802f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc53095a45e4136b37fb6e4e677eff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:25.391974 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb434535-2aa9-4f2b-ab34-4495f13802f2 service swift] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:25.393517 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb434535-2aa9-4f2b-ab34-4495f13802f2 service swift] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:25.395122 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb434535-2aa9-4f2b-ab34-4495f13802f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:25.409220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:25.423404 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76dd0e-5880-404a-b7fe-859127fae96a None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:25.427382 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875deb7-e3dd-4114-b24f-8532a42f7605 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:25.428144 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875deb7-e3dd-4114-b24f-8532a42f7605 service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:25.428526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875deb7-e3dd-4114-b24f-8532a42f7605 service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:25.428895 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875deb7-e3dd-4114-b24f-8532a42f7605 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:25.446430 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875deb7-e3dd-4114-b24f-8532a42f7605 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:25.451970 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875deb7-e3dd-4114-b24f-8532a42f7605 service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:25.459520 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1145/2267] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:59:25.488328 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb434535-2aa9-4f2b-ab34-4495f13802f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:25.491250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb434535-2aa9-4f2b-ab34-4495f13802f2 service swift] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:25.502451 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1123/2268] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 19:59:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 19:59:25.779532 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875deb7-e3dd-4114-b24f-8532a42f7605 service cinder] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:25.781005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c875deb7-e3dd-4114-b24f-8532a42f7605 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:25.991800 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875deb7-e3dd-4114-b24f-8532a42f7605 service cinder] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:25.997759 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facfe77-1354-4d85-93be-76c0ff81d8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:25.999614 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facfe77-1354-4d85-93be-76c0ff81d8e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:25.999987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facfe77-1354-4d85-93be-76c0ff81d8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:26.000422 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facfe77-1354-4d85-93be-76c0ff81d8e3 admin admin] PATH_INFO: `/v3/projects/dbb1f8d11f01439abd6682f6e0a62648` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:26.003195 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facfe77-1354-4d85-93be-76c0ff81d8e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbb1f8d11f01439abd6682f6e0a62648)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:26.006257 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facfe77-1354-4d85-93be-76c0ff81d8e3 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:26.251447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-5facfe77-1354-4d85-93be-76c0ff81d8e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbb1f8d11f01439abd6682f6e0a62648', 'request_id': 'req-5facfe77-1354-4d85-93be-76c0ff81d8e3'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:26.251447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-5facfe77-1354-4d85-93be-76c0ff81d8e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbb1f8d11f01439abd6682f6e0a62648', 'request_id': 'req-5facfe77-1354-4d85-93be-76c0ff81d8e3'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:26.251447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-5facfe77-1354-4d85-93be-76c0ff81d8e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbb1f8d11f01439abd6682f6e0a62648', 'request_id': 'req-5facfe77-1354-4d85-93be-76c0ff81d8e3'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:26.352964 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-5facfe77-1354-4d85-93be-76c0ff81d8e3 admin admin] The token cache is being invalidate because project dbb1f8d11f01439abd6682f6e0a62648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:59:26.352964 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-5facfe77-1354-4d85-93be-76c0ff81d8e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:26.352964 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-5facfe77-1354-4d85-93be-76c0ff81d8e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:26.360891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1146/2269] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:59:25 2022] DELETE /identity/v3/projects/dbb1f8d11f01439abd6682f6e0a62648 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:26.362647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092a6f1-e90e-4b33-aeaf-fdfdeca286c5 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:26.363073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092a6f1-e90e-4b33-aeaf-fdfdeca286c5 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:26.363214 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092a6f1-e90e-4b33-aeaf-fdfdeca286c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:26.441045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-f092a6f1-e90e-4b33-aeaf-fdfdeca286c5 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:26.447231 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f092a6f1-e90e-4b33-aeaf-fdfdeca286c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:26.572301 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1124/2270] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:26.582547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad573a66-31d5-47fb-bee2-4c9b591c3ad8 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:26.582891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad573a66-31d5-47fb-bee2-4c9b591c3ad8 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:26.583815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad573a66-31d5-47fb-bee2-4c9b591c3ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:26.615999 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-ad573a66-31d5-47fb-bee2-4c9b591c3ad8 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:26.624243 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ad573a66-31d5-47fb-bee2-4c9b591c3ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:26.628369 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1147/2271] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:26.634249 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092a6f1-e90e-4b33-aeaf-fdfdeca286c5 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:26.667360 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092a6f1-e90e-4b33-aeaf-fdfdeca286c5 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:26.683253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ce7b8-e20d-4e8b-a110-31ff0ad8a1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:26.684120 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ce7b8-e20d-4e8b-a110-31ff0ad8a1ee admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:26.684694 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ce7b8-e20d-4e8b-a110-31ff0ad8a1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:26.685201 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ce7b8-e20d-4e8b-a110-31ff0ad8a1ee admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:26.693013 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ce7b8-e20d-4e8b-a110-31ff0ad8a1ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:59:26.693013 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ce7b8-e20d-4e8b-a110-31ff0ad8a1ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:26.693013 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ce7b8-e20d-4e8b-a110-31ff0ad8a1ee admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:26.710744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1125/2272] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:59:26.730401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad573a66-31d5-47fb-bee2-4c9b591c3ad8 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:26.741474 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad573a66-31d5-47fb-bee2-4c9b591c3ad8 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:26.747047 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adecd6-2b86-4454-936c-d1ae6c920b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:26.747992 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adecd6-2b86-4454-936c-d1ae6c920b94 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:26.748440 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adecd6-2b86-4454-936c-d1ae6c920b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:26.748882 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adecd6-2b86-4454-936c-d1ae6c920b94 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:26.749812 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adecd6-2b86-4454-936c-d1ae6c920b94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:26.752322 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adecd6-2b86-4454-936c-d1ae6c920b94 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:26.883715 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:26.892188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1148/2273] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:59:26 2022] POST /identity/v3/projects => generated 363 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:59:26.898415 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ce7b8-e20d-4e8b-a110-31ff0ad8a1ee admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:26.915933 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ce7b8-e20d-4e8b-a110-31ff0ad8a1ee admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:27.070053 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3c2ce-14b7-490d-9e7c-ebe5a6655495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:27.070818 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3c2ce-14b7-490d-9e7c-ebe5a6655495 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:27.071170 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3c2ce-14b7-490d-9e7c-ebe5a6655495 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:27.071534 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3c2ce-14b7-490d-9e7c-ebe5a6655495 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:27.079876 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3c2ce-14b7-490d-9e7c-ebe5a6655495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:27.089844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3c2ce-14b7-490d-9e7c-ebe5a6655495 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:27.203484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1126/2274] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:59:26 2022] POST /identity/v3/users => generated 282 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:59:27.206243 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adecd6-2b86-4454-936c-d1ae6c920b94 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:27.219447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adecd6-2b86-4454-936c-d1ae6c920b94 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:27.224943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1d053-8b6a-4741-8123-c44295591787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:27.229105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1d053-8b6a-4741-8123-c44295591787 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:27.229105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1d053-8b6a-4741-8123-c44295591787 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:27.229105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1d053-8b6a-4741-8123-c44295591787 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:27.229105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1d053-8b6a-4741-8123-c44295591787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:27.229642 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1d053-8b6a-4741-8123-c44295591787 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:27.245270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1149/2275] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:59:27.246166 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3c2ce-14b7-490d-9e7c-ebe5a6655495 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:27.266297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3c2ce-14b7-490d-9e7c-ebe5a6655495 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:27.286969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994cb0f-7307-42df-b0a6-643d8d3be380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:27.288887 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994cb0f-7307-42df-b0a6-643d8d3be380 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:27.289805 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994cb0f-7307-42df-b0a6-643d8d3be380 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:27.290100 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994cb0f-7307-42df-b0a6-643d8d3be380 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:27.293037 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994cb0f-7307-42df-b0a6-643d8d3be380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:27.296908 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994cb0f-7307-42df-b0a6-643d8d3be380 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:27.314216 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1127/2276] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:59:27.318536 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1d053-8b6a-4741-8123-c44295591787 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:27.335787 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1d053-8b6a-4741-8123-c44295591787 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:27.346649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e11b28-ae82-4333-8e7e-69b1026a0a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:27.346649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e11b28-ae82-4333-8e7e-69b1026a0a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:27.346649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e11b28-ae82-4333-8e7e-69b1026a0a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:27.346649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e11b28-ae82-4333-8e7e-69b1026a0a71 admin admin] PATH_INFO: `/v3/projects/b73d95893795463db69133bf8159b152/users/e4573c1b0cee4289b413cb1b5fa5f304/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:27.362402 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e11b28-ae82-4333-8e7e-69b1026a0a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b73d95893795463db69133bf8159b152, user_id=e4573c1b0cee4289b413cb1b5fa5f304, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:27.367130 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e11b28-ae82-4333-8e7e-69b1026a0a71 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:27.469491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1150/2277] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:59:27 2022] PUT /identity/v3/projects/b73d95893795463db69133bf8159b152/users/e4573c1b0cee4289b413cb1b5fa5f304/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:27.483859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b89fe-f71c-428d-8719-266513dfb9e3 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:27.484481 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b89fe-f71c-428d-8719-266513dfb9e3 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:27.484481 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b89fe-f71c-428d-8719-266513dfb9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:27.550932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-3a3b89fe-f71c-428d-8719-266513dfb9e3 None None] MFA Rules not processed for user `e4573c1b0cee4289b413cb1b5fa5f304`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:27.556822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-3a3b89fe-f71c-428d-8719-266513dfb9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:27.740892 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1128/2278] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:27 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:27.757732 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e11b28-ae82-4333-8e7e-69b1026a0a71 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:27.759765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f6e11b28-ae82-4333-8e7e-69b1026a0a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:27.898040 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:27.921645 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e11b28-ae82-4333-8e7e-69b1026a0a71 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:27.927878 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a866771-51ab-48d2-91cf-10e20fbe76a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:27.929321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a866771-51ab-48d2-91cf-10e20fbe76a9 service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:27.929989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a866771-51ab-48d2-91cf-10e20fbe76a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:27.930469 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a866771-51ab-48d2-91cf-10e20fbe76a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:28.019250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a866771-51ab-48d2-91cf-10e20fbe76a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:28.028658 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a866771-51ab-48d2-91cf-10e20fbe76a9 service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:28.067584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1151/2279] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:27 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:59:28.298701 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff0fb3-853b-4722-b01f-26af550c7b64 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:28.299249 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff0fb3-853b-4722-b01f-26af550c7b64 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:28.299700 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff0fb3-853b-4722-b01f-26af550c7b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:28.327968 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-36ff0fb3-853b-4722-b01f-26af550c7b64 None None] MFA Rules not processed for user `fec6c1cbf48a44f9922bd82e714861c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:28.329812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-36ff0fb3-853b-4722-b01f-26af550c7b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:28.477742 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1129/2280] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 19:59:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:28.495249 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a866771-51ab-48d2-91cf-10e20fbe76a9 service cinder] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:28.496726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-8a866771-51ab-48d2-91cf-10e20fbe76a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:28.666727 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a866771-51ab-48d2-91cf-10e20fbe76a9 service cinder] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:28.683134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89d0be-e2be-4b45-83a4-a5977565ceeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc53095a45e4136b37fb6e4e677eff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:28.692858 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89d0be-e2be-4b45-83a4-a5977565ceeb service swift] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:28.692858 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89d0be-e2be-4b45-83a4-a5977565ceeb service swift] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:28.692858 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89d0be-e2be-4b45-83a4-a5977565ceeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:28.697203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89d0be-e2be-4b45-83a4-a5977565ceeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:28.699325 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89d0be-e2be-4b45-83a4-a5977565ceeb service swift] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:28.735701 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1152/2281] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 19:59:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 19:59:29.140704 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:29.230638 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff0fb3-853b-4722-b01f-26af550c7b64 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:29.232158 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-36ff0fb3-853b-4722-b01f-26af550c7b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:29.573702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff0fb3-853b-4722-b01f-26af550c7b64 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:29.587011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3b297-76cc-4fe9-9cc3-7ad84c6a6d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:29.588108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3b297-76cc-4fe9-9cc3-7ad84c6a6d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:29.588565 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3b297-76cc-4fe9-9cc3-7ad84c6a6d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:29.589040 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3b297-76cc-4fe9-9cc3-7ad84c6a6d27 admin admin] PATH_INFO: `/v3/users/a20f752f144f413eb7b6991089993cfc` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:29.592279 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3b297-76cc-4fe9-9cc3-7ad84c6a6d27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a20f752f144f413eb7b6991089993cfc)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:29.594804 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3b297-76cc-4fe9-9cc3-7ad84c6a6d27 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:30.082963 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1bf3b297-76cc-4fe9-9cc3-7ad84c6a6d27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a20f752f144f413eb7b6991089993cfc'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:30.105380 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1bf3b297-76cc-4fe9-9cc3-7ad84c6a6d27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a20f752f144f413eb7b6991089993cfc'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:30.263492 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:30.285832 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1bf3b297-76cc-4fe9-9cc3-7ad84c6a6d27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a20f752f144f413eb7b6991089993cfc'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:30.286876 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1bf3b297-76cc-4fe9-9cc3-7ad84c6a6d27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a20f752f144f413eb7b6991089993cfc'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:30.296906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-1bf3b297-76cc-4fe9-9cc3-7ad84c6a6d27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a20f752f144f413eb7b6991089993cfc'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:30.349946 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1130/2282] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:59:29 2022] DELETE /identity/v3/users/a20f752f144f413eb7b6991089993cfc => generated 0 bytes in 1116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:30.351828 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f6541-e6e6-48fc-bb1b-2f543c805ee7 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:30.352133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f6541-e6e6-48fc-bb1b-2f543c805ee7 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:30.352425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f6541-e6e6-48fc-bb1b-2f543c805ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:30.407025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-d27f6541-e6e6-48fc-bb1b-2f543c805ee7 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:30.408481 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d27f6541-e6e6-48fc-bb1b-2f543c805ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:30.646397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1153/2283] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:30.650030 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3b297-76cc-4fe9-9cc3-7ad84c6a6d27 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:30.650030 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-1bf3b297-76cc-4fe9-9cc3-7ad84c6a6d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:30.843134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3b297-76cc-4fe9-9cc3-7ad84c6a6d27 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:30.853796 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b0791-fcf7-4548-99ed-a3523140b020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:30.854630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b0791-fcf7-4548-99ed-a3523140b020 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:30.855024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b0791-fcf7-4548-99ed-a3523140b020 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:30.855410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b0791-fcf7-4548-99ed-a3523140b020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:30.877832 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b0791-fcf7-4548-99ed-a3523140b020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:30.879965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b0791-fcf7-4548-99ed-a3523140b020 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:30.911301 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1131/2284] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 19:59:31.754882 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:31.837096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f6541-e6e6-48fc-bb1b-2f543c805ee7 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:31.838602 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d27f6541-e6e6-48fc-bb1b-2f543c805ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:31.857991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f6541-e6e6-48fc-bb1b-2f543c805ee7 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:31.901609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ffbedd-20b4-4874-b571-97a03abc3ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:31.901609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffbedd-20b4-4874-b571-97a03abc3ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:31.901609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffbedd-20b4-4874-b571-97a03abc3ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:31.901609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffbedd-20b4-4874-b571-97a03abc3ce5 admin admin] PATH_INFO: `/v3/projects/415851de1a154d818421bc83036ea3aa` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:31.902290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ffbedd-20b4-4874-b571-97a03abc3ce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=415851de1a154d818421bc83036ea3aa)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:31.902290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ffbedd-20b4-4874-b571-97a03abc3ce5 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:32.040374 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-87ffbedd-20b4-4874-b571-97a03abc3ce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '415851de1a154d818421bc83036ea3aa', 'request_id': 'req-87ffbedd-20b4-4874-b571-97a03abc3ce5'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:32.062446 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-87ffbedd-20b4-4874-b571-97a03abc3ce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '415851de1a154d818421bc83036ea3aa', 'request_id': 'req-87ffbedd-20b4-4874-b571-97a03abc3ce5'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:32.080528 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-87ffbedd-20b4-4874-b571-97a03abc3ce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '415851de1a154d818421bc83036ea3aa', 'request_id': 'req-87ffbedd-20b4-4874-b571-97a03abc3ce5'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:32.193835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-87ffbedd-20b4-4874-b571-97a03abc3ce5 admin admin] The token cache is being invalidate because project 415851de1a154d818421bc83036ea3aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:59:32.194359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-87ffbedd-20b4-4874-b571-97a03abc3ce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:32.195225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-87ffbedd-20b4-4874-b571-97a03abc3ce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:32.203067 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1154/2285] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:59:31 2022] DELETE /identity/v3/projects/415851de1a154d818421bc83036ea3aa => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:32.203383 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffc92c-bf13-43b9-8f07-625ce58c155b None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:32.203681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffc92c-bf13-43b9-8f07-625ce58c155b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:32.203965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffc92c-bf13-43b9-8f07-625ce58c155b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:32.384639 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-50ffc92c-bf13-43b9-8f07-625ce58c155b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:32.386569 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-50ffc92c-bf13-43b9-8f07-625ce58c155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:32.594622 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1132/2286] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:32.603372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8361767-4003-4851-91e8-db5c8495d612 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:32.603659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8361767-4003-4851-91e8-db5c8495d612 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:32.603971 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8361767-4003-4851-91e8-db5c8495d612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:32.636884 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-c8361767-4003-4851-91e8-db5c8495d612 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:32.636884 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c8361767-4003-4851-91e8-db5c8495d612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:32.658867 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ffc92c-bf13-43b9-8f07-625ce58c155b None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:32.665588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1155/2287] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:32.683352 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ffc92c-bf13-43b9-8f07-625ce58c155b None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:32.696918 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce1df0-d13a-4f8b-8d79-b32a5bdb3a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:32.697803 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce1df0-d13a-4f8b-8d79-b32a5bdb3a32 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:32.698199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce1df0-d13a-4f8b-8d79-b32a5bdb3a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:32.698731 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce1df0-d13a-4f8b-8d79-b32a5bdb3a32 admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:32.700276 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce1df0-d13a-4f8b-8d79-b32a5bdb3a32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:59:32.700872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce1df0-d13a-4f8b-8d79-b32a5bdb3a32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:32.703238 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce1df0-d13a-4f8b-8d79-b32a5bdb3a32 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:32.729469 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1133/2288] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:59:32.734257 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8361767-4003-4851-91e8-db5c8495d612 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:32.747297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8361767-4003-4851-91e8-db5c8495d612 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:32.752815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcee9b1-d216-477a-b913-5264ccdfb333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:32.753312 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcee9b1-d216-477a-b913-5264ccdfb333 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:32.753703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcee9b1-d216-477a-b913-5264ccdfb333 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:32.754090 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcee9b1-d216-477a-b913-5264ccdfb333 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:32.754964 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcee9b1-d216-477a-b913-5264ccdfb333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:32.757201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcee9b1-d216-477a-b913-5264ccdfb333 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:32.823889 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:32.937585 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1156/2289] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:59:32 2022] POST /identity/v3/projects => generated 385 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:59:32.942240 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce1df0-d13a-4f8b-8d79-b32a5bdb3a32 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:32.956066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce1df0-d13a-4f8b-8d79-b32a5bdb3a32 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:33.185384 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa4e1d-cfd5-48cc-92e7-b941a7f33e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:33.194082 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa4e1d-cfd5-48cc-92e7-b941a7f33e76 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:33.194389 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa4e1d-cfd5-48cc-92e7-b941a7f33e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:33.194680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa4e1d-cfd5-48cc-92e7-b941a7f33e76 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:33.195445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa4e1d-cfd5-48cc-92e7-b941a7f33e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:33.207993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa4e1d-cfd5-48cc-92e7-b941a7f33e76 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:33.296505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1134/2290] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:59:32 2022] POST /identity/v3/users => generated 293 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:59:33.297214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcee9b1-d216-477a-b913-5264ccdfb333 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:33.312713 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcee9b1-d216-477a-b913-5264ccdfb333 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:33.330328 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d3830-1cbb-41f9-9859-e9c9e6415e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:33.331031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d3830-1cbb-41f9-9859-e9c9e6415e28 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:33.331340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d3830-1cbb-41f9-9859-e9c9e6415e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:33.331611 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d3830-1cbb-41f9-9859-e9c9e6415e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:33.335112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d3830-1cbb-41f9-9859-e9c9e6415e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:33.340397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d3830-1cbb-41f9-9859-e9c9e6415e28 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:33.383680 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1157/2291] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 19:59:33.388061 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa4e1d-cfd5-48cc-92e7-b941a7f33e76 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:33.400684 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa4e1d-cfd5-48cc-92e7-b941a7f33e76 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:33.452875 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f92868-2d35-4106-8a79-13dcf17bcb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:33.452875 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f92868-2d35-4106-8a79-13dcf17bcb08 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:33.452875 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f92868-2d35-4106-8a79-13dcf17bcb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:33.452875 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f92868-2d35-4106-8a79-13dcf17bcb08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:33.453526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f92868-2d35-4106-8a79-13dcf17bcb08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:33.453526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f92868-2d35-4106-8a79-13dcf17bcb08 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:33.504733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1135/2292] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:59:33.505790 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d3830-1cbb-41f9-9859-e9c9e6415e28 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:33.550175 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d3830-1cbb-41f9-9859-e9c9e6415e28 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:33.577673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88593c-2642-4c9b-9896-e82df0740213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:33.580378 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88593c-2642-4c9b-9896-e82df0740213 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:33.580378 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88593c-2642-4c9b-9896-e82df0740213 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:33.580378 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88593c-2642-4c9b-9896-e82df0740213 admin admin] PATH_INFO: `/v3/projects/4fb24cdebec343b2a9b0684ae67a40c8/users/277cd0e880dc4ed39cbc46422ed5e22a/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:33.640361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88593c-2642-4c9b-9896-e82df0740213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fb24cdebec343b2a9b0684ae67a40c8, user_id=277cd0e880dc4ed39cbc46422ed5e22a, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:33.643099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88593c-2642-4c9b-9896-e82df0740213 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:33.784808 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1158/2293] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:59:33 2022] PUT /identity/v3/projects/4fb24cdebec343b2a9b0684ae67a40c8/users/277cd0e880dc4ed39cbc46422ed5e22a/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:59:33.790381 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad62f8-3472-4754-9fc3-600d21dbfe69 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:33.790676 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad62f8-3472-4754-9fc3-600d21dbfe69 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:33.790959 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad62f8-3472-4754-9fc3-600d21dbfe69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:33.828571 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-58ad62f8-3472-4754-9fc3-600d21dbfe69 None None] MFA Rules not processed for user `277cd0e880dc4ed39cbc46422ed5e22a`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:33.829942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-58ad62f8-3472-4754-9fc3-600d21dbfe69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:33.966328 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88593c-2642-4c9b-9896-e82df0740213 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:34.000940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1136/2294] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:34.232576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88593c-2642-4c9b-9896-e82df0740213 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:34.249916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c34d3-a20e-4de7-9017-38667b79701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:34.251218 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c34d3-a20e-4de7-9017-38667b79701b admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:34.251711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c34d3-a20e-4de7-9017-38667b79701b admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:34.252195 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c34d3-a20e-4de7-9017-38667b79701b admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:34.253245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c34d3-a20e-4de7-9017-38667b79701b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:34.256370 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c34d3-a20e-4de7-9017-38667b79701b admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:34.706558 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1159/2295] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:59:33 2022] POST /identity/v3/projects => generated 381 bytes in 741 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:59:34.711903 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad62f8-3472-4754-9fc3-600d21dbfe69 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:34.725366 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad62f8-3472-4754-9fc3-600d21dbfe69 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:34.800560 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906c79f-5bb1-458e-9674-66ef0af9c3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:34.801954 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906c79f-5bb1-458e-9674-66ef0af9c3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:34.803285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906c79f-5bb1-458e-9674-66ef0af9c3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:34.803915 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906c79f-5bb1-458e-9674-66ef0af9c3f1 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:34.804863 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906c79f-5bb1-458e-9674-66ef0af9c3f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:34.807115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906c79f-5bb1-458e-9674-66ef0af9c3f1 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:34.887662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:35.076595 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:35.111440 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1137/2296] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:59:34 2022] POST /identity/v3/users => generated 291 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:59:35.114966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c34d3-a20e-4de7-9017-38667b79701b admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:35.126992 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c34d3-a20e-4de7-9017-38667b79701b admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:35.141131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94eeae-1ea0-40fc-a512-a4d405dc2d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:35.141854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94eeae-1ea0-40fc-a512-a4d405dc2d36 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:35.142130 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94eeae-1ea0-40fc-a512-a4d405dc2d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:35.142408 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94eeae-1ea0-40fc-a512-a4d405dc2d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:35.143156 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94eeae-1ea0-40fc-a512-a4d405dc2d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:35.146341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94eeae-1ea0-40fc-a512-a4d405dc2d36 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:35.173785 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1160/2297] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:59:35.175085 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906c79f-5bb1-458e-9674-66ef0af9c3f1 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:35.187043 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906c79f-5bb1-458e-9674-66ef0af9c3f1 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:35.204315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486521fa-03f8-410f-b5c0-c34932e428a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:35.206036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486521fa-03f8-410f-b5c0-c34932e428a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:35.206364 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486521fa-03f8-410f-b5c0-c34932e428a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:35.206658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486521fa-03f8-410f-b5c0-c34932e428a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:35.207456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486521fa-03f8-410f-b5c0-c34932e428a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:35.209085 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486521fa-03f8-410f-b5c0-c34932e428a0 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:35.236296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1138/2298] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:59:35.248785 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94eeae-1ea0-40fc-a512-a4d405dc2d36 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:35.265066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94eeae-1ea0-40fc-a512-a4d405dc2d36 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:35.273959 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca680281-663f-43df-bf5f-82836aee7a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:35.275234 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca680281-663f-43df-bf5f-82836aee7a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:35.276130 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca680281-663f-43df-bf5f-82836aee7a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:35.276710 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca680281-663f-43df-bf5f-82836aee7a96 admin admin] PATH_INFO: `/v3/projects/493f6664d8e64e97b688dbecca5d7cfb/users/028ce5c11ff04f95a85bfdfba10591fc/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:35.295763 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca680281-663f-43df-bf5f-82836aee7a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=493f6664d8e64e97b688dbecca5d7cfb, user_id=028ce5c11ff04f95a85bfdfba10591fc, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:35.299176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca680281-663f-43df-bf5f-82836aee7a96 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:35.390383 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1161/2299] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:59:35 2022] PUT /identity/v3/projects/493f6664d8e64e97b688dbecca5d7cfb/users/028ce5c11ff04f95a85bfdfba10591fc/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:35.402136 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cc306-b980-4006-955f-23dbad5a8b2e None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:35.402590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cc306-b980-4006-955f-23dbad5a8b2e None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:35.403080 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cc306-b980-4006-955f-23dbad5a8b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:35.467510 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-8d2cc306-b980-4006-955f-23dbad5a8b2e None None] MFA Rules not processed for user `028ce5c11ff04f95a85bfdfba10591fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:35.470277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-8d2cc306-b980-4006-955f-23dbad5a8b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:35.626651 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1139/2300] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:35.631777 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca680281-663f-43df-bf5f-82836aee7a96 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:35.914218 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca680281-663f-43df-bf5f-82836aee7a96 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:35.946647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee5f52-5f93-4cc2-a271-a4aa7d149477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:35.947346 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee5f52-5f93-4cc2-a271-a4aa7d149477 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:35.947636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee5f52-5f93-4cc2-a271-a4aa7d149477 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:35.947962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee5f52-5f93-4cc2-a271-a4aa7d149477 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:35.948792 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee5f52-5f93-4cc2-a271-a4aa7d149477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:35.950794 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee5f52-5f93-4cc2-a271-a4aa7d149477 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:36.088862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1162/2301] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:59:35 2022] POST /identity/v3/projects => generated 385 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:59:36.092902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cc306-b980-4006-955f-23dbad5a8b2e None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:36.115122 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cc306-b980-4006-955f-23dbad5a8b2e None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:36.330265 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd03fc-e191-431d-af85-88ac6a368a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:36.330970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd03fc-e191-431d-af85-88ac6a368a7d admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:36.331260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd03fc-e191-431d-af85-88ac6a368a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:36.331544 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd03fc-e191-431d-af85-88ac6a368a7d admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:36.332297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd03fc-e191-431d-af85-88ac6a368a7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:36.336966 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd03fc-e191-431d-af85-88ac6a368a7d admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:36.472606 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1140/2302] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:59:36 2022] POST /identity/v3/users => generated 299 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 19:59:36.476770 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee5f52-5f93-4cc2-a271-a4aa7d149477 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:36.493078 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee5f52-5f93-4cc2-a271-a4aa7d149477 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:36.507491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19b421-3cb7-4cb3-8e0c-5aeedf974bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:36.508571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19b421-3cb7-4cb3-8e0c-5aeedf974bab admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:36.509463 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19b421-3cb7-4cb3-8e0c-5aeedf974bab admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:36.509952 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19b421-3cb7-4cb3-8e0c-5aeedf974bab admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:36.510918 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19b421-3cb7-4cb3-8e0c-5aeedf974bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:36.513452 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19b421-3cb7-4cb3-8e0c-5aeedf974bab admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:36.544541 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1163/2303] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:59:36.546126 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd03fc-e191-431d-af85-88ac6a368a7d admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:36.571478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd03fc-e191-431d-af85-88ac6a368a7d admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:36.647404 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9a1c2-b326-4461-9696-9d9a61f81161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:36.681533 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9a1c2-b326-4461-9696-9d9a61f81161 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:36.681533 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9a1c2-b326-4461-9696-9d9a61f81161 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:36.681533 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9a1c2-b326-4461-9696-9d9a61f81161 admin admin] PATH_INFO: `/v3/projects/65685783315542c797f2b33b582bf493/users/52458263897f4c058286fc32dcddcfbb/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:36.695545 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9a1c2-b326-4461-9696-9d9a61f81161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65685783315542c797f2b33b582bf493, user_id=52458263897f4c058286fc32dcddcfbb, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:36.698528 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9a1c2-b326-4461-9696-9d9a61f81161 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:37.184061 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1141/2304] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:59:36 2022] PUT /identity/v3/projects/65685783315542c797f2b33b582bf493/users/52458263897f4c058286fc32dcddcfbb/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:59:37.187747 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19b421-3cb7-4cb3-8e0c-5aeedf974bab admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:37.208565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19b421-3cb7-4cb3-8e0c-5aeedf974bab admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:37.343228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2daa9-6d5c-49e5-972a-d0f41e2f2945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:37.344393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2daa9-6d5c-49e5-972a-d0f41e2f2945 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:37.345044 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2daa9-6d5c-49e5-972a-d0f41e2f2945 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:37.345510 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2daa9-6d5c-49e5-972a-d0f41e2f2945 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:37.346422 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2daa9-6d5c-49e5-972a-d0f41e2f2945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:37.348850 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2daa9-6d5c-49e5-972a-d0f41e2f2945 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:37.377394 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1164/2305] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:59:37.382001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9a1c2-b326-4461-9696-9d9a61f81161 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:37.397019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9a1c2-b326-4461-9696-9d9a61f81161 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:37.411240 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0100c06-8b86-4e6c-979c-7885df7b2ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:37.413396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0100c06-8b86-4e6c-979c-7885df7b2ebe admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:37.413801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0100c06-8b86-4e6c-979c-7885df7b2ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:37.414726 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0100c06-8b86-4e6c-979c-7885df7b2ebe admin admin] PATH_INFO: `/v3/projects/65685783315542c797f2b33b582bf493/users/52458263897f4c058286fc32dcddcfbb/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:37.419723 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0100c06-8b86-4e6c-979c-7885df7b2ebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=65685783315542c797f2b33b582bf493, user_id=52458263897f4c058286fc32dcddcfbb, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:37.425697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0100c06-8b86-4e6c-979c-7885df7b2ebe admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:37.456700 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1142/2306] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:59:37 2022] PUT /identity/v3/projects/65685783315542c797f2b33b582bf493/users/52458263897f4c058286fc32dcddcfbb/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:37.467673 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6b246-f0db-48ac-a87a-f2a0f89c663d None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:37.468004 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6b246-f0db-48ac-a87a-f2a0f89c663d None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:37.468342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6b246-f0db-48ac-a87a-f2a0f89c663d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:37.516975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-67d6b246-f0db-48ac-a87a-f2a0f89c663d None None] MFA Rules not processed for user `52458263897f4c058286fc32dcddcfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:37.518761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-67d6b246-f0db-48ac-a87a-f2a0f89c663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:37.531333 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:37.648909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:37.649949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1165/2307] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:37.663658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0100c06-8b86-4e6c-979c-7885df7b2ebe admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:37.677723 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-b0100c06-8b86-4e6c-979c-7885df7b2ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:37.819461 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0100c06-8b86-4e6c-979c-7885df7b2ebe admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:37.829119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44e186-94dc-4456-8d03-1f5a56494485 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:37.829958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44e186-94dc-4456-8d03-1f5a56494485 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:37.830348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44e186-94dc-4456-8d03-1f5a56494485 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:37.830773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44e186-94dc-4456-8d03-1f5a56494485 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:38.043103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44e186-94dc-4456-8d03-1f5a56494485 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:38.053726 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44e186-94dc-4456-8d03-1f5a56494485 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:38.081081 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1143/2308] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:59:39.765512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:40.233475 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:41.273972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:41.828193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:42.203958 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6b246-f0db-48ac-a87a-f2a0f89c663d None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:42.220001 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6b246-f0db-48ac-a87a-f2a0f89c663d None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:42.225042 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39927039-2fe6-41d6-b6c3-cc011df6fdf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:42.226225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39927039-2fe6-41d6-b6c3-cc011df6fdf4 service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:42.226803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39927039-2fe6-41d6-b6c3-cc011df6fdf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:42.227394 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39927039-2fe6-41d6-b6c3-cc011df6fdf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:42.305010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39927039-2fe6-41d6-b6c3-cc011df6fdf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:42.306736 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39927039-2fe6-41d6-b6c3-cc011df6fdf4 service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:42.333973 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1166/2309] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:59:44.124733 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:44.714629 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:45.406577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44e186-94dc-4456-8d03-1f5a56494485 service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:45.414744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:45.441024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44e186-94dc-4456-8d03-1f5a56494485 service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:45.463735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da698e07-c266-436d-b74c-bb221c21691d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:45.476411 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da698e07-c266-436d-b74c-bb221c21691d service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:45.477066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da698e07-c266-436d-b74c-bb221c21691d service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:45.478088 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da698e07-c266-436d-b74c-bb221c21691d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:45.496554 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da698e07-c266-436d-b74c-bb221c21691d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:45.498379 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da698e07-c266-436d-b74c-bb221c21691d service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:45.510322 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1144/2310] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:59:45.805669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0437631-8d1d-4a65-b9c0-295966add4f2 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:45.806159 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0437631-8d1d-4a65-b9c0-295966add4f2 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:45.806252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0437631-8d1d-4a65-b9c0-295966add4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:45.864753 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-c0437631-8d1d-4a65-b9c0-295966add4f2 None None] MFA Rules not processed for user `fec6c1cbf48a44f9922bd82e714861c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:45.868098 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c0437631-8d1d-4a65-b9c0-295966add4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:45.953911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1167/2311] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 19:59:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:45.969448 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da698e07-c266-436d-b74c-bb221c21691d service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:45.972256 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-da698e07-c266-436d-b74c-bb221c21691d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:46.130734 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da698e07-c266-436d-b74c-bb221c21691d service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:46.136348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039289f-c98c-417d-8d2c-12e5c2e9ff00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc53095a45e4136b37fb6e4e677eff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:46.137083 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039289f-c98c-417d-8d2c-12e5c2e9ff00 service swift] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:46.137599 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039289f-c98c-417d-8d2c-12e5c2e9ff00 service swift] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:46.138059 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039289f-c98c-417d-8d2c-12e5c2e9ff00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:46.165795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039289f-c98c-417d-8d2c-12e5c2e9ff00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:46.167987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039289f-c98c-417d-8d2c-12e5c2e9ff00 service swift] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:46.183323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1145/2312] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 19:59:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 19:59:46.536529 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:47.688036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0437631-8d1d-4a65-b9c0-295966add4f2 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:47.690542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c0437631-8d1d-4a65-b9c0-295966add4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:47.745979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08773776-39b8-434d-8236-0456223529a0 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:47.755740 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08773776-39b8-434d-8236-0456223529a0 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:47.755740 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08773776-39b8-434d-8236-0456223529a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:47.774192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-08773776-39b8-434d-8236-0456223529a0 None None] MFA Rules not processed for user `fec6c1cbf48a44f9922bd82e714861c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:47.781183 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-08773776-39b8-434d-8236-0456223529a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:47.796982 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1146/2313] 10.222.0.13 () {58 vars in 967 bytes} [Thu Jun 23 19:59:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:59:47.837027 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08773776-39b8-434d-8236-0456223529a0 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:47.837543 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0437631-8d1d-4a65-b9c0-295966add4f2 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:47.838008 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08773776-39b8-434d-8236-0456223529a0 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:47.838362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe8a16-4671-413b-aa8a-906078c430fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:47.838362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe8a16-4671-413b-aa8a-906078c430fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:47.838362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe8a16-4671-413b-aa8a-906078c430fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:47.838362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe8a16-4671-413b-aa8a-906078c430fb admin admin] PATH_INFO: `/v3/users/ad798f450046406cac3b466ab942eb41` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:47.838702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe8a16-4671-413b-aa8a-906078c430fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad798f450046406cac3b466ab942eb41)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:47.838702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe8a16-4671-413b-aa8a-906078c430fb admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:47.839583 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3a5dd-330d-4874-ab9d-0ce8d692186c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc53095a45e4136b37fb6e4e677eff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:47.840382 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a5dd-330d-4874-ab9d-0ce8d692186c service swift] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:47.840765 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a5dd-330d-4874-ab9d-0ce8d692186c service swift] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:47.841138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a5dd-330d-4874-ab9d-0ce8d692186c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:47.851914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3a5dd-330d-4874-ab9d-0ce8d692186c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:47.853965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3a5dd-330d-4874-ab9d-0ce8d692186c service swift] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:47.865496 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1147/2314] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 19:59:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 19:59:47.891632 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:48.212566 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-debe8a16-4671-413b-aa8a-906078c430fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad798f450046406cac3b466ab942eb41'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:48.230970 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-debe8a16-4671-413b-aa8a-906078c430fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad798f450046406cac3b466ab942eb41'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:48.314698 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-debe8a16-4671-413b-aa8a-906078c430fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad798f450046406cac3b466ab942eb41'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:48.316188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-debe8a16-4671-413b-aa8a-906078c430fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad798f450046406cac3b466ab942eb41'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:48.328859 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-debe8a16-4671-413b-aa8a-906078c430fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad798f450046406cac3b466ab942eb41'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:48.336440 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1168/2315] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:59:47 2022] DELETE /identity/v3/users/ad798f450046406cac3b466ab942eb41 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:48.340828 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692f8a7-6ab9-4700-87d3-4d61201386f1 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:48.341122 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692f8a7-6ab9-4700-87d3-4d61201386f1 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:48.341443 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692f8a7-6ab9-4700-87d3-4d61201386f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:48.362074 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-9692f8a7-6ab9-4700-87d3-4d61201386f1 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:48.363368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-9692f8a7-6ab9-4700-87d3-4d61201386f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:48.474840 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1148/2316] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:48.485256 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe8a16-4671-413b-aa8a-906078c430fb admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:48.486879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-debe8a16-4671-413b-aa8a-906078c430fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:48.558441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe8a16-4671-413b-aa8a-906078c430fb admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:48.564375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaff95d-954a-4a55-86de-cdf384e626a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:48.565499 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaff95d-954a-4a55-86de-cdf384e626a2 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:48.566075 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaff95d-954a-4a55-86de-cdf384e626a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:48.567111 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaff95d-954a-4a55-86de-cdf384e626a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:48.583184 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaff95d-954a-4a55-86de-cdf384e626a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:48.585946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaff95d-954a-4a55-86de-cdf384e626a2 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:48.609961 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1169/2317] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:59:48.790250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765e149-8c1a-4117-b004-a5b7f5cd5fc8 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:48.793015 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765e149-8c1a-4117-b004-a5b7f5cd5fc8 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:48.793570 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765e149-8c1a-4117-b004-a5b7f5cd5fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:48.864885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-d765e149-8c1a-4117-b004-a5b7f5cd5fc8 None None] MFA Rules not processed for user `fec6c1cbf48a44f9922bd82e714861c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:48.867520 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d765e149-8c1a-4117-b004-a5b7f5cd5fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:49.015931 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1149/2318] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 19:59:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:49.035410 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaff95d-954a-4a55-86de-cdf384e626a2 service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:49.037604 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ebaff95d-954a-4a55-86de-cdf384e626a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:49.041681 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:49.221398 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaff95d-954a-4a55-86de-cdf384e626a2 service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:49.229813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f842c4-94b2-4ecc-b0d4-174bab9bc4d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc53095a45e4136b37fb6e4e677eff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:49.232235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f842c4-94b2-4ecc-b0d4-174bab9bc4d5 service swift] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:49.232689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f842c4-94b2-4ecc-b0d4-174bab9bc4d5 service swift] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:49.233135 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f842c4-94b2-4ecc-b0d4-174bab9bc4d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:49.246046 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f842c4-94b2-4ecc-b0d4-174bab9bc4d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:49.248237 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f842c4-94b2-4ecc-b0d4-174bab9bc4d5 service swift] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:49.267759 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1170/2319] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 19:59:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 19:59:49.651293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765e149-8c1a-4117-b004-a5b7f5cd5fc8 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:49.652775 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d765e149-8c1a-4117-b004-a5b7f5cd5fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:49.681398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765e149-8c1a-4117-b004-a5b7f5cd5fc8 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:49.693737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d50a7-f2d4-4470-908d-75ec55d3e36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:49.700169 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d50a7-f2d4-4470-908d-75ec55d3e36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:49.701702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d50a7-f2d4-4470-908d-75ec55d3e36f admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:49.701702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d50a7-f2d4-4470-908d-75ec55d3e36f admin admin] PATH_INFO: `/v3/projects/f64d555a0eac48e88cd74f5f1f17005b` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:49.702819 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d50a7-f2d4-4470-908d-75ec55d3e36f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f64d555a0eac48e88cd74f5f1f17005b)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:49.704999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d50a7-f2d4-4470-908d-75ec55d3e36f admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:49.807694 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d45d50a7-f2d4-4470-908d-75ec55d3e36f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f64d555a0eac48e88cd74f5f1f17005b', 'request_id': 'req-d45d50a7-f2d4-4470-908d-75ec55d3e36f'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:49.816232 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d45d50a7-f2d4-4470-908d-75ec55d3e36f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f64d555a0eac48e88cd74f5f1f17005b', 'request_id': 'req-d45d50a7-f2d4-4470-908d-75ec55d3e36f'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:49.823436 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d45d50a7-f2d4-4470-908d-75ec55d3e36f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f64d555a0eac48e88cd74f5f1f17005b', 'request_id': 'req-d45d50a7-f2d4-4470-908d-75ec55d3e36f'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:49.877527 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d45d50a7-f2d4-4470-908d-75ec55d3e36f admin admin] The token cache is being invalidate because project f64d555a0eac48e88cd74f5f1f17005b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:59:49.877973 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d45d50a7-f2d4-4470-908d-75ec55d3e36f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:49.879261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d45d50a7-f2d4-4470-908d-75ec55d3e36f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:49.884751 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1150/2320] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:59:49 2022] DELETE /identity/v3/projects/f64d555a0eac48e88cd74f5f1f17005b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:50.046818 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:50.306277 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebeae6-d1f9-4152-bfde-a78a98f96128 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:50.318141 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebeae6-d1f9-4152-bfde-a78a98f96128 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:50.318141 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebeae6-d1f9-4152-bfde-a78a98f96128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:50.338192 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-14ebeae6-d1f9-4152-bfde-a78a98f96128 None None] MFA Rules not processed for user `fec6c1cbf48a44f9922bd82e714861c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:50.342235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-14ebeae6-d1f9-4152-bfde-a78a98f96128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:50.417034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1171/2321] 10.222.0.13 () {58 vars in 967 bytes} [Thu Jun 23 19:59:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:50.435523 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d50a7-f2d4-4470-908d-75ec55d3e36f admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:50.438951 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d45d50a7-f2d4-4470-908d-75ec55d3e36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:50.466676 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:50.606525 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d50a7-f2d4-4470-908d-75ec55d3e36f admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:50.625125 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81436106-fe5a-427f-903b-6b81774d82ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc53095a45e4136b37fb6e4e677eff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:50.625824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81436106-fe5a-427f-903b-6b81774d82ae service swift] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:50.626111 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81436106-fe5a-427f-903b-6b81774d82ae service swift] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:50.626390 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81436106-fe5a-427f-903b-6b81774d82ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:50.641431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81436106-fe5a-427f-903b-6b81774d82ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:50.641431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81436106-fe5a-427f-903b-6b81774d82ae service swift] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:50.661198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1151/2322] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 19:59:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 19:59:50.943019 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:51.765685 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:52.463529 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebeae6-d1f9-4152-bfde-a78a98f96128 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:52.466632 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-14ebeae6-d1f9-4152-bfde-a78a98f96128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:52.538994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebeae6-d1f9-4152-bfde-a78a98f96128 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:52.544041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ff221-830e-42ab-b122-e38f8047ed28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:52.545801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ff221-830e-42ab-b122-e38f8047ed28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:52.545801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ff221-830e-42ab-b122-e38f8047ed28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:52.545801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ff221-830e-42ab-b122-e38f8047ed28 admin admin] PATH_INFO: `/v3/users/277cd0e880dc4ed39cbc46422ed5e22a` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:52.546896 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ff221-830e-42ab-b122-e38f8047ed28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=277cd0e880dc4ed39cbc46422ed5e22a)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:52.548860 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ff221-830e-42ab-b122-e38f8047ed28 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:52.646116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:52.877543 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ef0ff221-830e-42ab-b122-e38f8047ed28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '277cd0e880dc4ed39cbc46422ed5e22a'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:52.893566 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ef0ff221-830e-42ab-b122-e38f8047ed28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '277cd0e880dc4ed39cbc46422ed5e22a'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:53.022403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ef0ff221-830e-42ab-b122-e38f8047ed28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '277cd0e880dc4ed39cbc46422ed5e22a'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:53.023157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ef0ff221-830e-42ab-b122-e38f8047ed28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '277cd0e880dc4ed39cbc46422ed5e22a'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:53.031054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ef0ff221-830e-42ab-b122-e38f8047ed28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '277cd0e880dc4ed39cbc46422ed5e22a'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:53.037965 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1172/2323] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:59:52 2022] DELETE /identity/v3/users/277cd0e880dc4ed39cbc46422ed5e22a => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:53.042624 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72657a-81ba-41cc-ac18-750abac0fca1 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:53.043156 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72657a-81ba-41cc-ac18-750abac0fca1 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:53.043238 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72657a-81ba-41cc-ac18-750abac0fca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:53.077098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-0d72657a-81ba-41cc-ac18-750abac0fca1 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:53.078669 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-0d72657a-81ba-41cc-ac18-750abac0fca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:53.158654 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1152/2324] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:53.168762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ff221-830e-42ab-b122-e38f8047ed28 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:53.170466 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ef0ff221-830e-42ab-b122-e38f8047ed28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:53.240385 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ff221-830e-42ab-b122-e38f8047ed28 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:53.245996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058be586-047a-4382-81d9-e56bd47674cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:53.246734 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058be586-047a-4382-81d9-e56bd47674cb service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:53.247093 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058be586-047a-4382-81d9-e56bd47674cb service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:53.247434 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058be586-047a-4382-81d9-e56bd47674cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:53.259209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058be586-047a-4382-81d9-e56bd47674cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:53.260755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058be586-047a-4382-81d9-e56bd47674cb service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:53.272800 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1173/2325] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:59:53.613917 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f69d5-4f69-4ccb-a6e5-18c022ec647b None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:53.614289 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f69d5-4f69-4ccb-a6e5-18c022ec647b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:53.614719 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f69d5-4f69-4ccb-a6e5-18c022ec647b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:53.634615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-911f69d5-4f69-4ccb-a6e5-18c022ec647b None None] MFA Rules not processed for user `fec6c1cbf48a44f9922bd82e714861c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:53.636124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-911f69d5-4f69-4ccb-a6e5-18c022ec647b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:53.709306 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1153/2326] 10.222.0.13 () {58 vars in 967 bytes} [Thu Jun 23 19:59:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:53.727903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058be586-047a-4382-81d9-e56bd47674cb service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:53.727903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-058be586-047a-4382-81d9-e56bd47674cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:53.762077 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f69d5-4f69-4ccb-a6e5-18c022ec647b None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:53.762077 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-911f69d5-4f69-4ccb-a6e5-18c022ec647b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:53.784840 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f69d5-4f69-4ccb-a6e5-18c022ec647b None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:53.798401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9216418-b9fb-44cc-9fe9-27a468a18057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:53.798401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9216418-b9fb-44cc-9fe9-27a468a18057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:53.798401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9216418-b9fb-44cc-9fe9-27a468a18057 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:53.799355 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9216418-b9fb-44cc-9fe9-27a468a18057 admin admin] PATH_INFO: `/v3/projects/4fb24cdebec343b2a9b0684ae67a40c8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:53.801309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9216418-b9fb-44cc-9fe9-27a468a18057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fb24cdebec343b2a9b0684ae67a40c8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:53.804035 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9216418-b9fb-44cc-9fe9-27a468a18057 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:53.810909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058be586-047a-4382-81d9-e56bd47674cb service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:53.818940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1a8ea-ef99-470d-8c5a-c2a9500b6f54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc53095a45e4136b37fb6e4e677eff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:53.819698 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1a8ea-ef99-470d-8c5a-c2a9500b6f54 service swift] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:53.820054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1a8ea-ef99-470d-8c5a-c2a9500b6f54 service swift] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:53.820403 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1a8ea-ef99-470d-8c5a-c2a9500b6f54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:53.829744 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1a8ea-ef99-470d-8c5a-c2a9500b6f54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:53.832719 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1a8ea-ef99-470d-8c5a-c2a9500b6f54 service swift] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:53.841728 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1174/2327] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 19:59:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 19:59:53.971770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b9216418-b9fb-44cc-9fe9-27a468a18057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fb24cdebec343b2a9b0684ae67a40c8', 'request_id': 'req-b9216418-b9fb-44cc-9fe9-27a468a18057'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:53.979142 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b9216418-b9fb-44cc-9fe9-27a468a18057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fb24cdebec343b2a9b0684ae67a40c8', 'request_id': 'req-b9216418-b9fb-44cc-9fe9-27a468a18057'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:53.986938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b9216418-b9fb-44cc-9fe9-27a468a18057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fb24cdebec343b2a9b0684ae67a40c8', 'request_id': 'req-b9216418-b9fb-44cc-9fe9-27a468a18057'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:54.055852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b9216418-b9fb-44cc-9fe9-27a468a18057 admin admin] The token cache is being invalidate because project 4fb24cdebec343b2a9b0684ae67a40c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:59:54.056517 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b9216418-b9fb-44cc-9fe9-27a468a18057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:54.056856 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b9216418-b9fb-44cc-9fe9-27a468a18057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:54.058451 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1154/2328] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:59:53 2022] DELETE /identity/v3/projects/4fb24cdebec343b2a9b0684ae67a40c8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:59:54.062389 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1a8ea-ef99-470d-8c5a-c2a9500b6f54 service swift] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:54.072640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1a8ea-ef99-470d-8c5a-c2a9500b6f54 service swift] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:54.113517 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:54.132255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61b38d-a2f2-4d4f-8e17-e910dbf16e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:54.133034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61b38d-a2f2-4d4f-8e17-e910dbf16e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:54.133358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61b38d-a2f2-4d4f-8e17-e910dbf16e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:54.134127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61b38d-a2f2-4d4f-8e17-e910dbf16e40 admin admin] PATH_INFO: `/v3/users/028ce5c11ff04f95a85bfdfba10591fc` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:54.139540 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61b38d-a2f2-4d4f-8e17-e910dbf16e40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=028ce5c11ff04f95a85bfdfba10591fc)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:54.139540 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61b38d-a2f2-4d4f-8e17-e910dbf16e40 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:54.235967 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9216418-b9fb-44cc-9fe9-27a468a18057 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:54.236901 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-b9216418-b9fb-44cc-9fe9-27a468a18057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:54.251631 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9216418-b9fb-44cc-9fe9-27a468a18057 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:54.256780 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6293d-33e7-4ef9-bade-9895a65e33b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:54.257709 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6293d-33e7-4ef9-bade-9895a65e33b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:54.258044 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6293d-33e7-4ef9-bade-9895a65e33b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:54.258383 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6293d-33e7-4ef9-bade-9895a65e33b8 admin admin] PATH_INFO: `/v3/users/26aaee3ba3ae48069ae62122eb8647cd` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:54.259746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6293d-33e7-4ef9-bade-9895a65e33b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26aaee3ba3ae48069ae62122eb8647cd)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:54.261869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6293d-33e7-4ef9-bade-9895a65e33b8 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:54.380061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-dd61b38d-a2f2-4d4f-8e17-e910dbf16e40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '028ce5c11ff04f95a85bfdfba10591fc'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:54.395744 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-dd61b38d-a2f2-4d4f-8e17-e910dbf16e40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '028ce5c11ff04f95a85bfdfba10591fc'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:54.512377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-dd61b38d-a2f2-4d4f-8e17-e910dbf16e40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '028ce5c11ff04f95a85bfdfba10591fc'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:54.514188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:54.515324 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-dd61b38d-a2f2-4d4f-8e17-e910dbf16e40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '028ce5c11ff04f95a85bfdfba10591fc'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:54.523498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-dd61b38d-a2f2-4d4f-8e17-e910dbf16e40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '028ce5c11ff04f95a85bfdfba10591fc'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:54.526822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-a0f6293d-33e7-4ef9-bade-9895a65e33b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26aaee3ba3ae48069ae62122eb8647cd'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:54.529629 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1175/2329] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:59:54 2022] DELETE /identity/v3/users/028ce5c11ff04f95a85bfdfba10591fc => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:59:54.539969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-a0f6293d-33e7-4ef9-bade-9895a65e33b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26aaee3ba3ae48069ae62122eb8647cd'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:54.667579 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-a0f6293d-33e7-4ef9-bade-9895a65e33b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26aaee3ba3ae48069ae62122eb8647cd'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:54.668336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-a0f6293d-33e7-4ef9-bade-9895a65e33b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26aaee3ba3ae48069ae62122eb8647cd'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:54.678367 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-a0f6293d-33e7-4ef9-bade-9895a65e33b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26aaee3ba3ae48069ae62122eb8647cd'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:54.684550 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1155/2330] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:59:54 2022] DELETE /identity/v3/users/26aaee3ba3ae48069ae62122eb8647cd => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:59:54.689188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf80bf5-58a2-4509-a469-663336df3151 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:54.689504 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf80bf5-58a2-4509-a469-663336df3151 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:54.689792 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf80bf5-58a2-4509-a469-663336df3151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:54.712436 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-baf80bf5-58a2-4509-a469-663336df3151 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:54.713694 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-baf80bf5-58a2-4509-a469-663336df3151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:54.781406 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1176/2331] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:54.791254 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6293d-33e7-4ef9-bade-9895a65e33b8 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:54.792902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-a0f6293d-33e7-4ef9-bade-9895a65e33b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:54.875014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6293d-33e7-4ef9-bade-9895a65e33b8 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:54.881619 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25793c-8d76-43b2-af55-b378d9fc8839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:54.882566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25793c-8d76-43b2-af55-b378d9fc8839 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:54.882878 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25793c-8d76-43b2-af55-b378d9fc8839 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:54.883411 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25793c-8d76-43b2-af55-b378d9fc8839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:54.893106 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25793c-8d76-43b2-af55-b378d9fc8839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:54.894623 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25793c-8d76-43b2-af55-b378d9fc8839 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:54.908180 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1156/2332] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:59:55.006866 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf80bf5-58a2-4509-a469-663336df3151 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:55.008621 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-baf80bf5-58a2-4509-a469-663336df3151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:55.024416 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf80bf5-58a2-4509-a469-663336df3151 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:55.048024 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a382a0-6f23-4a86-a803-2c8cae7be5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:55.049331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a382a0-6f23-4a86-a803-2c8cae7be5ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:55.049796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a382a0-6f23-4a86-a803-2c8cae7be5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:55.050079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a382a0-6f23-4a86-a803-2c8cae7be5ae admin admin] PATH_INFO: `/v3/projects/493f6664d8e64e97b688dbecca5d7cfb` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:55.054422 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a382a0-6f23-4a86-a803-2c8cae7be5ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=493f6664d8e64e97b688dbecca5d7cfb)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:55.065659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a382a0-6f23-4a86-a803-2c8cae7be5ae admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:55.216740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-57a382a0-6f23-4a86-a803-2c8cae7be5ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '493f6664d8e64e97b688dbecca5d7cfb', 'request_id': 'req-57a382a0-6f23-4a86-a803-2c8cae7be5ae'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:55.224629 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-57a382a0-6f23-4a86-a803-2c8cae7be5ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '493f6664d8e64e97b688dbecca5d7cfb', 'request_id': 'req-57a382a0-6f23-4a86-a803-2c8cae7be5ae'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:55.230888 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-57a382a0-6f23-4a86-a803-2c8cae7be5ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '493f6664d8e64e97b688dbecca5d7cfb', 'request_id': 'req-57a382a0-6f23-4a86-a803-2c8cae7be5ae'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:55.298263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25793c-8d76-43b2-af55-b378d9fc8839 service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:55.300236 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-0e25793c-8d76-43b2-af55-b378d9fc8839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:55.325101 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25793c-8d76-43b2-af55-b378d9fc8839 service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:55.339425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-57a382a0-6f23-4a86-a803-2c8cae7be5ae admin admin] The token cache is being invalidate because project 493f6664d8e64e97b688dbecca5d7cfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:59:55.339425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-57a382a0-6f23-4a86-a803-2c8cae7be5ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:55.339959 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-57a382a0-6f23-4a86-a803-2c8cae7be5ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:55.345411 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1177/2333] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:59:55 2022] DELETE /identity/v3/projects/493f6664d8e64e97b688dbecca5d7cfb => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:55.355202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a382a0-6f23-4a86-a803-2c8cae7be5ae admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:55.355202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-57a382a0-6f23-4a86-a803-2c8cae7be5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:55.430215 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3d336-a29e-4034-9a09-b5fb665521f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:55.431286 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3d336-a29e-4034-9a09-b5fb665521f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:55.431413 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3d336-a29e-4034-9a09-b5fb665521f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:55.431801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3d336-a29e-4034-9a09-b5fb665521f5 admin admin] PATH_INFO: `/v3/projects/451606bb2d8941bc83e452aa9e60e4d2` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:55.433213 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3d336-a29e-4034-9a09-b5fb665521f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=451606bb2d8941bc83e452aa9e60e4d2)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:55.435178 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3d336-a29e-4034-9a09-b5fb665521f5 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:55.464901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a382a0-6f23-4a86-a803-2c8cae7be5ae admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:55.470150 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90488111-be16-47db-a92f-1ffd0bd9d240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:55.471080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90488111-be16-47db-a92f-1ffd0bd9d240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:55.471322 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90488111-be16-47db-a92f-1ffd0bd9d240 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:55.471753 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90488111-be16-47db-a92f-1ffd0bd9d240 admin admin] PATH_INFO: `/v3/users/52458263897f4c058286fc32dcddcfbb` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:55.474297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90488111-be16-47db-a92f-1ffd0bd9d240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52458263897f4c058286fc32dcddcfbb)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:55.476272 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90488111-be16-47db-a92f-1ffd0bd9d240 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:55.738700 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-04d3d336-a29e-4034-9a09-b5fb665521f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451606bb2d8941bc83e452aa9e60e4d2', 'request_id': 'req-04d3d336-a29e-4034-9a09-b5fb665521f5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:55.739595 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-90488111-be16-47db-a92f-1ffd0bd9d240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52458263897f4c058286fc32dcddcfbb'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:55.745701 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-04d3d336-a29e-4034-9a09-b5fb665521f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451606bb2d8941bc83e452aa9e60e4d2', 'request_id': 'req-04d3d336-a29e-4034-9a09-b5fb665521f5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:55.753314 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-04d3d336-a29e-4034-9a09-b5fb665521f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451606bb2d8941bc83e452aa9e60e4d2', 'request_id': 'req-04d3d336-a29e-4034-9a09-b5fb665521f5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:55.758768 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-90488111-be16-47db-a92f-1ffd0bd9d240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52458263897f4c058286fc32dcddcfbb'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:55.827786 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-04d3d336-a29e-4034-9a09-b5fb665521f5 admin admin] The token cache is being invalidate because project 451606bb2d8941bc83e452aa9e60e4d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:59:55.828245 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-04d3d336-a29e-4034-9a09-b5fb665521f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:55.833730 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-04d3d336-a29e-4034-9a09-b5fb665521f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:55.835595 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1157/2334] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:59:55 2022] DELETE /identity/v3/projects/451606bb2d8941bc83e452aa9e60e4d2 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:59:55.870482 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:55.897381 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-90488111-be16-47db-a92f-1ffd0bd9d240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52458263897f4c058286fc32dcddcfbb'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:55.900178 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-90488111-be16-47db-a92f-1ffd0bd9d240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52458263897f4c058286fc32dcddcfbb'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:55.908210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:55.920841 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-90488111-be16-47db-a92f-1ffd0bd9d240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52458263897f4c058286fc32dcddcfbb'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:55.931647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1178/2335] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:59:55 2022] DELETE /identity/v3/users/52458263897f4c058286fc32dcddcfbb => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:59:56.242945 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377b449-a863-4f05-887e-7584483cf879 None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:56.243380 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377b449-a863-4f05-887e-7584483cf879 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:56.243760 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377b449-a863-4f05-887e-7584483cf879 None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:56.245306 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1158/2336] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 19:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:59:56.251875 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca3853-444d-42b3-abf8-363169963071 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:56.252172 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca3853-444d-42b3-abf8-363169963071 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:56.252460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca3853-444d-42b3-abf8-363169963071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:56.319489 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-d3ca3853-444d-42b3-abf8-363169963071 None None] MFA Rules not processed for user `83bff5cd7782423eaa0bc5b29b208ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:56.320733 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d3ca3853-444d-42b3-abf8-363169963071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:56.403730 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1179/2337] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 19:59:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:56.416405 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377b449-a863-4f05-887e-7584483cf879 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:56.417981 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca3853-444d-42b3-abf8-363169963071 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:56.418803 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d377b449-a863-4f05-887e-7584483cf879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:56.419358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d3ca3853-444d-42b3-abf8-363169963071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:56.488583 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377b449-a863-4f05-887e-7584483cf879 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:56.491547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca3853-444d-42b3-abf8-363169963071 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:56.492429 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f56e26-cadc-4d52-9d9b-23a5141aa149 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f078219032be4b619119d1d9d59c499d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:56.493093 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f56e26-cadc-4d52-9d9b-23a5141aa149 service glance] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:56.493442 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f56e26-cadc-4d52-9d9b-23a5141aa149 service glance] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:56.493678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f56e26-cadc-4d52-9d9b-23a5141aa149 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:56.497843 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d553593-c583-4f77-a805-7175c87455f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:56.498700 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d553593-c583-4f77-a805-7175c87455f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:56.498986 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d553593-c583-4f77-a805-7175c87455f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:56.499375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d553593-c583-4f77-a805-7175c87455f1 admin admin] PATH_INFO: `/v3/projects/65685783315542c797f2b33b582bf493` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:56.500502 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d553593-c583-4f77-a805-7175c87455f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65685783315542c797f2b33b582bf493)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:56.502450 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d553593-c583-4f77-a805-7175c87455f1 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:56.506248 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f56e26-cadc-4d52-9d9b-23a5141aa149 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:56.507737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f56e26-cadc-4d52-9d9b-23a5141aa149 service glance] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:56.520708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1159/2338] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:59:56.617491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9d553593-c583-4f77-a805-7175c87455f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65685783315542c797f2b33b582bf493', 'request_id': 'req-9d553593-c583-4f77-a805-7175c87455f1'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:56.623589 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9d553593-c583-4f77-a805-7175c87455f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65685783315542c797f2b33b582bf493', 'request_id': 'req-9d553593-c583-4f77-a805-7175c87455f1'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:56.629211 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9d553593-c583-4f77-a805-7175c87455f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65685783315542c797f2b33b582bf493', 'request_id': 'req-9d553593-c583-4f77-a805-7175c87455f1'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:56.764204 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9d553593-c583-4f77-a805-7175c87455f1 admin admin] The token cache is being invalidate because project 65685783315542c797f2b33b582bf493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:59:56.764724 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9d553593-c583-4f77-a805-7175c87455f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:56.765909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9d553593-c583-4f77-a805-7175c87455f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:56.767623 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1180/2339] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:59:56 2022] DELETE /identity/v3/projects/65685783315542c797f2b33b582bf493 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:56.790409 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c2165-ef13-49ed-819a-3d1d4dc6e97c None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:56.790904 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c2165-ef13-49ed-819a-3d1d4dc6e97c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:56.791011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c2165-ef13-49ed-819a-3d1d4dc6e97c None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:56.792397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1160/2340] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 19:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:59:56.798204 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a6ea9-46f6-4fe4-9e24-736569d560e1 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:56.798520 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a6ea9-46f6-4fe4-9e24-736569d560e1 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:56.799005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a6ea9-46f6-4fe4-9e24-736569d560e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:56.823013 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-180a6ea9-46f6-4fe4-9e24-736569d560e1 None None] MFA Rules not processed for user `24bb6f31e87045f5b17f561b42edca6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:56.824298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-180a6ea9-46f6-4fe4-9e24-736569d560e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:56.913576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1181/2341] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 19:59:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:56.920404 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c2165-ef13-49ed-819a-3d1d4dc6e97c None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:56.922243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f76c2165-ef13-49ed-819a-3d1d4dc6e97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:56.937398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c2165-ef13-49ed-819a-3d1d4dc6e97c None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:56.941221 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86552a69-d6f0-4fce-a269-dca4f8049134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:56.942802 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86552a69-d6f0-4fce-a269-dca4f8049134 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:56.943262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86552a69-d6f0-4fce-a269-dca4f8049134 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:56.943698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86552a69-d6f0-4fce-a269-dca4f8049134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:56.951853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86552a69-d6f0-4fce-a269-dca4f8049134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:56.953377 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86552a69-d6f0-4fce-a269-dca4f8049134 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:56.971609 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1161/2342] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:59:57.044656 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:57.058155 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596c702-789c-470b-910a-0b9ec700c79b None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:57.058449 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596c702-789c-470b-910a-0b9ec700c79b None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:57.058752 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596c702-789c-470b-910a-0b9ec700c79b None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:57.060179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1182/2343] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 19:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 19:59:57.066171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71bf74-43be-4d74-9070-f1acfcdfaf33 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:57.066445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71bf74-43be-4d74-9070-f1acfcdfaf33 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:57.066719 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71bf74-43be-4d74-9070-f1acfcdfaf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:57.086490 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-df71bf74-43be-4d74-9070-f1acfcdfaf33 None None] MFA Rules not processed for user `83bff5cd7782423eaa0bc5b29b208ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:57.087745 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-df71bf74-43be-4d74-9070-f1acfcdfaf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:57.165869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1162/2344] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 19:59:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:57.176477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596c702-789c-470b-910a-0b9ec700c79b None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:57.193607 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596c702-789c-470b-910a-0b9ec700c79b None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:57.197972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be1fc0-4612-42b5-b145-f8a035b765bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:57.198643 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be1fc0-4612-42b5-b145-f8a035b765bb service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:57.198929 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be1fc0-4612-42b5-b145-f8a035b765bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:57.199209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be1fc0-4612-42b5-b145-f8a035b765bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:57.211095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be1fc0-4612-42b5-b145-f8a035b765bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:57.212739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be1fc0-4612-42b5-b145-f8a035b765bb service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:57.226133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1183/2345] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:59:57.272110 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71bf74-43be-4d74-9070-f1acfcdfaf33 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:57.275319 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-df71bf74-43be-4d74-9070-f1acfcdfaf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:57.348024 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=81,keystone:INSERT=4,keystone:DELETE=15 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:57.357045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71bf74-43be-4d74-9070-f1acfcdfaf33 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:57.362212 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4d38f-0be8-4b2c-969f-37be2e31292b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:57.363276 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4d38f-0be8-4b2c-969f-37be2e31292b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:57.363636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4d38f-0be8-4b2c-969f-37be2e31292b admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:57.363919 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4d38f-0be8-4b2c-969f-37be2e31292b admin admin] PATH_INFO: `/v3/users/e8dba2c48a2145ab894681ec0720996e` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:57.365181 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4d38f-0be8-4b2c-969f-37be2e31292b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8dba2c48a2145ab894681ec0720996e)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:57.367192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4d38f-0be8-4b2c-969f-37be2e31292b admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:57.614745 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d6a4d38f-0be8-4b2c-969f-37be2e31292b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8dba2c48a2145ab894681ec0720996e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:57.627742 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d6a4d38f-0be8-4b2c-969f-37be2e31292b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8dba2c48a2145ab894681ec0720996e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:57.713203 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d6a4d38f-0be8-4b2c-969f-37be2e31292b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8dba2c48a2145ab894681ec0720996e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:57.713835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d6a4d38f-0be8-4b2c-969f-37be2e31292b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8dba2c48a2145ab894681ec0720996e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:57.723416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d6a4d38f-0be8-4b2c-969f-37be2e31292b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8dba2c48a2145ab894681ec0720996e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:57.729653 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1163/2346] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:59:57 2022] DELETE /identity/v3/users/e8dba2c48a2145ab894681ec0720996e => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:59:58.012927 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be1fc0-4612-42b5-b145-f8a035b765bb service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:58.027226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be1fc0-4612-42b5-b145-f8a035b765bb service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:58.086753 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4a5a9-1000-4d89-bc25-1052229ffaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:58.087679 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4a5a9-1000-4d89-bc25-1052229ffaef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:58.087970 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4a5a9-1000-4d89-bc25-1052229ffaef admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:58.088256 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4a5a9-1000-4d89-bc25-1052229ffaef admin admin] PATH_INFO: `/v3/projects/b1ced5fb2f504aee9dd0f9280a97531f` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:58.089559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4a5a9-1000-4d89-bc25-1052229ffaef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ced5fb2f504aee9dd0f9280a97531f)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:58.091517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4a5a9-1000-4d89-bc25-1052229ffaef admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:58.210541 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:58.221548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-aaf4a5a9-1000-4d89-bc25-1052229ffaef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ced5fb2f504aee9dd0f9280a97531f', 'request_id': 'req-aaf4a5a9-1000-4d89-bc25-1052229ffaef'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:58.229324 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-aaf4a5a9-1000-4d89-bc25-1052229ffaef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ced5fb2f504aee9dd0f9280a97531f', 'request_id': 'req-aaf4a5a9-1000-4d89-bc25-1052229ffaef'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:58.235162 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-aaf4a5a9-1000-4d89-bc25-1052229ffaef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ced5fb2f504aee9dd0f9280a97531f', 'request_id': 'req-aaf4a5a9-1000-4d89-bc25-1052229ffaef'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:58.307945 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-aaf4a5a9-1000-4d89-bc25-1052229ffaef admin admin] The token cache is being invalidate because project b1ced5fb2f504aee9dd0f9280a97531f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 19:59:58.308143 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-aaf4a5a9-1000-4d89-bc25-1052229ffaef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:58.308768 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-aaf4a5a9-1000-4d89-bc25-1052229ffaef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:58.310342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1184/2347] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 19:59:58 2022] DELETE /identity/v3/projects/b1ced5fb2f504aee9dd0f9280a97531f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:58.315401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8326919-0e8b-4fea-8e4a-2685d4dd0bab None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:58.315719 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8326919-0e8b-4fea-8e4a-2685d4dd0bab None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:58.316235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8326919-0e8b-4fea-8e4a-2685d4dd0bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:58.335009 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-b8326919-0e8b-4fea-8e4a-2685d4dd0bab None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:58.336292 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-b8326919-0e8b-4fea-8e4a-2685d4dd0bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:58.401197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1164/2348] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:58.407067 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192b23f-721a-4b22-9eb0-fdc4a8c278f1 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:58.407361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192b23f-721a-4b22-9eb0-fdc4a8c278f1 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:58.407645 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192b23f-721a-4b22-9eb0-fdc4a8c278f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:58.428252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-2192b23f-721a-4b22-9eb0-fdc4a8c278f1 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:58.429731 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-2192b23f-721a-4b22-9eb0-fdc4a8c278f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:58.438759 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1185/2349] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:58.443447 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8326919-0e8b-4fea-8e4a-2685d4dd0bab None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:58.453922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8326919-0e8b-4fea-8e4a-2685d4dd0bab None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:58.459241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02263d3-dbcb-48d9-b027-6bcc2c3d1f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:58.460055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02263d3-dbcb-48d9-b027-6bcc2c3d1f38 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:58.460243 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02263d3-dbcb-48d9-b027-6bcc2c3d1f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:58.460528 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02263d3-dbcb-48d9-b027-6bcc2c3d1f38 admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:58.461307 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02263d3-dbcb-48d9-b027-6bcc2c3d1f38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 19:59:58.473413 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02263d3-dbcb-48d9-b027-6bcc2c3d1f38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:58.473413 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02263d3-dbcb-48d9-b027-6bcc2c3d1f38 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:58.480035 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1165/2350] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 19:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 19:59:58.481258 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192b23f-721a-4b22-9eb0-fdc4a8c278f1 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:58.490634 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192b23f-721a-4b22-9eb0-fdc4a8c278f1 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:58.495619 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb633cd-0c8a-4207-955f-b406fbfcde5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:58.496296 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb633cd-0c8a-4207-955f-b406fbfcde5a admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:58.496586 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb633cd-0c8a-4207-955f-b406fbfcde5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:58.496869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb633cd-0c8a-4207-955f-b406fbfcde5a admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:58.497599 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb633cd-0c8a-4207-955f-b406fbfcde5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:58.499508 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb633cd-0c8a-4207-955f-b406fbfcde5a admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:58.611528 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1186/2351] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 19:59:58 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:59:58.615730 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02263d3-dbcb-48d9-b027-6bcc2c3d1f38 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:58.626325 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02263d3-dbcb-48d9-b027-6bcc2c3d1f38 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:58.696102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174d436-23a8-454e-8771-8eda5f82deba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:58.696983 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174d436-23a8-454e-8771-8eda5f82deba admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:58.697397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174d436-23a8-454e-8771-8eda5f82deba admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:58.697741 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174d436-23a8-454e-8771-8eda5f82deba admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:58.698513 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174d436-23a8-454e-8771-8eda5f82deba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:58.700618 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174d436-23a8-454e-8771-8eda5f82deba admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:58.719177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:58.863679 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1166/2352] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 19:59:58 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 19:59:58.868031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb633cd-0c8a-4207-955f-b406fbfcde5a admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:58.882558 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb633cd-0c8a-4207-955f-b406fbfcde5a admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:58.887376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a3e58-2be5-4c5c-80d4-0d4c78642354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:58.888044 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a3e58-2be5-4c5c-80d4-0d4c78642354 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:58.888361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a3e58-2be5-4c5c-80d4-0d4c78642354 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:58.888593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a3e58-2be5-4c5c-80d4-0d4c78642354 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:58.889425 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a3e58-2be5-4c5c-80d4-0d4c78642354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:58.891106 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a3e58-2be5-4c5c-80d4-0d4c78642354 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:58.903080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1187/2353] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:59:58.907599 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174d436-23a8-454e-8771-8eda5f82deba admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:58.917690 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174d436-23a8-454e-8771-8eda5f82deba admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:58.922175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb366e5b-1c0f-4f37-9fce-c1a55ecfb757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:58.922828 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb366e5b-1c0f-4f37-9fce-c1a55ecfb757 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:58.923120 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb366e5b-1c0f-4f37-9fce-c1a55ecfb757 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:58.923400 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb366e5b-1c0f-4f37-9fce-c1a55ecfb757 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:58.924120 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb366e5b-1c0f-4f37-9fce-c1a55ecfb757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:58.925970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb366e5b-1c0f-4f37-9fce-c1a55ecfb757 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:58.935758 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1167/2354] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 19:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 19:59:58.940171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a3e58-2be5-4c5c-80d4-0d4c78642354 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:58.950767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a3e58-2be5-4c5c-80d4-0d4c78642354 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:58.955173 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5dde5-b737-409b-9224-02e3bca3e2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:58.956033 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5dde5-b737-409b-9224-02e3bca3e2ac admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:58.956316 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5dde5-b737-409b-9224-02e3bca3e2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:58.956591 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5dde5-b737-409b-9224-02e3bca3e2ac admin admin] PATH_INFO: `/v3/projects/58bc93c7919647b6ad7a23ebe970916b/users/6e8ce8396ee741849fba64960c50bd1d/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:58.972933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5dde5-b737-409b-9224-02e3bca3e2ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=58bc93c7919647b6ad7a23ebe970916b, user_id=6e8ce8396ee741849fba64960c50bd1d, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:58.975669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5dde5-b737-409b-9224-02e3bca3e2ac admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:59.078915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1188/2355] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 19:59:58 2022] PUT /identity/v3/projects/58bc93c7919647b6ad7a23ebe970916b/users/6e8ce8396ee741849fba64960c50bd1d/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 19:59:59.089536 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20639a-c519-450b-a7b5-fd7989a69cdd None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:59.089835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20639a-c519-450b-a7b5-fd7989a69cdd None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:59.090119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20639a-c519-450b-a7b5-fd7989a69cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:59.119796 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-5f20639a-c519-450b-a7b5-fd7989a69cdd None None] MFA Rules not processed for user `6e8ce8396ee741849fba64960c50bd1d`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:59.121016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-5f20639a-c519-450b-a7b5-fd7989a69cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:59.194438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1168/2356] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 19:59:59.202713 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5dde5-b737-409b-9224-02e3bca3e2ac admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:59.204422 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7de5dde5-b737-409b-9224-02e3bca3e2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:59.266990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5dde5-b737-409b-9224-02e3bca3e2ac admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:59.272710 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9d357-8d8b-440a-8860-113db9555afc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:59.273494 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9d357-8d8b-440a-8860-113db9555afc service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:59.273967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9d357-8d8b-440a-8860-113db9555afc service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:59.274258 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9d357-8d8b-440a-8860-113db9555afc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:59.284556 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9d357-8d8b-440a-8860-113db9555afc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:59.286096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9d357-8d8b-440a-8860-113db9555afc service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:59.295852 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1189/2357] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 19:59:59.320905 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20639a-c519-450b-a7b5-fd7989a69cdd None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:59.386484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20639a-c519-450b-a7b5-fd7989a69cdd None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:59.391094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ca88b-692c-4a7f-923e-ec8fff36e9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:59.391970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ca88b-692c-4a7f-923e-ec8fff36e9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:59.392252 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ca88b-692c-4a7f-923e-ec8fff36e9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:59.392528 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ca88b-692c-4a7f-923e-ec8fff36e9a3 admin admin] PATH_INFO: `/v3/users/6e8ce8396ee741849fba64960c50bd1d` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:59.393773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ca88b-692c-4a7f-923e-ec8fff36e9a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e8ce8396ee741849fba64960c50bd1d)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:59.396247 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ca88b-692c-4a7f-923e-ec8fff36e9a3 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:59.529338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:59.567066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-244ca88b-692c-4a7f-923e-ec8fff36e9a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e8ce8396ee741849fba64960c50bd1d'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:59.581040 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-244ca88b-692c-4a7f-923e-ec8fff36e9a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e8ce8396ee741849fba64960c50bd1d'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:59.649444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-244ca88b-692c-4a7f-923e-ec8fff36e9a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e8ce8396ee741849fba64960c50bd1d'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:59.650095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-244ca88b-692c-4a7f-923e-ec8fff36e9a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e8ce8396ee741849fba64960c50bd1d'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:59.657802 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-244ca88b-692c-4a7f-923e-ec8fff36e9a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e8ce8396ee741849fba64960c50bd1d'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 19:59:59.663970 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1169/2358] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 19:59:59 2022] DELETE /identity/v3/users/6e8ce8396ee741849fba64960c50bd1d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 19:59:59.668695 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1acd6-3c7d-4788-b14d-9e9a5b98bddb None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:59.669105 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1acd6-3c7d-4788-b14d-9e9a5b98bddb None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:59.669415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1acd6-3c7d-4788-b14d-9e9a5b98bddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:59.688111 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-75a1acd6-3c7d-4788-b14d-9e9a5b98bddb None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 19:59:59.691860 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-75a1acd6-3c7d-4788-b14d-9e9a5b98bddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:59.749311 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1190/2359] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 19:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 19:59:59.759122 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ca88b-692c-4a7f-923e-ec8fff36e9a3 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 19:59:59.760561 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-244ca88b-692c-4a7f-923e-ec8fff36e9a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 19:59:59.817975 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ca88b-692c-4a7f-923e-ec8fff36e9a3 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 19:59:59.821528 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24506044-42fe-4857-9a1f-768d664b7446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 19:59:59.822165 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24506044-42fe-4857-9a1f-768d664b7446 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 19:59:59.822446 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24506044-42fe-4857-9a1f-768d664b7446 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 19:59:59.822724 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24506044-42fe-4857-9a1f-768d664b7446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 19:59:59.831573 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24506044-42fe-4857-9a1f-768d664b7446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 19:59:59.833016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24506044-42fe-4857-9a1f-768d664b7446 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 19:59:59.838266 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:59.843405 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1170/2360] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 19:59:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:00:00.239077 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:00.415447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:00.781303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1acd6-3c7d-4788-b14d-9e9a5b98bddb None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:00.782859 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-75a1acd6-3c7d-4788-b14d-9e9a5b98bddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:00.797786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1acd6-3c7d-4788-b14d-9e9a5b98bddb None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:00.804702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69329cbf-20be-4fc3-b7e7-a18b86e40d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:00.806089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69329cbf-20be-4fc3-b7e7-a18b86e40d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:00.806565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69329cbf-20be-4fc3-b7e7-a18b86e40d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:00.807056 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69329cbf-20be-4fc3-b7e7-a18b86e40d14 admin admin] PATH_INFO: `/v3/projects/58bc93c7919647b6ad7a23ebe970916b` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:00.808653 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69329cbf-20be-4fc3-b7e7-a18b86e40d14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58bc93c7919647b6ad7a23ebe970916b)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:00.811532 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69329cbf-20be-4fc3-b7e7-a18b86e40d14 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:00.861537 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:00.920805 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-69329cbf-20be-4fc3-b7e7-a18b86e40d14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58bc93c7919647b6ad7a23ebe970916b', 'request_id': 'req-69329cbf-20be-4fc3-b7e7-a18b86e40d14'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:00:00.929117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-69329cbf-20be-4fc3-b7e7-a18b86e40d14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58bc93c7919647b6ad7a23ebe970916b', 'request_id': 'req-69329cbf-20be-4fc3-b7e7-a18b86e40d14'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:00:00.934946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-69329cbf-20be-4fc3-b7e7-a18b86e40d14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58bc93c7919647b6ad7a23ebe970916b', 'request_id': 'req-69329cbf-20be-4fc3-b7e7-a18b86e40d14'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:00:01.022966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-69329cbf-20be-4fc3-b7e7-a18b86e40d14 admin admin] The token cache is being invalidate because project 58bc93c7919647b6ad7a23ebe970916b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:00:01.023261 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-69329cbf-20be-4fc3-b7e7-a18b86e40d14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:00:01.024382 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-69329cbf-20be-4fc3-b7e7-a18b86e40d14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:00:01.026195 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1191/2361] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:00:00 2022] DELETE /identity/v3/projects/58bc93c7919647b6ad7a23ebe970916b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:00:01.031535 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ffc7f-4a25-4821-b229-a029a9ad04e4 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:01.032043 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ffc7f-4a25-4821-b229-a029a9ad04e4 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:01.032480 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ffc7f-4a25-4821-b229-a029a9ad04e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:01.050255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-b77ffc7f-4a25-4821-b229-a029a9ad04e4 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:00:01.051545 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-b77ffc7f-4a25-4821-b229-a029a9ad04e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:01.122514 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1171/2362] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:00:01.130509 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6b592-a33d-4aaa-9025-4e4a666d3bec None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:01.131045 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6b592-a33d-4aaa-9025-4e4a666d3bec None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:01.131546 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6b592-a33d-4aaa-9025-4e4a666d3bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:01.154773 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-4ed6b592-a33d-4aaa-9025-4e4a666d3bec None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:00:01.156183 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-4ed6b592-a33d-4aaa-9025-4e4a666d3bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:01.165590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1192/2363] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:00:01.170609 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ffc7f-4a25-4821-b229-a029a9ad04e4 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:01.184742 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ffc7f-4a25-4821-b229-a029a9ad04e4 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:01.190238 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1ec66-49d4-419c-bb4a-a2a024acb35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:01.192113 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1ec66-49d4-419c-bb4a-a2a024acb35e admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:01.192113 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1ec66-49d4-419c-bb4a-a2a024acb35e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:01.192685 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1ec66-49d4-419c-bb4a-a2a024acb35e admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:01.193655 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1ec66-49d4-419c-bb4a-a2a024acb35e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:00:01.194136 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1ec66-49d4-419c-bb4a-a2a024acb35e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:01.196057 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1ec66-49d4-419c-bb4a-a2a024acb35e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:01.213771 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1172/2364] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 20:00:01.215446 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6b592-a33d-4aaa-9025-4e4a666d3bec None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:01.225354 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6b592-a33d-4aaa-9025-4e4a666d3bec None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:01.230699 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c544a-f828-4be2-adaa-d88c7229ec56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:01.231969 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c544a-f828-4be2-adaa-d88c7229ec56 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:01.231969 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c544a-f828-4be2-adaa-d88c7229ec56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:01.232288 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c544a-f828-4be2-adaa-d88c7229ec56 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:01.232963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c544a-f828-4be2-adaa-d88c7229ec56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:01.234993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c544a-f828-4be2-adaa-d88c7229ec56 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:01.241982 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:01.338060 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37733edf-4e4b-4e7e-bb1e-5ecf317e949e None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:01.338243 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1193/2365] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:00:01 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:00:01.338677 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37733edf-4e4b-4e7e-bb1e-5ecf317e949e None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:01.341093 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37733edf-4e4b-4e7e-bb1e-5ecf317e949e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:01.341531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c544a-f828-4be2-adaa-d88c7229ec56 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:01.366496 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-37733edf-4e4b-4e7e-bb1e-5ecf317e949e None None] MFA Rules not processed for user `fec6c1cbf48a44f9922bd82e714861c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:00:01.368474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-37733edf-4e4b-4e7e-bb1e-5ecf317e949e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:01.421049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c544a-f828-4be2-adaa-d88c7229ec56 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:01.428067 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e54219-821e-404c-ad8e-81fe6a6efe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:01.428869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e54219-821e-404c-ad8e-81fe6a6efe8c admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:01.431615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e54219-821e-404c-ad8e-81fe6a6efe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:01.431615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e54219-821e-404c-ad8e-81fe6a6efe8c admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:01.431615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e54219-821e-404c-ad8e-81fe6a6efe8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:01.432315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e54219-821e-404c-ad8e-81fe6a6efe8c admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:01.437413 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1173/2366] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 20:00:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:00:01.450095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37733edf-4e4b-4e7e-bb1e-5ecf317e949e None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:01.451494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-37733edf-4e4b-4e7e-bb1e-5ecf317e949e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:01.522430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37733edf-4e4b-4e7e-bb1e-5ecf317e949e None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:01.527502 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1eacc2-1a3c-49e3-b00b-0922cf683619 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc53095a45e4136b37fb6e4e677eff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:01.528113 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eacc2-1a3c-49e3-b00b-0922cf683619 service swift] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:01.528420 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eacc2-1a3c-49e3-b00b-0922cf683619 service swift] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:01.528702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eacc2-1a3c-49e3-b00b-0922cf683619 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:01.537761 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1eacc2-1a3c-49e3-b00b-0922cf683619 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:01.539358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1eacc2-1a3c-49e3-b00b-0922cf683619 service swift] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:01.547626 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1174/2367] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 20:00:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 20:00:01.582488 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1194/2368] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:00:01 2022] POST /identity/v3/users => generated 292 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:00:01.592034 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1eacc2-1a3c-49e3-b00b-0922cf683619 service swift] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:01.605310 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1eacc2-1a3c-49e3-b00b-0922cf683619 service swift] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:01.609985 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f11e1f-91e2-408b-87c7-6bedeb76aa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:01.617843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f11e1f-91e2-408b-87c7-6bedeb76aa8d admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:01.617843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f11e1f-91e2-408b-87c7-6bedeb76aa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:01.617843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f11e1f-91e2-408b-87c7-6bedeb76aa8d admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:01.617843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f11e1f-91e2-408b-87c7-6bedeb76aa8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:01.617843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f11e1f-91e2-408b-87c7-6bedeb76aa8d admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:01.625199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1175/2369] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:00:01.629698 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e54219-821e-404c-ad8e-81fe6a6efe8c admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:01.639881 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e54219-821e-404c-ad8e-81fe6a6efe8c admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:01.645202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de22943-d817-44d3-b8a0-efe14ac28212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:01.649788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de22943-d817-44d3-b8a0-efe14ac28212 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:01.649788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de22943-d817-44d3-b8a0-efe14ac28212 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:01.649788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de22943-d817-44d3-b8a0-efe14ac28212 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:01.649788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de22943-d817-44d3-b8a0-efe14ac28212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:01.649788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de22943-d817-44d3-b8a0-efe14ac28212 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:01.659215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1195/2370] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:00:01.663807 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f11e1f-91e2-408b-87c7-6bedeb76aa8d admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:01.674906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f11e1f-91e2-408b-87c7-6bedeb76aa8d admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:01.680372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f32fe-be5b-46f0-9d8e-39bc57ed804a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:01.681297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f32fe-be5b-46f0-9d8e-39bc57ed804a admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:01.681576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f32fe-be5b-46f0-9d8e-39bc57ed804a admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:01.681858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f32fe-be5b-46f0-9d8e-39bc57ed804a admin admin] PATH_INFO: `/v3/projects/7b208adac77d4641a395b186154c37e6/users/1885d0dd57f84c2d83f4245e5ecfb199/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:01.697095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f32fe-be5b-46f0-9d8e-39bc57ed804a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b208adac77d4641a395b186154c37e6, user_id=1885d0dd57f84c2d83f4245e5ecfb199, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:01.699802 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f32fe-be5b-46f0-9d8e-39bc57ed804a admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:01.701945 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:01.796267 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1176/2371] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:00:01 2022] PUT /identity/v3/projects/7b208adac77d4641a395b186154c37e6/users/1885d0dd57f84c2d83f4245e5ecfb199/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:00:01.805568 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55c656-bfe3-4b53-817c-673c997e5edb None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:01.806767 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55c656-bfe3-4b53-817c-673c997e5edb None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:01.807728 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55c656-bfe3-4b53-817c-673c997e5edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:01.836596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-6a55c656-bfe3-4b53-817c-673c997e5edb None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:00:01.841282 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-6a55c656-bfe3-4b53-817c-673c997e5edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:01.907879 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:01.937297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:01.949678 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1196/2372] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:00:01.964054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f32fe-be5b-46f0-9d8e-39bc57ed804a admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:01.966366 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-772f32fe-be5b-46f0-9d8e-39bc57ed804a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:02.079444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f32fe-be5b-46f0-9d8e-39bc57ed804a admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:02.085500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b02b6-00ed-4d5a-b08d-f78b035b813c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:02.086295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b02b6-00ed-4d5a-b08d-f78b035b813c service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:02.086725 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b02b6-00ed-4d5a-b08d-f78b035b813c service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:02.087014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b02b6-00ed-4d5a-b08d-f78b035b813c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:02.103223 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b02b6-00ed-4d5a-b08d-f78b035b813c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:02.104697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b02b6-00ed-4d5a-b08d-f78b035b813c service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:02.115391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1177/2373] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:00:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:00:02.290290 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:02.359439 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:03.001727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:03.592780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:04.400949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:04.829917 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:05.227790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:05.289758 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:05.812765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:06.769116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:08.725658 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:09.090954 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:09.370258 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:09.495648 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:09.956930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc6bd3-335c-4531-a738-d764b02deeb0 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:09.957651 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc6bd3-335c-4531-a738-d764b02deeb0 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:09.957766 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc6bd3-335c-4531-a738-d764b02deeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:10.029459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-d2bc6bd3-335c-4531-a738-d764b02deeb0 None None] MFA Rules not processed for user `1885d0dd57f84c2d83f4245e5ecfb199`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:00:10.031789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d2bc6bd3-335c-4531-a738-d764b02deeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:10.137187 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b02b6-00ed-4d5a-b08d-f78b035b813c service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:10.147093 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1197/2374] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:00:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:00:10.150280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b02b6-00ed-4d5a-b08d-f78b035b813c service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:10.157673 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b65c8-0ebf-4efe-b14d-005606c9f7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:10.158349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b65c8-0ebf-4efe-b14d-005606c9f7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:10.158638 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b65c8-0ebf-4efe-b14d-005606c9f7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:10.158921 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b65c8-0ebf-4efe-b14d-005606c9f7d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:10.160255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b65c8-0ebf-4efe-b14d-005606c9f7d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:10.163136 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b65c8-0ebf-4efe-b14d-005606c9f7d6 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:10.261070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1178/2375] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:00:10 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:00:10.265770 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc6bd3-335c-4531-a738-d764b02deeb0 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:10.278245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc6bd3-335c-4531-a738-d764b02deeb0 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:10.312190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:10.361476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0041aa8-6690-4b7c-a286-0df9f944058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:10.362204 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0041aa8-6690-4b7c-a286-0df9f944058c admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:10.362499 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0041aa8-6690-4b7c-a286-0df9f944058c admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:10.363552 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0041aa8-6690-4b7c-a286-0df9f944058c admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:10.364617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0041aa8-6690-4b7c-a286-0df9f944058c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:10.366745 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0041aa8-6690-4b7c-a286-0df9f944058c admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:10.466397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1198/2376] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:00:10 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:00:10.467748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b65c8-0ebf-4efe-b14d-005606c9f7d6 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:10.478622 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:10.484799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b65c8-0ebf-4efe-b14d-005606c9f7d6 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:10.488451 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf584ed-a718-4207-940c-a3b8a3c27455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:10.490221 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf584ed-a718-4207-940c-a3b8a3c27455 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:10.490736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf584ed-a718-4207-940c-a3b8a3c27455 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:10.491236 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf584ed-a718-4207-940c-a3b8a3c27455 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:10.492136 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf584ed-a718-4207-940c-a3b8a3c27455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:10.493814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf584ed-a718-4207-940c-a3b8a3c27455 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:10.512026 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1179/2377] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:00:10.515935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0041aa8-6690-4b7c-a286-0df9f944058c admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:10.527924 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0041aa8-6690-4b7c-a286-0df9f944058c admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:10.532760 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291134b3-da7b-4eb7-bdda-b530d270e48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:10.536347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291134b3-da7b-4eb7-bdda-b530d270e48d admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:10.536347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291134b3-da7b-4eb7-bdda-b530d270e48d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:10.536347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291134b3-da7b-4eb7-bdda-b530d270e48d admin admin] PATH_INFO: `/v3/projects/264a29429dfc4ebfbfc00a485237f9ed/users/06990ef3f1284da49375f8c0313ca30d/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:10.552218 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291134b3-da7b-4eb7-bdda-b530d270e48d admin admin] RBAC: Authorizing `identity:create_grant(project_id=264a29429dfc4ebfbfc00a485237f9ed, user_id=06990ef3f1284da49375f8c0313ca30d, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:10.554958 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291134b3-da7b-4eb7-bdda-b530d270e48d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:10.621944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1199/2378] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:00:10 2022] PUT /identity/v3/projects/264a29429dfc4ebfbfc00a485237f9ed/users/06990ef3f1284da49375f8c0313ca30d/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:00:10.625949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf584ed-a718-4207-940c-a3b8a3c27455 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:10.637113 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf584ed-a718-4207-940c-a3b8a3c27455 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:10.735145 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bff64-d3d5-4ed6-8e91-71b82ea98b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:10.738551 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bff64-d3d5-4ed6-8e91-71b82ea98b07 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:10.738551 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bff64-d3d5-4ed6-8e91-71b82ea98b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:10.738551 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bff64-d3d5-4ed6-8e91-71b82ea98b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:10.738551 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bff64-d3d5-4ed6-8e91-71b82ea98b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:10.739783 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bff64-d3d5-4ed6-8e91-71b82ea98b07 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:10.753725 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1180/2379] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:00:10.756045 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291134b3-da7b-4eb7-bdda-b530d270e48d admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:10.767704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:10.774347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291134b3-da7b-4eb7-bdda-b530d270e48d admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:10.779642 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a433f6c-7c6c-4a47-a69c-2aa9bf00758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:10.780548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a433f6c-7c6c-4a47-a69c-2aa9bf00758a admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:10.780883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a433f6c-7c6c-4a47-a69c-2aa9bf00758a admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:10.781225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a433f6c-7c6c-4a47-a69c-2aa9bf00758a admin admin] PATH_INFO: `/v3/projects/264a29429dfc4ebfbfc00a485237f9ed/users/06990ef3f1284da49375f8c0313ca30d/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:10.783243 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a433f6c-7c6c-4a47-a69c-2aa9bf00758a admin admin] RBAC: Authorizing `identity:create_grant(project_id=264a29429dfc4ebfbfc00a485237f9ed, user_id=06990ef3f1284da49375f8c0313ca30d, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:10.787153 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a433f6c-7c6c-4a47-a69c-2aa9bf00758a admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:10.799021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1200/2380] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:00:10 2022] PUT /identity/v3/projects/264a29429dfc4ebfbfc00a485237f9ed/users/06990ef3f1284da49375f8c0313ca30d/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:00:10.850522 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:11.245892 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:11.393037 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:12.393607 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:12.444872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=80,keystone:DELETE=16,keystone:INSERT=4 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:13.772742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:14.204626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:14.221373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:15.158670 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:15.653273 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bff64-d3d5-4ed6-8e91-71b82ea98b07 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:15.655259 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e71bff64-d3d5-4ed6-8e91-71b82ea98b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:15.668650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bff64-d3d5-4ed6-8e91-71b82ea98b07 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:15.738454 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c606c4c-f67e-41f6-97e5-9f89bf28b8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:15.739615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c606c4c-f67e-41f6-97e5-9f89bf28b8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:15.740079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c606c4c-f67e-41f6-97e5-9f89bf28b8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:15.740748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c606c4c-f67e-41f6-97e5-9f89bf28b8d0 admin admin] PATH_INFO: `/v3/users/e4573c1b0cee4289b413cb1b5fa5f304` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:15.742482 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c606c4c-f67e-41f6-97e5-9f89bf28b8d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4573c1b0cee4289b413cb1b5fa5f304)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:15.744606 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c606c4c-f67e-41f6-97e5-9f89bf28b8d0 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:15.924409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:16.015884 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4c606c4c-f67e-41f6-97e5-9f89bf28b8d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4573c1b0cee4289b413cb1b5fa5f304'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:00:16.037565 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4c606c4c-f67e-41f6-97e5-9f89bf28b8d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4573c1b0cee4289b413cb1b5fa5f304'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:00:16.112828 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4c606c4c-f67e-41f6-97e5-9f89bf28b8d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4573c1b0cee4289b413cb1b5fa5f304'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:00:16.114003 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4c606c4c-f67e-41f6-97e5-9f89bf28b8d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4573c1b0cee4289b413cb1b5fa5f304'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:00:16.126301 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4c606c4c-f67e-41f6-97e5-9f89bf28b8d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4573c1b0cee4289b413cb1b5fa5f304'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:00:16.137003 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1181/2381] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:00:15 2022] DELETE /identity/v3/users/e4573c1b0cee4289b413cb1b5fa5f304 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:00:16.141420 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03f1c2-586e-45cb-aa4f-9dd66a3014bf None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:16.144466 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03f1c2-586e-45cb-aa4f-9dd66a3014bf None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:16.144466 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03f1c2-586e-45cb-aa4f-9dd66a3014bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:16.163400 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-bf03f1c2-586e-45cb-aa4f-9dd66a3014bf None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:00:16.164707 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-bf03f1c2-586e-45cb-aa4f-9dd66a3014bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:16.234842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1201/2382] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:00:16.244673 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c606c4c-f67e-41f6-97e5-9f89bf28b8d0 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:16.246223 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-4c606c4c-f67e-41f6-97e5-9f89bf28b8d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:16.327242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c606c4c-f67e-41f6-97e5-9f89bf28b8d0 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:16.334192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fb79c-a17c-4eca-bc1d-3c6c6b4b588b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:16.335149 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fb79c-a17c-4eca-bc1d-3c6c6b4b588b service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:16.336168 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fb79c-a17c-4eca-bc1d-3c6c6b4b588b service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:16.336644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fb79c-a17c-4eca-bc1d-3c6c6b4b588b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:16.347978 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fb79c-a17c-4eca-bc1d-3c6c6b4b588b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:16.349621 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fb79c-a17c-4eca-bc1d-3c6c6b4b588b service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:16.360365 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1182/2383] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:00:16.404646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:17.021848 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:17.098823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03f1c2-586e-45cb-aa4f-9dd66a3014bf None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:17.099102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:17.100323 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-bf03f1c2-586e-45cb-aa4f-9dd66a3014bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:17.112252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03f1c2-586e-45cb-aa4f-9dd66a3014bf None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:17.117697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bfde4-de0f-40fa-b2a8-ed7dd74e42f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:17.119261 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bfde4-de0f-40fa-b2a8-ed7dd74e42f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:17.119941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bfde4-de0f-40fa-b2a8-ed7dd74e42f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:17.119941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bfde4-de0f-40fa-b2a8-ed7dd74e42f7 admin admin] PATH_INFO: `/v3/projects/b73d95893795463db69133bf8159b152` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:17.121287 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bfde4-de0f-40fa-b2a8-ed7dd74e42f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b73d95893795463db69133bf8159b152)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:17.123355 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bfde4-de0f-40fa-b2a8-ed7dd74e42f7 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:17.242692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e12bfde4-de0f-40fa-b2a8-ed7dd74e42f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b73d95893795463db69133bf8159b152', 'request_id': 'req-e12bfde4-de0f-40fa-b2a8-ed7dd74e42f7'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:00:17.249897 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e12bfde4-de0f-40fa-b2a8-ed7dd74e42f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b73d95893795463db69133bf8159b152', 'request_id': 'req-e12bfde4-de0f-40fa-b2a8-ed7dd74e42f7'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:00:17.256640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e12bfde4-de0f-40fa-b2a8-ed7dd74e42f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b73d95893795463db69133bf8159b152', 'request_id': 'req-e12bfde4-de0f-40fa-b2a8-ed7dd74e42f7'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:00:17.340831 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e12bfde4-de0f-40fa-b2a8-ed7dd74e42f7 admin admin] The token cache is being invalidate because project b73d95893795463db69133bf8159b152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:00:17.344628 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e12bfde4-de0f-40fa-b2a8-ed7dd74e42f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:00:17.344628 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e12bfde4-de0f-40fa-b2a8-ed7dd74e42f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:00:17.344977 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1202/2384] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:00:17 2022] DELETE /identity/v3/projects/b73d95893795463db69133bf8159b152 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:00:17.350245 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d01a2-0e84-438d-88f6-203a29e0ea8b None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:17.350687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d01a2-0e84-438d-88f6-203a29e0ea8b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:17.351050 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d01a2-0e84-438d-88f6-203a29e0ea8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:17.376773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-817d01a2-0e84-438d-88f6-203a29e0ea8b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:00:17.379080 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-817d01a2-0e84-438d-88f6-203a29e0ea8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:17.458384 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1183/2385] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:00:17.459802 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b2075-7497-4bb3-a6e5-f12fba5970e6 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:17.460219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b2075-7497-4bb3-a6e5-f12fba5970e6 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:17.460607 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b2075-7497-4bb3-a6e5-f12fba5970e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:17.492889 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-d28b2075-7497-4bb3-a6e5-f12fba5970e6 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:00:17.494315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d28b2075-7497-4bb3-a6e5-f12fba5970e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:17.504510 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1203/2386] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:00:17.508452 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d01a2-0e84-438d-88f6-203a29e0ea8b None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:17.527119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d01a2-0e84-438d-88f6-203a29e0ea8b None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:17.538862 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb07db0-f427-4540-9734-e4425c7c810f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:17.540809 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb07db0-f427-4540-9734-e4425c7c810f admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:17.543775 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb07db0-f427-4540-9734-e4425c7c810f admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:17.543775 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb07db0-f427-4540-9734-e4425c7c810f admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:17.545399 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb07db0-f427-4540-9734-e4425c7c810f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:00:17.545399 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb07db0-f427-4540-9734-e4425c7c810f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:17.546580 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb07db0-f427-4540-9734-e4425c7c810f admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:17.576015 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b2075-7497-4bb3-a6e5-f12fba5970e6 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:17.577569 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1184/2387] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 20:00:17.592104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b2075-7497-4bb3-a6e5-f12fba5970e6 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:17.598206 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea82fb6-0304-4e10-a990-7d657147ad18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:17.604576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea82fb6-0304-4e10-a990-7d657147ad18 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:17.604576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea82fb6-0304-4e10-a990-7d657147ad18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:17.604576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea82fb6-0304-4e10-a990-7d657147ad18 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:17.604576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea82fb6-0304-4e10-a990-7d657147ad18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:17.609541 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea82fb6-0304-4e10-a990-7d657147ad18 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:17.730737 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1204/2388] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:00:17 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:00:17.731871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb07db0-f427-4540-9734-e4425c7c810f admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:17.732765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bf0bc-7d1a-449f-8fd1-7b08ce53e066 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:17.733233 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bf0bc-7d1a-449f-8fd1-7b08ce53e066 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:17.734066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bf0bc-7d1a-449f-8fd1-7b08ce53e066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:17.745068 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb07db0-f427-4540-9734-e4425c7c810f admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:17.805863 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-569bf0bc-7d1a-449f-8fd1-7b08ce53e066 None None] MFA Rules not processed for user `06990ef3f1284da49375f8c0313ca30d`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:00:17.806084 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-569bf0bc-7d1a-449f-8fd1-7b08ce53e066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:17.878357 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a75b8-eb83-489a-a38a-d1f5dd9c7709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:17.881968 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a75b8-eb83-489a-a38a-d1f5dd9c7709 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:17.882419 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a75b8-eb83-489a-a38a-d1f5dd9c7709 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:17.882803 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a75b8-eb83-489a-a38a-d1f5dd9c7709 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:17.883667 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a75b8-eb83-489a-a38a-d1f5dd9c7709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:17.889960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a75b8-eb83-489a-a38a-d1f5dd9c7709 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:17.953242 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1205/2389] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:00:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:00:17.965215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bf0bc-7d1a-449f-8fd1-7b08ce53e066 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:17.966729 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-569bf0bc-7d1a-449f-8fd1-7b08ce53e066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:18.013279 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1185/2390] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:00:17 2022] POST /identity/v3/users => generated 291 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:00:18.025211 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a75b8-eb83-489a-a38a-d1f5dd9c7709 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:18.039180 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a75b8-eb83-489a-a38a-d1f5dd9c7709 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:18.047817 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c1843-a933-4665-8dee-b7af0f7db7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:18.048885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c1843-a933-4665-8dee-b7af0f7db7cb admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:18.049470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c1843-a933-4665-8dee-b7af0f7db7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:18.050160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c1843-a933-4665-8dee-b7af0f7db7cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:18.051219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c1843-a933-4665-8dee-b7af0f7db7cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:18.056296 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c1843-a933-4665-8dee-b7af0f7db7cb admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:18.076750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1186/2391] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:00:18.081324 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c1843-a933-4665-8dee-b7af0f7db7cb admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:18.101589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c1843-a933-4665-8dee-b7af0f7db7cb admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:18.115266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee92787-8b89-4ff6-a8f0-58a08766acb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:18.115962 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee92787-8b89-4ff6-a8f0-58a08766acb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:18.116249 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee92787-8b89-4ff6-a8f0-58a08766acb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:18.116532 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee92787-8b89-4ff6-a8f0-58a08766acb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:18.117290 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee92787-8b89-4ff6-a8f0-58a08766acb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:18.125195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee92787-8b89-4ff6-a8f0-58a08766acb3 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:18.127054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bf0bc-7d1a-449f-8fd1-7b08ce53e066 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:18.132749 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ae13c-2b18-4831-b85b-81caa7adeb0f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f078219032be4b619119d1d9d59c499d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:18.133582 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ae13c-2b18-4831-b85b-81caa7adeb0f service glance] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:18.133946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ae13c-2b18-4831-b85b-81caa7adeb0f service glance] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:18.134300 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ae13c-2b18-4831-b85b-81caa7adeb0f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:18.136867 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f22ae13c-2b18-4831-b85b-81caa7adeb0f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:18.142823 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1187/2392] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:00:18.155871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee92787-8b89-4ff6-a8f0-58a08766acb3 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:18.171933 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee92787-8b89-4ff6-a8f0-58a08766acb3 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:18.179947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4cfdf-689b-4559-9ab2-945a3ed3e71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:18.181239 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4cfdf-689b-4559-9ab2-945a3ed3e71a admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:18.181533 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4cfdf-689b-4559-9ab2-945a3ed3e71a admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:18.181814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4cfdf-689b-4559-9ab2-945a3ed3e71a admin admin] PATH_INFO: `/v3/projects/2d2ff678c82142f2aa1612f2110c6b23/users/762127eafd404c56b995b3e9e44c8e04/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:18.198483 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4cfdf-689b-4559-9ab2-945a3ed3e71a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2ff678c82142f2aa1612f2110c6b23, user_id=762127eafd404c56b995b3e9e44c8e04, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:18.202167 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4cfdf-689b-4559-9ab2-945a3ed3e71a admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:18.220742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ae13c-2b18-4831-b85b-81caa7adeb0f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:18.223328 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ae13c-2b18-4831-b85b-81caa7adeb0f service glance] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:18.235721 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1206/2393] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:00:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 20:00:18.297137 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1188/2394] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:00:18 2022] PUT /identity/v3/projects/2d2ff678c82142f2aa1612f2110c6b23/users/762127eafd404c56b995b3e9e44c8e04/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:00:18.302949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e2215-0d97-4e9a-bec7-447b1d0320e0 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:18.303266 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e2215-0d97-4e9a-bec7-447b1d0320e0 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:18.305889 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e2215-0d97-4e9a-bec7-447b1d0320e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:18.329364 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-e85e2215-0d97-4e9a-bec7-447b1d0320e0 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:00:18.330601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e85e2215-0d97-4e9a-bec7-447b1d0320e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:18.374872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:18.416042 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:18.462369 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1207/2395] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:00:18.472755 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4cfdf-689b-4559-9ab2-945a3ed3e71a admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:18.477411 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f9d4cfdf-689b-4559-9ab2-945a3ed3e71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:18.540452 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4cfdf-689b-4559-9ab2-945a3ed3e71a admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:18.544224 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae53af-9076-417d-bfd3-363d1b7a14fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:18.544875 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae53af-9076-417d-bfd3-363d1b7a14fa service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:18.545208 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae53af-9076-417d-bfd3-363d1b7a14fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:18.545514 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae53af-9076-417d-bfd3-363d1b7a14fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:18.553872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380e81c-cf5f-400a-855a-263e78b6b40d None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:18.553872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380e81c-cf5f-400a-855a-263e78b6b40d None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:18.554128 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380e81c-cf5f-400a-855a-263e78b6b40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:18.556434 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae53af-9076-417d-bfd3-363d1b7a14fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:18.558085 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae53af-9076-417d-bfd3-363d1b7a14fa service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:18.569130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1189/2396] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:00:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:00:18.603386 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-2380e81c-cf5f-400a-855a-263e78b6b40d None None] MFA Rules not processed for user `fec6c1cbf48a44f9922bd82e714861c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:00:18.604610 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-2380e81c-cf5f-400a-855a-263e78b6b40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:18.671800 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1208/2397] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 20:00:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:00:18.684641 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae53af-9076-417d-bfd3-363d1b7a14fa service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:18.686076 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-c8ae53af-9076-417d-bfd3-363d1b7a14fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:18.781123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae53af-9076-417d-bfd3-363d1b7a14fa service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:18.786965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d2b39-3d71-4ec6-bdef-d39dae9984fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc53095a45e4136b37fb6e4e677eff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:18.787610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2b39-3d71-4ec6-bdef-d39dae9984fb service swift] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:18.787896 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2b39-3d71-4ec6-bdef-d39dae9984fb service swift] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:18.788177 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2b39-3d71-4ec6-bdef-d39dae9984fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:18.796288 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d2b39-3d71-4ec6-bdef-d39dae9984fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:18.797906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d2b39-3d71-4ec6-bdef-d39dae9984fb service swift] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:18.806568 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1190/2398] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 20:00:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 20:00:19.171049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:19.425782 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:20.695707 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:21.121234 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bea31e-301b-4f0e-a839-cdd8e962e5da None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:21.121665 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bea31e-301b-4f0e-a839-cdd8e962e5da None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:21.122043 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bea31e-301b-4f0e-a839-cdd8e962e5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:21.135555 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:21.218006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-c7bea31e-301b-4f0e-a839-cdd8e962e5da None None] MFA Rules not processed for user `762127eafd404c56b995b3e9e44c8e04`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:00:21.221642 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c7bea31e-301b-4f0e-a839-cdd8e962e5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:21.464575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1209/2399] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:00:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:00:21.484058 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d2b39-3d71-4ec6-bdef-d39dae9984fb service swift] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:21.485609 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-010d2b39-3d71-4ec6-bdef-d39dae9984fb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:21.535971 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:21.655933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:21.674711 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d2b39-3d71-4ec6-bdef-d39dae9984fb service swift] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:21.685565 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:21.693800 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d792264-5586-4df4-919d-f1111ebb5717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:21.694973 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d792264-5586-4df4-919d-f1111ebb5717 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:21.695562 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d792264-5586-4df4-919d-f1111ebb5717 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:21.697524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d792264-5586-4df4-919d-f1111ebb5717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:21.724670 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d792264-5586-4df4-919d-f1111ebb5717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:21.730946 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d792264-5586-4df4-919d-f1111ebb5717 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:21.768314 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1191/2400] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:00:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:00:22.284881 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:22.381583 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:22.700809 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c4d5b-f8d6-464b-9e0e-239356a1d465 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:22.701406 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c4d5b-f8d6-464b-9e0e-239356a1d465 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:22.701919 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c4d5b-f8d6-464b-9e0e-239356a1d465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:22.726933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-0e2c4d5b-f8d6-464b-9e0e-239356a1d465 None None] MFA Rules not processed for user `fec6c1cbf48a44f9922bd82e714861c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:00:22.728917 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0e2c4d5b-f8d6-464b-9e0e-239356a1d465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:22.743706 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1210/2401] 10.222.0.13 () {58 vars in 967 bytes} [Thu Jun 23 20:00:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:00:22.759307 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d792264-5586-4df4-919d-f1111ebb5717 service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:22.789770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d792264-5586-4df4-919d-f1111ebb5717 service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:22.818940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8170a5-43e0-4a44-9d47-30f557fc8864 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc53095a45e4136b37fb6e4e677eff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:22.819646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8170a5-43e0-4a44-9d47-30f557fc8864 service swift] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:22.819939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8170a5-43e0-4a44-9d47-30f557fc8864 service swift] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:22.820219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8170a5-43e0-4a44-9d47-30f557fc8864 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:22.839771 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8170a5-43e0-4a44-9d47-30f557fc8864 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:22.841840 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8170a5-43e0-4a44-9d47-30f557fc8864 service swift] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:22.854234 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1192/2402] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 20:00:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 20:00:22.890452 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:23.272695 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:23.358771 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:23.547769 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:23.989412 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:24.047738 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:24.084152 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60065d56-ede7-4cb3-813b-362eda73d130 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:24.085280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60065d56-ede7-4cb3-813b-362eda73d130 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:24.085724 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60065d56-ede7-4cb3-813b-362eda73d130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:24.142142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-60065d56-ede7-4cb3-813b-362eda73d130 None None] MFA Rules not processed for user `762127eafd404c56b995b3e9e44c8e04`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:00:24.143429 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-60065d56-ede7-4cb3-813b-362eda73d130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:24.182961 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1211/2403] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:00:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:00:24.416857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:24.720803 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:25.084492 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:25.176214 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:25.495681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:25.554225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:25.742251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:25.867221 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:25.998840 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:26.449556 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:26.547179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:27.101172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:27.257350 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:27.758665 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:27.817236 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:28.272613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:28.330036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:28.730095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:28.881818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:29.906604 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:30.461258 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:30.740871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:31.123911 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:32.738440 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16009e39-313a-44cb-a6db-40ba6fa1f6cc None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:32.740821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16009e39-313a-44cb-a6db-40ba6fa1f6cc None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:32.740821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16009e39-313a-44cb-a6db-40ba6fa1f6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:32.763846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-16009e39-313a-44cb-a6db-40ba6fa1f6cc None None] MFA Rules not processed for user `93501679612c4fc4bfa079af8bb6cfd0`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:00:32.765453 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-16009e39-313a-44cb-a6db-40ba6fa1f6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:32.852902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1193/2404] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:00:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:00:35.037568 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60065d56-ede7-4cb3-813b-362eda73d130 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:35.039273 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-60065d56-ede7-4cb3-813b-362eda73d130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:35.090918 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:35.141859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebc895-ad55-448b-8a73-759e0ecc0f5b None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:35.142436 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebc895-ad55-448b-8a73-759e0ecc0f5b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:35.142672 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebc895-ad55-448b-8a73-759e0ecc0f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:35.169500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60065d56-ede7-4cb3-813b-362eda73d130 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:35.169611 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-e1ebc895-ad55-448b-8a73-759e0ecc0f5b None None] MFA Rules not processed for user `1885d0dd57f84c2d83f4245e5ecfb199`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:00:35.169611 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e1ebc895-ad55-448b-8a73-759e0ecc0f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:35.175052 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3385a1-077e-4635-b642-ade0033fe925 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9ba6d33e8640ec8dcda9971f59c5dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:35.176378 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3385a1-077e-4635-b642-ade0033fe925 service placement] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:35.176786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3385a1-077e-4635-b642-ade0033fe925 service placement] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:35.177079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3385a1-077e-4635-b642-ade0033fe925 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:35.179140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-8f3385a1-077e-4635-b642-ade0033fe925 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:35.193459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3385a1-077e-4635-b642-ade0033fe925 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:35.196306 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3385a1-077e-4635-b642-ade0033fe925 service placement] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:35.214504 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1212/2405] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:00:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:00:35.233093 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:35.271486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1194/2406] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:00:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:00:39.473200 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfdd7c-d950-44fb-9331-0d4771a89d41 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:39.473689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfdd7c-d950-44fb-9331-0d4771a89d41 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:39.473801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfdd7c-d950-44fb-9331-0d4771a89d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:39.494854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-dfbfdd7c-d950-44fb-9331-0d4771a89d41 None None] MFA Rules not processed for user `fec6c1cbf48a44f9922bd82e714861c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:00:39.496151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-dfbfdd7c-d950-44fb-9331-0d4771a89d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:39.516472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1213/2407] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 20:00:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:00:39.517682 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebc895-ad55-448b-8a73-759e0ecc0f5b None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:00:39.530924 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebc895-ad55-448b-8a73-759e0ecc0f5b None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:00:39.537114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67025e7b-9bb5-4bfa-8544-29ae640d1699 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc53095a45e4136b37fb6e4e677eff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:00:39.537991 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67025e7b-9bb5-4bfa-8544-29ae640d1699 service swift] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:39.538275 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67025e7b-9bb5-4bfa-8544-29ae640d1699 service swift] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:39.538606 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67025e7b-9bb5-4bfa-8544-29ae640d1699 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:39.547512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67025e7b-9bb5-4bfa-8544-29ae640d1699 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:00:39.549935 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67025e7b-9bb5-4bfa-8544-29ae640d1699 service swift] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:00:39.559902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1195/2408] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 20:00:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 20:00:42.097128 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eacf4-4873-4722-8c68-6bd46214b88f None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:00:42.097678 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eacf4-4873-4722-8c68-6bd46214b88f None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:00:42.097801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eacf4-4873-4722-8c68-6bd46214b88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:00:42.115768 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-3d3eacf4-4873-4722-8c68-6bd46214b88f None None] MFA Rules not processed for user `d5157ad1d56246a185f5a25cc6771a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:00:42.116988 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-3d3eacf4-4873-4722-8c68-6bd46214b88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:00:42.186708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1214/2409] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:00:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:00:49.556717 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=10 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:52.179781 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=49 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:01:10.630281 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67025e7b-9bb5-4bfa-8544-29ae640d1699 service swift] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:01:10.631690 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-67025e7b-9bb5-4bfa-8544-29ae640d1699 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:01:10.643643 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67025e7b-9bb5-4bfa-8544-29ae640d1699 service swift] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:01:10.647250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382a78c-095c-4bb1-9a81-7bc79f7a7e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:01:10.647894 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382a78c-095c-4bb1-9a81-7bc79f7a7e1c service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:01:10.653004 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382a78c-095c-4bb1-9a81-7bc79f7a7e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:01:10.653004 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382a78c-095c-4bb1-9a81-7bc79f7a7e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:01:10.710842 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382a78c-095c-4bb1-9a81-7bc79f7a7e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:01:10.712397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382a78c-095c-4bb1-9a81-7bc79f7a7e1c service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:01:10.724398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1196/2410] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:01:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:01:16.323554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d640e-48c3-4d1f-8082-3daac85b8232 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:01:16.324882 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d640e-48c3-4d1f-8082-3daac85b8232 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:01:16.325446 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d640e-48c3-4d1f-8082-3daac85b8232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:01:16.380189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-fe5d640e-48c3-4d1f-8082-3daac85b8232 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:01:16.394152 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-fe5d640e-48c3-4d1f-8082-3daac85b8232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:01:16.403293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1215/2411] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 23 20:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:01:16.433195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382a78c-095c-4bb1-9a81-7bc79f7a7e1c service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:01:16.434722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-1382a78c-095c-4bb1-9a81-7bc79f7a7e1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:01:16.613560 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382a78c-095c-4bb1-9a81-7bc79f7a7e1c service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:01:16.622598 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81809f59-269d-41fd-a3e4-b21d442974e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:01:16.625782 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81809f59-269d-41fd-a3e4-b21d442974e3 service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:01:16.625782 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81809f59-269d-41fd-a3e4-b21d442974e3 service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:01:16.625782 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81809f59-269d-41fd-a3e4-b21d442974e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:01:16.633980 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81809f59-269d-41fd-a3e4-b21d442974e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:01:16.635881 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81809f59-269d-41fd-a3e4-b21d442974e3 service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:01:16.657391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1197/2412] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:01:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:01:20.850967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b213f-927d-4d2b-9735-e1adaeadcfa7 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:01:20.851530 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b213f-927d-4d2b-9735-e1adaeadcfa7 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:01:20.851530 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b213f-927d-4d2b-9735-e1adaeadcfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:01:20.872964 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-cc7b213f-927d-4d2b-9735-e1adaeadcfa7 None None] MFA Rules not processed for user `073ea72b0441442ebfbbf045eecee2b6`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:01:20.874215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-cc7b213f-927d-4d2b-9735-e1adaeadcfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:01:20.931793 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1216/2413] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:01:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:01:21.651190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f3d25-1aba-4f64-a962-215e617f484b None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:01:21.656023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f3d25-1aba-4f64-a962-215e617f484b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:01:21.656023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f3d25-1aba-4f64-a962-215e617f484b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:01:21.672378 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-7e6f3d25-1aba-4f64-a962-215e617f484b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:01:21.674446 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-7e6f3d25-1aba-4f64-a962-215e617f484b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:01:21.682789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1198/2414] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 23 20:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:01:21.702994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b213f-927d-4d2b-9735-e1adaeadcfa7 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:01:21.716576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b213f-927d-4d2b-9735-e1adaeadcfa7 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:01:21.723247 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226f1b6-5591-44fc-9e38-61b98f68ad85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:01:21.727376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226f1b6-5591-44fc-9e38-61b98f68ad85 service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:01:21.727376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226f1b6-5591-44fc-9e38-61b98f68ad85 service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:01:21.727376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226f1b6-5591-44fc-9e38-61b98f68ad85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:01:21.733583 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226f1b6-5591-44fc-9e38-61b98f68ad85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:01:21.735245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226f1b6-5591-44fc-9e38-61b98f68ad85 service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:01:21.746631 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1217/2415] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:01:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:01:24.989797 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b89571-464c-4906-a183-1333c76151c5 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:01:24.990302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b89571-464c-4906-a183-1333c76151c5 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:01:24.990405 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b89571-464c-4906-a183-1333c76151c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:01:25.026505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-56b89571-464c-4906-a183-1333c76151c5 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:01:25.027819 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-56b89571-464c-4906-a183-1333c76151c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:01:25.038387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1199/2416] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 23 20:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:01:25.064948 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226f1b6-5591-44fc-9e38-61b98f68ad85 service nova] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:01:25.077641 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226f1b6-5591-44fc-9e38-61b98f68ad85 service nova] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:01:25.086308 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99aa88c-b0d4-4bff-86ae-df6b9a788e60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:01:25.091552 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99aa88c-b0d4-4bff-86ae-df6b9a788e60 service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:01:25.091552 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99aa88c-b0d4-4bff-86ae-df6b9a788e60 service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:01:25.091552 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99aa88c-b0d4-4bff-86ae-df6b9a788e60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:01:25.098282 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99aa88c-b0d4-4bff-86ae-df6b9a788e60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:01:25.099994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99aa88c-b0d4-4bff-86ae-df6b9a788e60 service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:01:25.109934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1218/2417] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:01:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 20:01:28.977929 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09999d-70d8-4af8-8f71-61788246410d None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:01:28.978436 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09999d-70d8-4af8-8f71-61788246410d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:01:28.978436 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09999d-70d8-4af8-8f71-61788246410d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:01:28.996925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-be09999d-70d8-4af8-8f71-61788246410d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:01:28.998170 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-be09999d-70d8-4af8-8f71-61788246410d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:01:29.006123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1200/2418] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 23 20:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:01:29.029395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99aa88c-b0d4-4bff-86ae-df6b9a788e60 service nova] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:01:29.030788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-b99aa88c-b0d4-4bff-86ae-df6b9a788e60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:01:29.046247 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99aa88c-b0d4-4bff-86ae-df6b9a788e60 service nova] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:01:29.052567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09e19c-8ba7-4988-8904-f75c0ef862cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:01:29.053231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09e19c-8ba7-4988-8904-f75c0ef862cb service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:01:29.053517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09e19c-8ba7-4988-8904-f75c0ef862cb service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:01:29.053797 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09e19c-8ba7-4988-8904-f75c0ef862cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:01:29.061952 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09e19c-8ba7-4988-8904-f75c0ef862cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:01:29.063563 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09e19c-8ba7-4988-8904-f75c0ef862cb service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:01:29.073813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1219/2419] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:01:33.190841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed227192-c954-4af7-8e28-f7ec3195f69a None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:01:33.191226 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed227192-c954-4af7-8e28-f7ec3195f69a None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:01:33.191368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed227192-c954-4af7-8e28-f7ec3195f69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:01:33.211610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-ed227192-c954-4af7-8e28-f7ec3195f69a None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:01:33.212806 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ed227192-c954-4af7-8e28-f7ec3195f69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:01:33.225479 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1201/2420] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 23 20:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:01:33.253329 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09e19c-8ba7-4988-8904-f75c0ef862cb service nova] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:01:33.264601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09e19c-8ba7-4988-8904-f75c0ef862cb service nova] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:01:33.270060 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8d329-fd5f-4564-b6ff-b1ba8324d8ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:01:33.270694 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8d329-fd5f-4564-b6ff-b1ba8324d8ed service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:01:33.270978 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8d329-fd5f-4564-b6ff-b1ba8324d8ed service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:01:33.271256 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8d329-fd5f-4564-b6ff-b1ba8324d8ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:01:33.279440 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8d329-fd5f-4564-b6ff-b1ba8324d8ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:01:33.281010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8d329-fd5f-4564-b6ff-b1ba8324d8ed service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:01:33.290323 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1220/2421] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:01:37.467984 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f40c64-6d26-4c66-9758-3730f89225ef None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:01:37.468493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f40c64-6d26-4c66-9758-3730f89225ef None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:01:37.468493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f40c64-6d26-4c66-9758-3730f89225ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:01:37.487562 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-21f40c64-6d26-4c66-9758-3730f89225ef None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:01:37.488765 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-21f40c64-6d26-4c66-9758-3730f89225ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:01:37.496597 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1202/2422] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 23 20:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:01:37.531570 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8d329-fd5f-4564-b6ff-b1ba8324d8ed service nova] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:01:37.543751 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8d329-fd5f-4564-b6ff-b1ba8324d8ed service nova] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:01:37.549560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cb1be-a7ef-4f1e-86b7-99db8a88e494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:01:37.550190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cb1be-a7ef-4f1e-86b7-99db8a88e494 service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:01:37.550473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cb1be-a7ef-4f1e-86b7-99db8a88e494 service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:01:37.550752 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cb1be-a7ef-4f1e-86b7-99db8a88e494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:01:37.558723 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cb1be-a7ef-4f1e-86b7-99db8a88e494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:01:37.560301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cb1be-a7ef-4f1e-86b7-99db8a88e494 service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:01:37.569972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1221/2423] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:01:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:01:47.482410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=79 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:01:47.565800 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=58 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:01:56.762791 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ddaa6-b070-4df9-9b3c-488f89fd8f9f None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:01:56.763333 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ddaa6-b070-4df9-9b3c-488f89fd8f9f None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:01:56.763443 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ddaa6-b070-4df9-9b3c-488f89fd8f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:01:56.785495 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-aa8ddaa6-b070-4df9-9b3c-488f89fd8f9f None None] MFA Rules not processed for user `762127eafd404c56b995b3e9e44c8e04`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:01:56.786719 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-aa8ddaa6-b070-4df9-9b3c-488f89fd8f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:01:56.793827 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1203/2424] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:01:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:02:06.778987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:02:11.398094 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f86b3-9012-4999-ac8a-fd790bf6d06d None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:02:11.398567 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f86b3-9012-4999-ac8a-fd790bf6d06d None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:02:11.398665 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f86b3-9012-4999-ac8a-fd790bf6d06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:02:11.416964 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-6d4f86b3-9012-4999-ac8a-fd790bf6d06d None None] MFA Rules not processed for user `d5157ad1d56246a185f5a25cc6771a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:02:11.418353 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-6d4f86b3-9012-4999-ac8a-fd790bf6d06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:02:11.425220 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1222/2425] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:02:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:02:14.484583 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5031d-0dff-4a81-8d1d-3749a4410f14 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:02:14.485026 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5031d-0dff-4a81-8d1d-3749a4410f14 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:02:14.485148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5031d-0dff-4a81-8d1d-3749a4410f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:02:14.505906 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-afd5031d-0dff-4a81-8d1d-3749a4410f14 None None] MFA Rules not processed for user `93501679612c4fc4bfa079af8bb6cfd0`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:02:14.507293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-afd5031d-0dff-4a81-8d1d-3749a4410f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:02:14.515073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1204/2426] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:02:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:02:17.936376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3afc6-3d20-4a13-bb10-cb3293369a57 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:02:17.936886 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3afc6-3d20-4a13-bb10-cb3293369a57 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:02:17.937351 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3afc6-3d20-4a13-bb10-cb3293369a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:02:17.955755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-c0e3afc6-3d20-4a13-bb10-cb3293369a57 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:02:17.956968 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c0e3afc6-3d20-4a13-bb10-cb3293369a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:02:17.966146 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1223/2427] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 23 20:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:02:17.989842 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5031d-0dff-4a81-8d1d-3749a4410f14 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:02:18.007986 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5031d-0dff-4a81-8d1d-3749a4410f14 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:02:18.013717 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94f169-949a-43a6-bddd-4448a000c835 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:02:18.014359 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94f169-949a-43a6-bddd-4448a000c835 service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:02:18.014645 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94f169-949a-43a6-bddd-4448a000c835 service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:02:18.014947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94f169-949a-43a6-bddd-4448a000c835 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:02:18.024506 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94f169-949a-43a6-bddd-4448a000c835 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:02:18.026123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94f169-949a-43a6-bddd-4448a000c835 service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:02:18.035700 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1205/2428] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:02:23.539854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c48fd-bdf4-4154-ab42-fcac487240b6 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:02:23.540473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c48fd-bdf4-4154-ab42-fcac487240b6 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:02:23.540473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c48fd-bdf4-4154-ab42-fcac487240b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:02:23.559805 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-9b7c48fd-bdf4-4154-ab42-fcac487240b6 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:02:23.561029 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-9b7c48fd-bdf4-4154-ab42-fcac487240b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:02:23.569652 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1224/2429] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 23 20:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:02:23.596162 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94f169-949a-43a6-bddd-4448a000c835 service nova] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:02:23.608310 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94f169-949a-43a6-bddd-4448a000c835 service nova] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:02:23.613965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d1855-2a66-46e3-855d-602dd42fec2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:02:23.614816 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d1855-2a66-46e3-855d-602dd42fec2d service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:02:23.615195 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d1855-2a66-46e3-855d-602dd42fec2d service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:02:23.615482 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d1855-2a66-46e3-855d-602dd42fec2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:02:23.624233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d1855-2a66-46e3-855d-602dd42fec2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:02:23.625884 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d1855-2a66-46e3-855d-602dd42fec2d service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:02:23.636118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1206/2430] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:02:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:02:23.815796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c48fd-bdf4-4154-ab42-fcac487240b6 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:02:23.827593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c48fd-bdf4-4154-ab42-fcac487240b6 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:02:23.831737 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8713a4-3627-4cfc-a222-feb704f60242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:02:23.832414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8713a4-3627-4cfc-a222-feb704f60242 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:02:23.832697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8713a4-3627-4cfc-a222-feb704f60242 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:02:23.832975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8713a4-3627-4cfc-a222-feb704f60242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:02:23.836644 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-cd8713a4-3627-4cfc-a222-feb704f60242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:02:23.851585 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8713a4-3627-4cfc-a222-feb704f60242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:02:23.853019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8713a4-3627-4cfc-a222-feb704f60242 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:02:23.865033 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1225/2431] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:02:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:02:25.040563 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d1855-2a66-46e3-855d-602dd42fec2d service nova] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:02:25.049897 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d1855-2a66-46e3-855d-602dd42fec2d service nova] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:02:25.054107 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6179316-97e5-4d73-9676-01eb9a78a52a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:02:25.054743 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6179316-97e5-4d73-9676-01eb9a78a52a service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:02:25.055025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6179316-97e5-4d73-9676-01eb9a78a52a service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:02:25.055302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6179316-97e5-4d73-9676-01eb9a78a52a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:02:25.057177 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-b6179316-97e5-4d73-9676-01eb9a78a52a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:02:25.072562 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6179316-97e5-4d73-9676-01eb9a78a52a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:02:25.075979 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6179316-97e5-4d73-9676-01eb9a78a52a service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:02:25.086636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1207/2432] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:02:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:02:27.474826 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8c3ed-6c78-4d84-b55a-16850ef9c4de None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:02:27.475410 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8c3ed-6c78-4d84-b55a-16850ef9c4de None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:02:27.475579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8c3ed-6c78-4d84-b55a-16850ef9c4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:02:27.494456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-6af8c3ed-6c78-4d84-b55a-16850ef9c4de None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:02:27.495662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-6af8c3ed-6c78-4d84-b55a-16850ef9c4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:02:27.503571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1226/2433] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 23 20:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:02:27.529441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6179316-97e5-4d73-9676-01eb9a78a52a service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:02:27.541068 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6179316-97e5-4d73-9676-01eb9a78a52a service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:02:27.547263 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a4d23-a43b-4e16-953f-0941063473b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:02:27.547911 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a4d23-a43b-4e16-953f-0941063473b9 service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:02:27.548197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a4d23-a43b-4e16-953f-0941063473b9 service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:02:27.548473 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a4d23-a43b-4e16-953f-0941063473b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:02:27.557345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a4d23-a43b-4e16-953f-0941063473b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:02:27.558924 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a4d23-a43b-4e16-953f-0941063473b9 service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:02:27.569079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1208/2434] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:02:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:02:29.801849 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8c3ed-6c78-4d84-b55a-16850ef9c4de None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:02:29.815481 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8c3ed-6c78-4d84-b55a-16850ef9c4de None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:02:29.820969 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae597c6d-aabd-49e5-91e9-bf556f2cf210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:02:29.821647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae597c6d-aabd-49e5-91e9-bf556f2cf210 service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:02:29.821934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae597c6d-aabd-49e5-91e9-bf556f2cf210 service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:02:29.822212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae597c6d-aabd-49e5-91e9-bf556f2cf210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:02:29.824003 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ae597c6d-aabd-49e5-91e9-bf556f2cf210 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:02:29.835331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae597c6d-aabd-49e5-91e9-bf556f2cf210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:02:29.836910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae597c6d-aabd-49e5-91e9-bf556f2cf210 service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:02:29.846701 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1227/2435] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:02:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:02:31.794622 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b28135-93ac-4d06-8f31-c9c5adcd22e4 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:02:31.795137 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b28135-93ac-4d06-8f31-c9c5adcd22e4 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:02:31.795245 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b28135-93ac-4d06-8f31-c9c5adcd22e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:02:31.813172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-53b28135-93ac-4d06-8f31-c9c5adcd22e4 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:02:31.814401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-53b28135-93ac-4d06-8f31-c9c5adcd22e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:02:31.823422 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1209/2436] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 23 20:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:02:31.869252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae597c6d-aabd-49e5-91e9-bf556f2cf210 service nova] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:02:31.880983 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae597c6d-aabd-49e5-91e9-bf556f2cf210 service nova] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:02:31.886806 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cce67-65a1-4b14-9de7-38175fe57b07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:02:31.887442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cce67-65a1-4b14-9de7-38175fe57b07 service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:02:31.887727 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cce67-65a1-4b14-9de7-38175fe57b07 service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:02:31.888055 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cce67-65a1-4b14-9de7-38175fe57b07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:02:31.897030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cce67-65a1-4b14-9de7-38175fe57b07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:02:31.898659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cce67-65a1-4b14-9de7-38175fe57b07 service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:02:31.908710 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1228/2437] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:02:33.526571 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b28135-93ac-4d06-8f31-c9c5adcd22e4 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:02:33.539772 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b28135-93ac-4d06-8f31-c9c5adcd22e4 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:02:33.547034 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0921b-5925-4723-bf14-7652e2c27841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:02:33.547810 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0921b-5925-4723-bf14-7652e2c27841 service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:02:33.548196 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0921b-5925-4723-bf14-7652e2c27841 service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:02:33.548579 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0921b-5925-4723-bf14-7652e2c27841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:02:33.550519 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-fea0921b-5925-4723-bf14-7652e2c27841 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:02:33.562613 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0921b-5925-4723-bf14-7652e2c27841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:02:33.564330 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0921b-5925-4723-bf14-7652e2c27841 service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:02:33.578098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1210/2438] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:02:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:02:36.035104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdde8b-f348-4bc1-aa6c-8691b6dcf8c9 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:02:36.035594 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdde8b-f348-4bc1-aa6c-8691b6dcf8c9 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:02:36.035717 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdde8b-f348-4bc1-aa6c-8691b6dcf8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:02:36.054859 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-98bdde8b-f348-4bc1-aa6c-8691b6dcf8c9 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:02:36.056073 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-98bdde8b-f348-4bc1-aa6c-8691b6dcf8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:02:36.064466 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1229/2439] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 23 20:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:02:36.091534 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0921b-5925-4723-bf14-7652e2c27841 service nova] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:02:36.103249 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0921b-5925-4723-bf14-7652e2c27841 service nova] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:02:36.108934 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d9ba8-3df2-4012-9dbc-4837364b41b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:02:36.109737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d9ba8-3df2-4012-9dbc-4837364b41b1 service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:02:36.110022 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d9ba8-3df2-4012-9dbc-4837364b41b1 service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:02:36.110300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d9ba8-3df2-4012-9dbc-4837364b41b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:02:36.119196 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d9ba8-3df2-4012-9dbc-4837364b41b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:02:36.120769 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d9ba8-3df2-4012-9dbc-4837364b41b1 service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:02:36.130794 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1211/2440] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:02:46.048466 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=33 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:02:46.125962 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=42 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:02:52.390982 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47985ef3-f3c3-4b71-9309-dffc57fabf3b None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:02:52.391569 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47985ef3-f3c3-4b71-9309-dffc57fabf3b None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:02:52.391569 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47985ef3-f3c3-4b71-9309-dffc57fabf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:02:52.422858 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-47985ef3-f3c3-4b71-9309-dffc57fabf3b None None] MFA Rules not processed for user `fec6c1cbf48a44f9922bd82e714861c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:02:52.422858 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-47985ef3-f3c3-4b71-9309-dffc57fabf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:02:52.423286 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1230/2441] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 20:02:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:02:52.471414 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d9ba8-3df2-4012-9dbc-4837364b41b1 service nova] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:02:52.491722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d9ba8-3df2-4012-9dbc-4837364b41b1 service nova] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:02:52.510457 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c2909-c6d4-44e8-b8c1-c85c988de0b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc53095a45e4136b37fb6e4e677eff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:02:52.511284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c2909-c6d4-44e8-b8c1-c85c988de0b1 service swift] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:02:52.511658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c2909-c6d4-44e8-b8c1-c85c988de0b1 service swift] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:02:52.512057 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c2909-c6d4-44e8-b8c1-c85c988de0b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:02:52.524130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c2909-c6d4-44e8-b8c1-c85c988de0b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:02:52.525826 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c2909-c6d4-44e8-b8c1-c85c988de0b1 service swift] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:02:52.534268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1212/2442] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 20:02:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 20:03:02.408678 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:02.531057 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=6 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:04.061052 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47985ef3-f3c3-4b71-9309-dffc57fabf3b None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:04.070407 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47985ef3-f3c3-4b71-9309-dffc57fabf3b None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:04.074362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60093f2-5caf-4235-8e50-dc6d10149a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:04.074904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60093f2-5caf-4235-8e50-dc6d10149a7f service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:04.075189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60093f2-5caf-4235-8e50-dc6d10149a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:04.075469 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60093f2-5caf-4235-8e50-dc6d10149a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:04.077282 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e60093f2-5caf-4235-8e50-dc6d10149a7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:04.086956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60093f2-5caf-4235-8e50-dc6d10149a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:04.088384 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60093f2-5caf-4235-8e50-dc6d10149a7f service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:04.096529 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1231/2443] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:03:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:03:08.322219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c2909-c6d4-44e8-b8c1-c85c988de0b1 service swift] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:08.333932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c2909-c6d4-44e8-b8c1-c85c988de0b1 service swift] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:08.340092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb987058-ecba-467c-9c1d-0b7b42b9d8de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:08.340726 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb987058-ecba-467c-9c1d-0b7b42b9d8de service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:08.341013 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb987058-ecba-467c-9c1d-0b7b42b9d8de service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:08.341327 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb987058-ecba-467c-9c1d-0b7b42b9d8de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:08.343177 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-eb987058-ecba-467c-9c1d-0b7b42b9d8de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:08.356473 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb987058-ecba-467c-9c1d-0b7b42b9d8de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:08.358144 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb987058-ecba-467c-9c1d-0b7b42b9d8de service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:08.368908 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1213/2444] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:03:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:03:09.936794 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60093f2-5caf-4235-8e50-dc6d10149a7f service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:09.945837 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60093f2-5caf-4235-8e50-dc6d10149a7f service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:09.949520 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da72a23-9e7d-45e9-a736-bd2e9b6b9f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:09.950158 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da72a23-9e7d-45e9-a736-bd2e9b6b9f00 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:09.950446 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da72a23-9e7d-45e9-a736-bd2e9b6b9f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:09.950726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da72a23-9e7d-45e9-a736-bd2e9b6b9f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:09.952471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-2da72a23-9e7d-45e9-a736-bd2e9b6b9f00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:09.962203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da72a23-9e7d-45e9-a736-bd2e9b6b9f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:09.963632 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da72a23-9e7d-45e9-a736-bd2e9b6b9f00 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:09.971772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1232/2445] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:03:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:03:10.601852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb987058-ecba-467c-9c1d-0b7b42b9d8de service nova] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:10.613008 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb987058-ecba-467c-9c1d-0b7b42b9d8de service nova] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:10.619154 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b334cd-9e58-40cc-9bd7-7f75ab166766 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9ba6d33e8640ec8dcda9971f59c5dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:10.620432 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b334cd-9e58-40cc-9bd7-7f75ab166766 service placement] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:10.620432 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b334cd-9e58-40cc-9bd7-7f75ab166766 service placement] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:10.620432 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b334cd-9e58-40cc-9bd7-7f75ab166766 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:10.622138 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-50b334cd-9e58-40cc-9bd7-7f75ab166766 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:10.634365 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b334cd-9e58-40cc-9bd7-7f75ab166766 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:10.635926 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b334cd-9e58-40cc-9bd7-7f75ab166766 service placement] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:10.646054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1214/2446] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:03:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:03:13.188510 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da72a23-9e7d-45e9-a736-bd2e9b6b9f00 service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:13.210331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da72a23-9e7d-45e9-a736-bd2e9b6b9f00 service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:13.210331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78a058-db26-45db-afc7-aea7656a0b13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9ba6d33e8640ec8dcda9971f59c5dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:13.210331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78a058-db26-45db-afc7-aea7656a0b13 service placement] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:13.210331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78a058-db26-45db-afc7-aea7656a0b13 service placement] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:13.210732 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78a058-db26-45db-afc7-aea7656a0b13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:13.212890 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-da78a058-db26-45db-afc7-aea7656a0b13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:13.225940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78a058-db26-45db-afc7-aea7656a0b13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:13.228095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78a058-db26-45db-afc7-aea7656a0b13 service placement] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:13.242151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1233/2447] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:03:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 20:03:13.348433 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b334cd-9e58-40cc-9bd7-7f75ab166766 service placement] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:13.364170 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b334cd-9e58-40cc-9bd7-7f75ab166766 service placement] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:13.378628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca5467-8e6e-4589-a440-762cdbc5b4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:13.378628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca5467-8e6e-4589-a440-762cdbc5b4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:13.378628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca5467-8e6e-4589-a440-762cdbc5b4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:13.378628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca5467-8e6e-4589-a440-762cdbc5b4b3 admin admin] PATH_INFO: `/v3/users/762127eafd404c56b995b3e9e44c8e04` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:13.379347 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca5467-8e6e-4589-a440-762cdbc5b4b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=762127eafd404c56b995b3e9e44c8e04)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:13.380314 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca5467-8e6e-4589-a440-762cdbc5b4b3 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:13.551829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-99ca5467-8e6e-4589-a440-762cdbc5b4b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '762127eafd404c56b995b3e9e44c8e04'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:13.564903 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-99ca5467-8e6e-4589-a440-762cdbc5b4b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '762127eafd404c56b995b3e9e44c8e04'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:13.627225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-99ca5467-8e6e-4589-a440-762cdbc5b4b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '762127eafd404c56b995b3e9e44c8e04'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:13.628319 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-99ca5467-8e6e-4589-a440-762cdbc5b4b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '762127eafd404c56b995b3e9e44c8e04'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:13.638764 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-99ca5467-8e6e-4589-a440-762cdbc5b4b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '762127eafd404c56b995b3e9e44c8e04'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:13.645438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1215/2448] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:03:13 2022] DELETE /identity/v3/users/762127eafd404c56b995b3e9e44c8e04 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:03:13.858565 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78a058-db26-45db-afc7-aea7656a0b13 service placement] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:13.872104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78a058-db26-45db-afc7-aea7656a0b13 service placement] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:13.919968 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca5467-8e6e-4589-a440-762cdbc5b4b3 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:13.919968 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-99ca5467-8e6e-4589-a440-762cdbc5b4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:13.971735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78ab44-c54a-40c7-b005-ace8b50a7e3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:13.972443 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78ab44-c54a-40c7-b005-ace8b50a7e3d service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:13.972805 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78ab44-c54a-40c7-b005-ace8b50a7e3d service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:13.973174 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78ab44-c54a-40c7-b005-ace8b50a7e3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:13.975902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ef78ab44-c54a-40c7-b005-ace8b50a7e3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:13.994571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78ab44-c54a-40c7-b005-ace8b50a7e3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:13.996958 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78ab44-c54a-40c7-b005-ace8b50a7e3d service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:14.015798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca5467-8e6e-4589-a440-762cdbc5b4b3 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:14.018084 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1234/2449] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:03:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:03:14.021691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b737b50-395c-4f69-9bde-9aa9438e95a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:14.023212 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b737b50-395c-4f69-9bde-9aa9438e95a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:14.024220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b737b50-395c-4f69-9bde-9aa9438e95a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:14.024709 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b737b50-395c-4f69-9bde-9aa9438e95a3 admin admin] PATH_INFO: `/v3/projects/2d2ff678c82142f2aa1612f2110c6b23` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:14.026897 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b737b50-395c-4f69-9bde-9aa9438e95a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d2ff678c82142f2aa1612f2110c6b23)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:14.029740 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b737b50-395c-4f69-9bde-9aa9438e95a3 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:14.161634 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:14.164252 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6b737b50-395c-4f69-9bde-9aa9438e95a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d2ff678c82142f2aa1612f2110c6b23', 'request_id': 'req-6b737b50-395c-4f69-9bde-9aa9438e95a3'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:14.172566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6b737b50-395c-4f69-9bde-9aa9438e95a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d2ff678c82142f2aa1612f2110c6b23', 'request_id': 'req-6b737b50-395c-4f69-9bde-9aa9438e95a3'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:14.182003 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6b737b50-395c-4f69-9bde-9aa9438e95a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d2ff678c82142f2aa1612f2110c6b23', 'request_id': 'req-6b737b50-395c-4f69-9bde-9aa9438e95a3'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:14.268914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6b737b50-395c-4f69-9bde-9aa9438e95a3 admin admin] The token cache is being invalidate because project 2d2ff678c82142f2aa1612f2110c6b23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:03:14.269334 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6b737b50-395c-4f69-9bde-9aa9438e95a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:14.272727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6b737b50-395c-4f69-9bde-9aa9438e95a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:14.274746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1216/2450] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:03:13 2022] DELETE /identity/v3/projects/2d2ff678c82142f2aa1612f2110c6b23 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:03:14.810982 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d78f8-ac36-4ce7-964e-87b617ab2737 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:14.811481 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d78f8-ac36-4ce7-964e-87b617ab2737 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:14.811604 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d78f8-ac36-4ce7-964e-87b617ab2737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:14.829955 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-4c7d78f8-ac36-4ce7-964e-87b617ab2737 None None] MFA Rules not processed for user `fec6c1cbf48a44f9922bd82e714861c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:03:14.832538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-4c7d78f8-ac36-4ce7-964e-87b617ab2737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:14.893573 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1235/2451] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 20:03:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:03:14.909313 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b737b50-395c-4f69-9bde-9aa9438e95a3 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:14.910749 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-6b737b50-395c-4f69-9bde-9aa9438e95a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:14.987496 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b737b50-395c-4f69-9bde-9aa9438e95a3 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:14.993714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a136d-2064-4fd1-80b2-5f99fb7f4184 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc53095a45e4136b37fb6e4e677eff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:14.994408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a136d-2064-4fd1-80b2-5f99fb7f4184 service swift] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:14.995360 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a136d-2064-4fd1-80b2-5f99fb7f4184 service swift] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:14.995650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a136d-2064-4fd1-80b2-5f99fb7f4184 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:15.004524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a136d-2064-4fd1-80b2-5f99fb7f4184 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:15.006280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a136d-2064-4fd1-80b2-5f99fb7f4184 service swift] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:15.016850 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1217/2452] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 20:03:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 20:03:24.886705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=77 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:25.011326 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=39,keystone:DELETE=3,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:25.443415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d78f8-ac36-4ce7-964e-87b617ab2737 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:25.446376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-4c7d78f8-ac36-4ce7-964e-87b617ab2737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:25.534616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d78f8-ac36-4ce7-964e-87b617ab2737 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:25.540996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15f3b6-d0dd-48c8-8acc-4e8d5a0da216 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:25.541956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15f3b6-d0dd-48c8-8acc-4e8d5a0da216 service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:25.541956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15f3b6-d0dd-48c8-8acc-4e8d5a0da216 service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:25.542240 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15f3b6-d0dd-48c8-8acc-4e8d5a0da216 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:25.546827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-1a15f3b6-d0dd-48c8-8acc-4e8d5a0da216 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:25.574478 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15f3b6-d0dd-48c8-8acc-4e8d5a0da216 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:25.576115 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15f3b6-d0dd-48c8-8acc-4e8d5a0da216 service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:25.590276 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1236/2453] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:03:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:03:35.583669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=34 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:39.734816 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61603052-87f3-427a-adc7-061e06c1c7f5 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:39.735280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61603052-87f3-427a-adc7-061e06c1c7f5 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:39.736351 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61603052-87f3-427a-adc7-061e06c1c7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:39.753794 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-61603052-87f3-427a-adc7-061e06c1c7f5 None None] MFA Rules not processed for user `fec6c1cbf48a44f9922bd82e714861c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:03:39.755012 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-61603052-87f3-427a-adc7-061e06c1c7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:39.762750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1218/2454] 10.222.0.13 () {58 vars in 967 bytes} [Thu Jun 23 20:03:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:03:39.775374 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15f3b6-d0dd-48c8-8acc-4e8d5a0da216 service nova] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:39.786869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15f3b6-d0dd-48c8-8acc-4e8d5a0da216 service nova] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:39.792097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd170db-26c0-423d-8789-5f733e5d76eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc53095a45e4136b37fb6e4e677eff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:39.792739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd170db-26c0-423d-8789-5f733e5d76eb service swift] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:39.793025 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd170db-26c0-423d-8789-5f733e5d76eb service swift] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:39.793342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd170db-26c0-423d-8789-5f733e5d76eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:39.801936 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd170db-26c0-423d-8789-5f733e5d76eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:39.804191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd170db-26c0-423d-8789-5f733e5d76eb service swift] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:39.812217 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1237/2455] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 20:03:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 20:03:41.789191 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61603052-87f3-427a-adc7-061e06c1c7f5 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:41.803164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61603052-87f3-427a-adc7-061e06c1c7f5 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:41.808901 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272357a-fa40-4555-8bfe-43c5d694689c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:41.809683 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272357a-fa40-4555-8bfe-43c5d694689c service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:41.810052 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272357a-fa40-4555-8bfe-43c5d694689c service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:41.810408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272357a-fa40-4555-8bfe-43c5d694689c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:41.812344 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-7272357a-fa40-4555-8bfe-43c5d694689c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:41.881028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272357a-fa40-4555-8bfe-43c5d694689c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:41.882715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272357a-fa40-4555-8bfe-43c5d694689c service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:41.892523 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1219/2456] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:03:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:03:41.940065 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd170db-26c0-423d-8789-5f733e5d76eb service swift] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:41.941609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-fcd170db-26c0-423d-8789-5f733e5d76eb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:42.001514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd170db-26c0-423d-8789-5f733e5d76eb service swift] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:42.005097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5e28f-d7b7-4b41-8294-4a38300a0299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:42.005785 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5e28f-d7b7-4b41-8294-4a38300a0299 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:42.006054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5e28f-d7b7-4b41-8294-4a38300a0299 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:42.006538 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5e28f-d7b7-4b41-8294-4a38300a0299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:42.008401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-bdb5e28f-d7b7-4b41-8294-4a38300a0299 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:42.070699 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5e28f-d7b7-4b41-8294-4a38300a0299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:42.072150 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5e28f-d7b7-4b41-8294-4a38300a0299 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:42.082306 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1238/2457] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:03:43.667039 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e488b3-bfc8-4020-8f11-6a43e99a4c70 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:43.667555 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e488b3-bfc8-4020-8f11-6a43e99a4c70 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:43.667642 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e488b3-bfc8-4020-8f11-6a43e99a4c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:43.685815 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-80e488b3-bfc8-4020-8f11-6a43e99a4c70 None None] MFA Rules not processed for user `fec6c1cbf48a44f9922bd82e714861c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:03:43.687020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-80e488b3-bfc8-4020-8f11-6a43e99a4c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:43.694891 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1220/2458] 10.222.0.13 () {58 vars in 967 bytes} [Thu Jun 23 20:03:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:03:43.707914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5e28f-d7b7-4b41-8294-4a38300a0299 service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:43.719892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5e28f-d7b7-4b41-8294-4a38300a0299 service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:43.726594 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f274f-32d9-4317-a6f9-a6f65bf7f1f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc53095a45e4136b37fb6e4e677eff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:43.727423 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f274f-32d9-4317-a6f9-a6f65bf7f1f8 service swift] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:43.727721 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f274f-32d9-4317-a6f9-a6f65bf7f1f8 service swift] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:43.728002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f274f-32d9-4317-a6f9-a6f65bf7f1f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:43.737555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f274f-32d9-4317-a6f9-a6f65bf7f1f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:43.739141 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f274f-32d9-4317-a6f9-a6f65bf7f1f8 service swift] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:43.747583 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1239/2459] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 20:03:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 20:03:46.252573 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e488b3-bfc8-4020-8f11-6a43e99a4c70 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:46.254183 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-80e488b3-bfc8-4020-8f11-6a43e99a4c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:46.353923 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e488b3-bfc8-4020-8f11-6a43e99a4c70 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:46.358945 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469297ad-31dc-4981-8f96-2ed4abf25fa7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9ba6d33e8640ec8dcda9971f59c5dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:46.360312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469297ad-31dc-4981-8f96-2ed4abf25fa7 service placement] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:46.360312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469297ad-31dc-4981-8f96-2ed4abf25fa7 service placement] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:46.360312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469297ad-31dc-4981-8f96-2ed4abf25fa7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:46.362205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-469297ad-31dc-4981-8f96-2ed4abf25fa7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:46.374534 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469297ad-31dc-4981-8f96-2ed4abf25fa7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:46.376247 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469297ad-31dc-4981-8f96-2ed4abf25fa7 service placement] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:46.386774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1221/2460] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:03:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:03:46.459041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f274f-32d9-4317-a6f9-a6f65bf7f1f8 service swift] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:46.462746 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-989f274f-32d9-4317-a6f9-a6f65bf7f1f8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:46.490331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f274f-32d9-4317-a6f9-a6f65bf7f1f8 service swift] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:46.497233 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20072863-dd06-468b-a551-fe9b2640e894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:46.498799 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20072863-dd06-468b-a551-fe9b2640e894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:46.499453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20072863-dd06-468b-a551-fe9b2640e894 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:46.499969 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20072863-dd06-468b-a551-fe9b2640e894 admin admin] PATH_INFO: `/v3/users/93501679612c4fc4bfa079af8bb6cfd0` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:46.501551 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20072863-dd06-468b-a551-fe9b2640e894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93501679612c4fc4bfa079af8bb6cfd0)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:46.504404 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20072863-dd06-468b-a551-fe9b2640e894 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:46.728255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-20072863-dd06-468b-a551-fe9b2640e894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93501679612c4fc4bfa079af8bb6cfd0'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:46.744365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-20072863-dd06-468b-a551-fe9b2640e894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93501679612c4fc4bfa079af8bb6cfd0'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:46.799057 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-20072863-dd06-468b-a551-fe9b2640e894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93501679612c4fc4bfa079af8bb6cfd0'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:46.799696 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-20072863-dd06-468b-a551-fe9b2640e894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93501679612c4fc4bfa079af8bb6cfd0'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:46.806295 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:46.808120 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-20072863-dd06-468b-a551-fe9b2640e894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93501679612c4fc4bfa079af8bb6cfd0'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:46.815031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1240/2461] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:03:46 2022] DELETE /identity/v3/users/93501679612c4fc4bfa079af8bb6cfd0 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:03:47.219773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469297ad-31dc-4981-8f96-2ed4abf25fa7 service placement] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:47.233054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469297ad-31dc-4981-8f96-2ed4abf25fa7 service placement] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:47.311695 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d724de-beba-47a0-b2f9-7ec644347a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:47.313311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d724de-beba-47a0-b2f9-7ec644347a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:47.313595 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d724de-beba-47a0-b2f9-7ec644347a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:47.314039 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d724de-beba-47a0-b2f9-7ec644347a98 admin admin] PATH_INFO: `/v3/projects/cc166d65903448cc81553c3410943745` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:47.316487 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d724de-beba-47a0-b2f9-7ec644347a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc166d65903448cc81553c3410943745)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:47.320029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d724de-beba-47a0-b2f9-7ec644347a98 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:47.342572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:47.451515 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-45d724de-beba-47a0-b2f9-7ec644347a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc166d65903448cc81553c3410943745', 'request_id': 'req-45d724de-beba-47a0-b2f9-7ec644347a98'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:47.461475 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-45d724de-beba-47a0-b2f9-7ec644347a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc166d65903448cc81553c3410943745', 'request_id': 'req-45d724de-beba-47a0-b2f9-7ec644347a98'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:47.477184 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-45d724de-beba-47a0-b2f9-7ec644347a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc166d65903448cc81553c3410943745', 'request_id': 'req-45d724de-beba-47a0-b2f9-7ec644347a98'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:47.551960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-45d724de-beba-47a0-b2f9-7ec644347a98 admin admin] The token cache is being invalidate because project cc166d65903448cc81553c3410943745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:03:47.551960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-45d724de-beba-47a0-b2f9-7ec644347a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:47.552525 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-45d724de-beba-47a0-b2f9-7ec644347a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:47.560052 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1222/2462] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:03:47 2022] DELETE /identity/v3/projects/cc166d65903448cc81553c3410943745 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:03:47.561526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a36afd-ba2f-4a79-9e5f-a3e5db1ba4eb None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:47.561967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a36afd-ba2f-4a79-9e5f-a3e5db1ba4eb None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:47.562090 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a36afd-ba2f-4a79-9e5f-a3e5db1ba4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:47.581485 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-c8a36afd-ba2f-4a79-9e5f-a3e5db1ba4eb None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:03:47.583071 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c8a36afd-ba2f-4a79-9e5f-a3e5db1ba4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:47.643828 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1241/2463] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:03:47.652169 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f25d7a-aa76-4300-a849-9474dfb71250 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:47.652463 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f25d7a-aa76-4300-a849-9474dfb71250 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:47.652747 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f25d7a-aa76-4300-a849-9474dfb71250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:47.671496 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-55f25d7a-aa76-4300-a849-9474dfb71250 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:03:47.672686 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-55f25d7a-aa76-4300-a849-9474dfb71250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:47.681634 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1223/2464] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:03:47.685776 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a36afd-ba2f-4a79-9e5f-a3e5db1ba4eb None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:47.695918 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a36afd-ba2f-4a79-9e5f-a3e5db1ba4eb None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:47.701081 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9029e82-05bc-4bc8-905b-fe9c60ec6e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:47.702092 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9029e82-05bc-4bc8-905b-fe9c60ec6e6e admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:47.702663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9029e82-05bc-4bc8-905b-fe9c60ec6e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:47.702950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9029e82-05bc-4bc8-905b-fe9c60ec6e6e admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:47.703693 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9029e82-05bc-4bc8-905b-fe9c60ec6e6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:03:47.704008 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9029e82-05bc-4bc8-905b-fe9c60ec6e6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:47.705666 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9029e82-05bc-4bc8-905b-fe9c60ec6e6e admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:47.718695 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1242/2465] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 20:03:47.730892 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f25d7a-aa76-4300-a849-9474dfb71250 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:47.734644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f25d7a-aa76-4300-a849-9474dfb71250 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:47.746396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15010a-433d-4f14-b2f0-436b459d22f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:47.747075 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15010a-433d-4f14-b2f0-436b459d22f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:47.747363 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15010a-433d-4f14-b2f0-436b459d22f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:47.747642 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15010a-433d-4f14-b2f0-436b459d22f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:47.748372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15010a-433d-4f14-b2f0-436b459d22f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:47.750319 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15010a-433d-4f14-b2f0-436b459d22f4 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:47.887740 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1224/2466] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:03:47 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:03:47.892166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9029e82-05bc-4bc8-905b-fe9c60ec6e6e admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:47.914669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9029e82-05bc-4bc8-905b-fe9c60ec6e6e admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:47.976982 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f4160-3643-46f0-a442-926142c324d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:47.977683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4160-3643-46f0-a442-926142c324d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:47.977971 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4160-3643-46f0-a442-926142c324d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:47.978253 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4160-3643-46f0-a442-926142c324d9 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:47.978942 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f4160-3643-46f0-a442-926142c324d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:47.980874 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f4160-3643-46f0-a442-926142c324d9 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:48.075378 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1243/2467] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:03:47 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:03:48.079302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15010a-433d-4f14-b2f0-436b459d22f4 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:48.091729 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15010a-433d-4f14-b2f0-436b459d22f4 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:48.096671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199a4a2-7186-42ee-a5d0-dc0480162b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:48.097367 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199a4a2-7186-42ee-a5d0-dc0480162b82 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:48.097661 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199a4a2-7186-42ee-a5d0-dc0480162b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:48.097935 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199a4a2-7186-42ee-a5d0-dc0480162b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:48.098855 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199a4a2-7186-42ee-a5d0-dc0480162b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:48.101217 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199a4a2-7186-42ee-a5d0-dc0480162b82 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:48.112430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1225/2468] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:03:48.118987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f4160-3643-46f0-a442-926142c324d9 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:48.129737 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f4160-3643-46f0-a442-926142c324d9 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:48.135327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e86ad7-d4bc-409e-9e3c-b7053fe3d3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:48.135994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e86ad7-d4bc-409e-9e3c-b7053fe3d3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:48.136280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e86ad7-d4bc-409e-9e3c-b7053fe3d3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:48.136586 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e86ad7-d4bc-409e-9e3c-b7053fe3d3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:48.137345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e86ad7-d4bc-409e-9e3c-b7053fe3d3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:48.138957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e86ad7-d4bc-409e-9e3c-b7053fe3d3d1 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:48.151160 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1244/2469] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 20:03:48.155468 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199a4a2-7186-42ee-a5d0-dc0480162b82 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:48.166759 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199a4a2-7186-42ee-a5d0-dc0480162b82 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:48.171728 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1fe66-8c1b-45e6-94fb-ebecbfa294e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:48.172560 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1fe66-8c1b-45e6-94fb-ebecbfa294e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:48.172844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1fe66-8c1b-45e6-94fb-ebecbfa294e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:48.173120 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1fe66-8c1b-45e6-94fb-ebecbfa294e0 admin admin] PATH_INFO: `/v3/projects/8025fed6d21e4e53a94e33fa450d848a/users/86a37c1ebb414a48baab2df7920704c3/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:48.188698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1fe66-8c1b-45e6-94fb-ebecbfa294e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8025fed6d21e4e53a94e33fa450d848a, user_id=86a37c1ebb414a48baab2df7920704c3, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:48.191687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1fe66-8c1b-45e6-94fb-ebecbfa294e0 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:48.293896 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1226/2470] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:03:48 2022] PUT /identity/v3/projects/8025fed6d21e4e53a94e33fa450d848a/users/86a37c1ebb414a48baab2df7920704c3/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:03:48.304224 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9de542-c6a9-46a6-b7e9-3e0ffe6dee6a None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:48.304524 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9de542-c6a9-46a6-b7e9-3e0ffe6dee6a None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:48.304827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9de542-c6a9-46a6-b7e9-3e0ffe6dee6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:48.337194 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-0d9de542-c6a9-46a6-b7e9-3e0ffe6dee6a None None] MFA Rules not processed for user `86a37c1ebb414a48baab2df7920704c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:03:48.338407 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0d9de542-c6a9-46a6-b7e9-3e0ffe6dee6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:48.389195 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:48.406601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1245/2471] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:03:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:03:48.433028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1fe66-8c1b-45e6-94fb-ebecbfa294e0 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:48.434910 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-34d1fe66-8c1b-45e6-94fb-ebecbfa294e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:48.515203 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1fe66-8c1b-45e6-94fb-ebecbfa294e0 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:48.519536 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edf696-63dd-46f2-b900-e58fd63afda0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:48.520304 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edf696-63dd-46f2-b900-e58fd63afda0 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:48.520651 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edf696-63dd-46f2-b900-e58fd63afda0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:48.525991 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edf696-63dd-46f2-b900-e58fd63afda0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:48.534699 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edf696-63dd-46f2-b900-e58fd63afda0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:48.536811 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edf696-63dd-46f2-b900-e58fd63afda0 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:48.556089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1227/2472] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:03:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:03:48.986991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9de542-c6a9-46a6-b7e9-3e0ffe6dee6a None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:48.988467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0d9de542-c6a9-46a6-b7e9-3e0ffe6dee6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:49.088387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9de542-c6a9-46a6-b7e9-3e0ffe6dee6a None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:49.091943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89eb4c9-7a7b-4617-97fe-cd3a276ca2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:49.092591 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eb4c9-7a7b-4617-97fe-cd3a276ca2ca service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:49.092876 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eb4c9-7a7b-4617-97fe-cd3a276ca2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:49.093166 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eb4c9-7a7b-4617-97fe-cd3a276ca2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:49.095014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d89eb4c9-7a7b-4617-97fe-cd3a276ca2ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:49.158751 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89eb4c9-7a7b-4617-97fe-cd3a276ca2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:49.160335 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89eb4c9-7a7b-4617-97fe-cd3a276ca2ca service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:49.170516 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1246/2473] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:03:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:03:53.207588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edf696-63dd-46f2-b900-e58fd63afda0 service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:53.209669 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e8edf696-63dd-46f2-b900-e58fd63afda0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:53.232755 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edf696-63dd-46f2-b900-e58fd63afda0 service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:53.239402 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c21756-cdb4-46f5-be2e-5737242c134f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:53.241945 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c21756-cdb4-46f5-be2e-5737242c134f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:53.251981 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c21756-cdb4-46f5-be2e-5737242c134f admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:53.251981 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c21756-cdb4-46f5-be2e-5737242c134f admin admin] PATH_INFO: `/v3/users/d5157ad1d56246a185f5a25cc6771a6e` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:53.251981 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c21756-cdb4-46f5-be2e-5737242c134f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5157ad1d56246a185f5a25cc6771a6e)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:53.251981 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c21756-cdb4-46f5-be2e-5737242c134f admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:53.491758 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:53.505492 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89eb4c9-7a7b-4617-97fe-cd3a276ca2ca service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:53.507666 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d89eb4c9-7a7b-4617-97fe-cd3a276ca2ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:53.510884 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-07c21756-cdb4-46f5-be2e-5737242c134f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5157ad1d56246a185f5a25cc6771a6e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:53.521207 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89eb4c9-7a7b-4617-97fe-cd3a276ca2ca service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:53.525413 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-07c21756-cdb4-46f5-be2e-5737242c134f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5157ad1d56246a185f5a25cc6771a6e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:53.527100 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b4d3b-be81-4274-a9d6-f7d1b8278e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:53.527972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b4d3b-be81-4274-a9d6-f7d1b8278e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:53.528260 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b4d3b-be81-4274-a9d6-f7d1b8278e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:53.528544 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b4d3b-be81-4274-a9d6-f7d1b8278e95 admin admin] PATH_INFO: `/v3/users/1885d0dd57f84c2d83f4245e5ecfb199` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:53.529894 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b4d3b-be81-4274-a9d6-f7d1b8278e95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1885d0dd57f84c2d83f4245e5ecfb199)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:53.541977 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b4d3b-be81-4274-a9d6-f7d1b8278e95 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:53.623577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-07c21756-cdb4-46f5-be2e-5737242c134f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5157ad1d56246a185f5a25cc6771a6e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:53.624220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-07c21756-cdb4-46f5-be2e-5737242c134f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5157ad1d56246a185f5a25cc6771a6e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:53.632082 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-07c21756-cdb4-46f5-be2e-5737242c134f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5157ad1d56246a185f5a25cc6771a6e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:53.638645 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1228/2474] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:03:53 2022] DELETE /identity/v3/users/d5157ad1d56246a185f5a25cc6771a6e => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:03:53.752049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-670b4d3b-be81-4274-a9d6-f7d1b8278e95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1885d0dd57f84c2d83f4245e5ecfb199'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:53.766276 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-670b4d3b-be81-4274-a9d6-f7d1b8278e95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1885d0dd57f84c2d83f4245e5ecfb199'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:53.867918 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-670b4d3b-be81-4274-a9d6-f7d1b8278e95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1885d0dd57f84c2d83f4245e5ecfb199'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:53.868545 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-670b4d3b-be81-4274-a9d6-f7d1b8278e95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1885d0dd57f84c2d83f4245e5ecfb199'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:53.876562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-670b4d3b-be81-4274-a9d6-f7d1b8278e95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1885d0dd57f84c2d83f4245e5ecfb199'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:53.883382 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1247/2475] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:03:53 2022] DELETE /identity/v3/users/1885d0dd57f84c2d83f4245e5ecfb199 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:03:53.912430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c21756-cdb4-46f5-be2e-5737242c134f admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:53.914162 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-07c21756-cdb4-46f5-be2e-5737242c134f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:54.004845 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c21756-cdb4-46f5-be2e-5737242c134f admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:54.073621 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b12282-5e97-4172-8c96-755d764ccfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:54.073621 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b12282-5e97-4172-8c96-755d764ccfa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:54.073621 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b12282-5e97-4172-8c96-755d764ccfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:54.073621 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b12282-5e97-4172-8c96-755d764ccfa5 admin admin] PATH_INFO: `/v3/projects/403b572a9c7d43db940e143f50370c3e` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:54.075938 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b12282-5e97-4172-8c96-755d764ccfa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=403b572a9c7d43db940e143f50370c3e)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:54.077905 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b12282-5e97-4172-8c96-755d764ccfa5 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:54.242102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b4d3b-be81-4274-a9d6-f7d1b8278e95 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:54.243685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-670b4d3b-be81-4274-a9d6-f7d1b8278e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:54.262104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b1b12282-5e97-4172-8c96-755d764ccfa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '403b572a9c7d43db940e143f50370c3e', 'request_id': 'req-b1b12282-5e97-4172-8c96-755d764ccfa5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:54.270765 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b1b12282-5e97-4172-8c96-755d764ccfa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '403b572a9c7d43db940e143f50370c3e', 'request_id': 'req-b1b12282-5e97-4172-8c96-755d764ccfa5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:54.273934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b4d3b-be81-4274-a9d6-f7d1b8278e95 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:54.278233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b1b12282-5e97-4172-8c96-755d764ccfa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '403b572a9c7d43db940e143f50370c3e', 'request_id': 'req-b1b12282-5e97-4172-8c96-755d764ccfa5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:54.291847 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:54.348616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5de9c4-e9ec-44f8-81e5-74ebc3c10b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:54.351284 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5de9c4-e9ec-44f8-81e5-74ebc3c10b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:54.351751 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5de9c4-e9ec-44f8-81e5-74ebc3c10b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:54.352214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5de9c4-e9ec-44f8-81e5-74ebc3c10b84 admin admin] PATH_INFO: `/v3/projects/7b208adac77d4641a395b186154c37e6` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:54.353733 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5de9c4-e9ec-44f8-81e5-74ebc3c10b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b208adac77d4641a395b186154c37e6)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:54.356681 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5de9c4-e9ec-44f8-81e5-74ebc3c10b84 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:54.389050 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b1b12282-5e97-4172-8c96-755d764ccfa5 admin admin] The token cache is being invalidate because project 403b572a9c7d43db940e143f50370c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:03:54.389373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b1b12282-5e97-4172-8c96-755d764ccfa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:54.394904 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b1b12282-5e97-4172-8c96-755d764ccfa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:54.398588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1229/2476] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:03:53 2022] DELETE /identity/v3/projects/403b572a9c7d43db940e143f50370c3e => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:03:54.410146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dd422-d94d-4cbc-b92a-4e5e11ed8e72 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:54.410536 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dd422-d94d-4cbc-b92a-4e5e11ed8e72 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:54.410910 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dd422-d94d-4cbc-b92a-4e5e11ed8e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:54.434742 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-a32dd422-d94d-4cbc-b92a-4e5e11ed8e72 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:03:54.435974 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-a32dd422-d94d-4cbc-b92a-4e5e11ed8e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:54.446063 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1230/2477] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:03:54.453828 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2e955-768b-4720-bbba-9ef62babc3a9 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:54.454115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2e955-768b-4720-bbba-9ef62babc3a9 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:54.454391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2e955-768b-4720-bbba-9ef62babc3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:54.476387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-a3c2e955-768b-4720-bbba-9ef62babc3a9 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:03:54.477017 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6c5de9c4-e9ec-44f8-81e5-74ebc3c10b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b208adac77d4641a395b186154c37e6', 'request_id': 'req-6c5de9c4-e9ec-44f8-81e5-74ebc3c10b84'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:54.477931 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-a3c2e955-768b-4720-bbba-9ef62babc3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:54.485507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6c5de9c4-e9ec-44f8-81e5-74ebc3c10b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b208adac77d4641a395b186154c37e6', 'request_id': 'req-6c5de9c4-e9ec-44f8-81e5-74ebc3c10b84'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:54.492988 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6c5de9c4-e9ec-44f8-81e5-74ebc3c10b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b208adac77d4641a395b186154c37e6', 'request_id': 'req-6c5de9c4-e9ec-44f8-81e5-74ebc3c10b84'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:54.548273 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1231/2478] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:03:54.552558 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2e955-768b-4720-bbba-9ef62babc3a9 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:54.562917 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2e955-768b-4720-bbba-9ef62babc3a9 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:54.567771 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a3d2d-5a47-444f-89ea-319b928d715d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:54.568495 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a3d2d-5a47-444f-89ea-319b928d715d admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:54.568945 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a3d2d-5a47-444f-89ea-319b928d715d admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:54.569273 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a3d2d-5a47-444f-89ea-319b928d715d admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:54.570560 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a3d2d-5a47-444f-89ea-319b928d715d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:03:54.571072 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a3d2d-5a47-444f-89ea-319b928d715d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:54.573036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a3d2d-5a47-444f-89ea-319b928d715d admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:54.577883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6c5de9c4-e9ec-44f8-81e5-74ebc3c10b84 admin admin] The token cache is being invalidate because project 7b208adac77d4641a395b186154c37e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:03:54.578383 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6c5de9c4-e9ec-44f8-81e5-74ebc3c10b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:54.578933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6c5de9c4-e9ec-44f8-81e5-74ebc3c10b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:54.580689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1248/2479] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:03:54 2022] DELETE /identity/v3/projects/7b208adac77d4641a395b186154c37e6 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:03:54.586081 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5de9c4-e9ec-44f8-81e5-74ebc3c10b84 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:54.589006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-6c5de9c4-e9ec-44f8-81e5-74ebc3c10b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:54.601037 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1232/2480] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 20:03:54.602753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a3d2d-5a47-444f-89ea-319b928d715d admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:54.604571 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-6d7a3d2d-5a47-444f-89ea-319b928d715d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:54.607535 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5de9c4-e9ec-44f8-81e5-74ebc3c10b84 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:54.613424 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c356d-d9f4-4192-a56d-cd02521ca423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:54.617586 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c356d-d9f4-4192-a56d-cd02521ca423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:54.617586 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c356d-d9f4-4192-a56d-cd02521ca423 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:54.617586 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c356d-d9f4-4192-a56d-cd02521ca423 admin admin] PATH_INFO: `/v3/users/06990ef3f1284da49375f8c0313ca30d` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:54.617586 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c356d-d9f4-4192-a56d-cd02521ca423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06990ef3f1284da49375f8c0313ca30d)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:54.618877 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c356d-d9f4-4192-a56d-cd02521ca423 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:54.624365 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a3d2d-5a47-444f-89ea-319b928d715d admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:54.631802 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:54.633206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d9979-da06-4e9f-a993-714fc3303e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:54.633881 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d9979-da06-4e9f-a993-714fc3303e2f admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:54.634162 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d9979-da06-4e9f-a993-714fc3303e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:54.634436 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d9979-da06-4e9f-a993-714fc3303e2f admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:54.635225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d9979-da06-4e9f-a993-714fc3303e2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:54.640545 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d9979-da06-4e9f-a993-714fc3303e2f admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:54.729472 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1233/2481] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:03:54 2022] POST /identity/v3/projects => generated 361 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:03:54.742102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d9979-da06-4e9f-a993-714fc3303e2f admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:54.809674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d9979-da06-4e9f-a993-714fc3303e2f admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:54.814760 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1397c-686b-4879-8fa4-5329adc6a775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:54.815678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1397c-686b-4879-8fa4-5329adc6a775 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:54.815965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1397c-686b-4879-8fa4-5329adc6a775 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:54.816242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1397c-686b-4879-8fa4-5329adc6a775 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:54.816962 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1397c-686b-4879-8fa4-5329adc6a775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:54.819878 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1397c-686b-4879-8fa4-5329adc6a775 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:54.891824 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-592c356d-d9f4-4192-a56d-cd02521ca423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06990ef3f1284da49375f8c0313ca30d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:54.904615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-592c356d-d9f4-4192-a56d-cd02521ca423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06990ef3f1284da49375f8c0313ca30d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:54.919031 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1234/2482] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:03:54 2022] POST /identity/v3/users => generated 281 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:03:54.923021 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1397c-686b-4879-8fa4-5329adc6a775 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:54.933818 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1397c-686b-4879-8fa4-5329adc6a775 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:54.938680 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2ee5b-bce4-4817-b694-6b82e225a7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:54.939341 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2ee5b-bce4-4817-b694-6b82e225a7fd admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:54.939628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2ee5b-bce4-4817-b694-6b82e225a7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:54.939929 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2ee5b-bce4-4817-b694-6b82e225a7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:54.940649 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2ee5b-bce4-4817-b694-6b82e225a7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:54.942563 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2ee5b-bce4-4817-b694-6b82e225a7fd admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:54.962394 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1235/2483] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 20:03:54.971916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2ee5b-bce4-4817-b694-6b82e225a7fd admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:54.984429 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2ee5b-bce4-4817-b694-6b82e225a7fd admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:54.991594 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6aa56-7d36-42b6-9858-9dbf8d6ebcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:54.992262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6aa56-7d36-42b6-9858-9dbf8d6ebcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:54.993731 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6aa56-7d36-42b6-9858-9dbf8d6ebcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:54.993731 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6aa56-7d36-42b6-9858-9dbf8d6ebcb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:54.993731 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6aa56-7d36-42b6-9858-9dbf8d6ebcb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:54.995244 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6aa56-7d36-42b6-9858-9dbf8d6ebcb6 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:55.006305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1236/2484] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 20:03:55.010170 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6aa56-7d36-42b6-9858-9dbf8d6ebcb6 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:55.014554 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-592c356d-d9f4-4192-a56d-cd02521ca423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06990ef3f1284da49375f8c0313ca30d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:55.016679 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-592c356d-d9f4-4192-a56d-cd02521ca423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06990ef3f1284da49375f8c0313ca30d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:55.019977 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6aa56-7d36-42b6-9858-9dbf8d6ebcb6 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:55.023920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-592c356d-d9f4-4192-a56d-cd02521ca423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06990ef3f1284da49375f8c0313ca30d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:55.024931 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba2592-d08a-474b-b579-5bb4c53c67d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:55.025871 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba2592-d08a-474b-b579-5bb4c53c67d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:55.026160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba2592-d08a-474b-b579-5bb4c53c67d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:55.026441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba2592-d08a-474b-b579-5bb4c53c67d6 admin admin] PATH_INFO: `/v3/projects/c1b53aa7e132475ca8fd13fb1f0f5b35/users/cf05e94fdae74107bee1b7568ee8753e/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:55.030241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1249/2485] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:03:54 2022] DELETE /identity/v3/users/06990ef3f1284da49375f8c0313ca30d => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:03:55.045490 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba2592-d08a-474b-b579-5bb4c53c67d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b53aa7e132475ca8fd13fb1f0f5b35, user_id=cf05e94fdae74107bee1b7568ee8753e, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:55.045490 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba2592-d08a-474b-b579-5bb4c53c67d6 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:55.126681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1237/2486] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:03:55 2022] PUT /identity/v3/projects/c1b53aa7e132475ca8fd13fb1f0f5b35/users/cf05e94fdae74107bee1b7568ee8753e/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:03:55.137499 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2bdbe-6cef-4fb3-bafa-571391a0cc3b None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:55.137794 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2bdbe-6cef-4fb3-bafa-571391a0cc3b None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:55.138079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2bdbe-6cef-4fb3-bafa-571391a0cc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:55.167395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-1cb2bdbe-6cef-4fb3-bafa-571391a0cc3b None None] MFA Rules not processed for user `cf05e94fdae74107bee1b7568ee8753e`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:03:55.169636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-1cb2bdbe-6cef-4fb3-bafa-571391a0cc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:55.174400 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:55.247755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1250/2487] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:03:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:03:55.252340 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba2592-d08a-474b-b579-5bb4c53c67d6 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:55.254056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-64ba2592-d08a-474b-b579-5bb4c53c67d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:55.317638 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2bdbe-6cef-4fb3-bafa-571391a0cc3b None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:55.319420 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-1cb2bdbe-6cef-4fb3-bafa-571391a0cc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:55.319907 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba2592-d08a-474b-b579-5bb4c53c67d6 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:55.324911 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a6f81-4c6a-4048-a3f6-bb332a62d5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:55.325645 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a6f81-4c6a-4048-a3f6-bb332a62d5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:55.326135 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a6f81-4c6a-4048-a3f6-bb332a62d5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:55.326272 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a6f81-4c6a-4048-a3f6-bb332a62d5a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:55.326996 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a6f81-4c6a-4048-a3f6-bb332a62d5a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:55.329067 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a6f81-4c6a-4048-a3f6-bb332a62d5a5 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:55.336302 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2bdbe-6cef-4fb3-bafa-571391a0cc3b None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:55.341285 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdd912-54f0-44dd-b51a-da775639c149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:55.342299 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdd912-54f0-44dd-b51a-da775639c149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:55.342650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdd912-54f0-44dd-b51a-da775639c149 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:55.342939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdd912-54f0-44dd-b51a-da775639c149 admin admin] PATH_INFO: `/v3/projects/264a29429dfc4ebfbfc00a485237f9ed` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:55.344625 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdd912-54f0-44dd-b51a-da775639c149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=264a29429dfc4ebfbfc00a485237f9ed)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:55.347377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdd912-54f0-44dd-b51a-da775639c149 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:55.403165 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1238/2488] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:03:55 2022] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:03:55.407179 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a6f81-4c6a-4048-a3f6-bb332a62d5a5 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:55.447756 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d3cdd912-54f0-44dd-b51a-da775639c149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '264a29429dfc4ebfbfc00a485237f9ed', 'request_id': 'req-d3cdd912-54f0-44dd-b51a-da775639c149'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:55.455978 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d3cdd912-54f0-44dd-b51a-da775639c149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '264a29429dfc4ebfbfc00a485237f9ed', 'request_id': 'req-d3cdd912-54f0-44dd-b51a-da775639c149'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:55.462092 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d3cdd912-54f0-44dd-b51a-da775639c149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '264a29429dfc4ebfbfc00a485237f9ed', 'request_id': 'req-d3cdd912-54f0-44dd-b51a-da775639c149'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:55.471092 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a6f81-4c6a-4048-a3f6-bb332a62d5a5 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:55.502167 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:55.527489 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93451195-ef16-4774-bdfb-6988d960fba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:55.528152 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93451195-ef16-4774-bdfb-6988d960fba1 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:55.528436 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93451195-ef16-4774-bdfb-6988d960fba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:55.528715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93451195-ef16-4774-bdfb-6988d960fba1 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:55.529447 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93451195-ef16-4774-bdfb-6988d960fba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:55.531508 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93451195-ef16-4774-bdfb-6988d960fba1 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:55.572171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d3cdd912-54f0-44dd-b51a-da775639c149 admin admin] The token cache is being invalidate because project 264a29429dfc4ebfbfc00a485237f9ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:03:55.572462 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d3cdd912-54f0-44dd-b51a-da775639c149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:55.573090 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d3cdd912-54f0-44dd-b51a-da775639c149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:55.574696 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1251/2489] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:03:55 2022] DELETE /identity/v3/projects/264a29429dfc4ebfbfc00a485237f9ed => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:03:55.579303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f72769-137e-4131-a7cb-788f48b9c487 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:55.579868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f72769-137e-4131-a7cb-788f48b9c487 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:55.579868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f72769-137e-4131-a7cb-788f48b9c487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:55.598786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-79f72769-137e-4131-a7cb-788f48b9c487 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:03:55.601623 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-79f72769-137e-4131-a7cb-788f48b9c487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:55.610309 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1252/2490] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:03:55.623957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2543824-93f2-476b-84ac-f1ae0c9d5f69 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:55.624306 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2543824-93f2-476b-84ac-f1ae0c9d5f69 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:55.624613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2543824-93f2-476b-84ac-f1ae0c9d5f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:55.635714 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1239/2491] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:03:55 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:03:55.639792 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93451195-ef16-4774-bdfb-6988d960fba1 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:55.641441 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-93451195-ef16-4774-bdfb-6988d960fba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:55.642286 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-e2543824-93f2-476b-84ac-f1ae0c9d5f69 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:03:55.643456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e2543824-93f2-476b-84ac-f1ae0c9d5f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:55.652196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1253/2492] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:03:55.654055 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93451195-ef16-4774-bdfb-6988d960fba1 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:55.656074 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2543824-93f2-476b-84ac-f1ae0c9d5f69 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:55.659003 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1f199-fd38-4c88-aede-201dbfb61783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:55.659659 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1f199-fd38-4c88-aede-201dbfb61783 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:55.659977 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1f199-fd38-4c88-aede-201dbfb61783 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:55.660294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1f199-fd38-4c88-aede-201dbfb61783 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:55.661001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1f199-fd38-4c88-aede-201dbfb61783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:55.663833 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1f199-fd38-4c88-aede-201dbfb61783 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:55.665825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2543824-93f2-476b-84ac-f1ae0c9d5f69 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:55.670508 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844da16-ebf4-47e4-82b0-29513eab8a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:55.671157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844da16-ebf4-47e4-82b0-29513eab8a88 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:55.671445 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844da16-ebf4-47e4-82b0-29513eab8a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:55.671734 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844da16-ebf4-47e4-82b0-29513eab8a88 admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:55.672452 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844da16-ebf4-47e4-82b0-29513eab8a88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:03:55.672762 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844da16-ebf4-47e4-82b0-29513eab8a88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:55.677257 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1240/2493] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:03:55.677414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844da16-ebf4-47e4-82b0-29513eab8a88 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:55.678309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1f199-fd38-4c88-aede-201dbfb61783 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:55.686171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1254/2494] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 20:03:55.688012 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1f199-fd38-4c88-aede-201dbfb61783 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:55.690349 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844da16-ebf4-47e4-82b0-29513eab8a88 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:55.692944 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121bf22-ad12-4be9-bf94-2d38d2bb49da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:55.694377 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121bf22-ad12-4be9-bf94-2d38d2bb49da admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:55.694818 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121bf22-ad12-4be9-bf94-2d38d2bb49da admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:55.695132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121bf22-ad12-4be9-bf94-2d38d2bb49da admin admin] PATH_INFO: `/v3/projects/503c92c4e569449dae08bdd5ee37a7c1/users/7af2df9746cd4ae497a1cb20d1a7c6d9/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:55.701309 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844da16-ebf4-47e4-82b0-29513eab8a88 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:55.705822 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86557195-6f78-4759-9f37-cb796f907ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:55.706456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86557195-6f78-4759-9f37-cb796f907ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:55.706738 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86557195-6f78-4759-9f37-cb796f907ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:55.709839 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86557195-6f78-4759-9f37-cb796f907ab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:55.709839 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86557195-6f78-4759-9f37-cb796f907ab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:55.710855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86557195-6f78-4759-9f37-cb796f907ab8 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:55.711280 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121bf22-ad12-4be9-bf94-2d38d2bb49da admin admin] RBAC: Authorizing `identity:create_grant(project_id=503c92c4e569449dae08bdd5ee37a7c1, user_id=7af2df9746cd4ae497a1cb20d1a7c6d9, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:55.714049 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121bf22-ad12-4be9-bf94-2d38d2bb49da admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:55.783980 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1241/2495] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:03:55 2022] PUT /identity/v3/projects/503c92c4e569449dae08bdd5ee37a7c1/users/7af2df9746cd4ae497a1cb20d1a7c6d9/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:03:55.787860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121bf22-ad12-4be9-bf94-2d38d2bb49da admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:55.806690 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1255/2496] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:03:55 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:03:55.811083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86557195-6f78-4759-9f37-cb796f907ab8 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:55.853561 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121bf22-ad12-4be9-bf94-2d38d2bb49da admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:55.858915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:55.879393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86557195-6f78-4759-9f37-cb796f907ab8 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:55.884686 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:55.885321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe4649-ae09-4336-854c-2f6c2ea51b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:55.886037 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe4649-ae09-4336-854c-2f6c2ea51b71 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:55.886335 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe4649-ae09-4336-854c-2f6c2ea51b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:55.886629 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe4649-ae09-4336-854c-2f6c2ea51b71 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:55.887341 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe4649-ae09-4336-854c-2f6c2ea51b71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:55.889342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe4649-ae09-4336-854c-2f6c2ea51b71 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:55.918760 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a386c-3063-4eab-93a9-1847c6d8fa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:55.919488 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a386c-3063-4eab-93a9-1847c6d8fa92 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:55.919784 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a386c-3063-4eab-93a9-1847c6d8fa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:55.920067 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a386c-3063-4eab-93a9-1847c6d8fa92 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:55.920816 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a386c-3063-4eab-93a9-1847c6d8fa92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:55.922432 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a386c-3063-4eab-93a9-1847c6d8fa92 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:55.932474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1242/2497] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 20:03:55.936541 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a386c-3063-4eab-93a9-1847c6d8fa92 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:55.946403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a386c-3063-4eab-93a9-1847c6d8fa92 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:55.951049 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28064c75-3f57-476a-ae2e-bf15aeb9f41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:55.951891 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28064c75-3f57-476a-ae2e-bf15aeb9f41b admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:55.952177 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28064c75-3f57-476a-ae2e-bf15aeb9f41b admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:55.952466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28064c75-3f57-476a-ae2e-bf15aeb9f41b admin admin] PATH_INFO: `/v3/projects/503c92c4e569449dae08bdd5ee37a7c1/users/7af2df9746cd4ae497a1cb20d1a7c6d9/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:55.954398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28064c75-3f57-476a-ae2e-bf15aeb9f41b admin admin] RBAC: Authorizing `identity:create_grant(project_id=503c92c4e569449dae08bdd5ee37a7c1, user_id=7af2df9746cd4ae497a1cb20d1a7c6d9, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:55.957453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1256/2498] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:03:55 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:03:55.961364 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28064c75-3f57-476a-ae2e-bf15aeb9f41b admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:55.962697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe4649-ae09-4336-854c-2f6c2ea51b71 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:55.968637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1243/2499] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:03:55 2022] PUT /identity/v3/projects/503c92c4e569449dae08bdd5ee37a7c1/users/7af2df9746cd4ae497a1cb20d1a7c6d9/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:03:55.973732 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe4649-ae09-4336-854c-2f6c2ea51b71 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:55.980510 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f49fdf-8fe8-434c-ba42-291270ecbc60 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:55.980804 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f49fdf-8fe8-434c-ba42-291270ecbc60 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:55.981123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f49fdf-8fe8-434c-ba42-291270ecbc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:56.008661 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-e7f49fdf-8fe8-434c-ba42-291270ecbc60 None None] MFA Rules not processed for user `7af2df9746cd4ae497a1cb20d1a7c6d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:03:56.009927 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e7f49fdf-8fe8-434c-ba42-291270ecbc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:56.030902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd4905-2418-4eef-9c79-a2d1ed692cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:56.031575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd4905-2418-4eef-9c79-a2d1ed692cfc admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:56.031860 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd4905-2418-4eef-9c79-a2d1ed692cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:56.032137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd4905-2418-4eef-9c79-a2d1ed692cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:56.032862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd4905-2418-4eef-9c79-a2d1ed692cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:56.034654 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd4905-2418-4eef-9c79-a2d1ed692cfc admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:56.044661 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1257/2500] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 20:03:56.048624 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd4905-2418-4eef-9c79-a2d1ed692cfc admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:56.059036 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd4905-2418-4eef-9c79-a2d1ed692cfc admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:56.063856 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1272ce-b729-421f-ae96-20ef80275a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:56.064498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1272ce-b729-421f-ae96-20ef80275a96 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:56.064790 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1272ce-b729-421f-ae96-20ef80275a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:56.065075 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1272ce-b729-421f-ae96-20ef80275a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:56.065829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1272ce-b729-421f-ae96-20ef80275a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:56.067431 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1272ce-b729-421f-ae96-20ef80275a96 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:56.078325 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1258/2501] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 20:03:56.082332 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1272ce-b729-421f-ae96-20ef80275a96 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:56.082495 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1244/2502] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:03:55 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:03:56.092245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1272ce-b729-421f-ae96-20ef80275a96 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:56.097002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f49fdf-8fe8-434c-ba42-291270ecbc60 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:56.097283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50bd55-be60-4f6b-bd74-f7e2622dde12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:56.098187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50bd55-be60-4f6b-bd74-f7e2622dde12 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:56.098404 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e7f49fdf-8fe8-434c-ba42-291270ecbc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:56.098519 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50bd55-be60-4f6b-bd74-f7e2622dde12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:56.098743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50bd55-be60-4f6b-bd74-f7e2622dde12 admin admin] PATH_INFO: `/v3/projects/5f5eb13e3140478eb348b08b11f18c3b/users/842655da97c74216bd2288d598fa321c/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:56.104816 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:56.114000 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50bd55-be60-4f6b-bd74-f7e2622dde12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f5eb13e3140478eb348b08b11f18c3b, user_id=842655da97c74216bd2288d598fa321c, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:56.117279 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50bd55-be60-4f6b-bd74-f7e2622dde12 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:56.155370 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f49fdf-8fe8-434c-ba42-291270ecbc60 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:56.159008 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f52d98-8237-41e4-92d4-c6cd3fcde39e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:56.159645 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f52d98-8237-41e4-92d4-c6cd3fcde39e service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:56.159927 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f52d98-8237-41e4-92d4-c6cd3fcde39e service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:56.160203 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f52d98-8237-41e4-92d4-c6cd3fcde39e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:56.168974 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f52d98-8237-41e4-92d4-c6cd3fcde39e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:56.170460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f52d98-8237-41e4-92d4-c6cd3fcde39e service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:56.180248 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1245/2503] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:03:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:03:56.189890 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1259/2504] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:03:56 2022] PUT /identity/v3/projects/5f5eb13e3140478eb348b08b11f18c3b/users/842655da97c74216bd2288d598fa321c/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:03:56.195663 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f86b2-fa81-43c2-a61f-796e7ed78ea3 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:56.196229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f86b2-fa81-43c2-a61f-796e7ed78ea3 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:56.197026 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f86b2-fa81-43c2-a61f-796e7ed78ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:56.214040 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-ef8f86b2-fa81-43c2-a61f-796e7ed78ea3 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:03:56.215236 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ef8f86b2-fa81-43c2-a61f-796e7ed78ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:56.277913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1246/2505] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:03:56.290086 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50bd55-be60-4f6b-bd74-f7e2622dde12 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:56.291987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0e50bd55-be60-4f6b-bd74-f7e2622dde12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:56.354908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50bd55-be60-4f6b-bd74-f7e2622dde12 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:56.358705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b92d3-ecfe-4d61-bd1e-151c109f0fbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:56.359377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b92d3-ecfe-4d61-bd1e-151c109f0fbe service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:56.359662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b92d3-ecfe-4d61-bd1e-151c109f0fbe service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:56.359947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b92d3-ecfe-4d61-bd1e-151c109f0fbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:56.370506 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b92d3-ecfe-4d61-bd1e-151c109f0fbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:56.371949 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b92d3-ecfe-4d61-bd1e-151c109f0fbe service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:56.382433 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1260/2506] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:03:57.143822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f86b2-fa81-43c2-a61f-796e7ed78ea3 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:57.154264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f86b2-fa81-43c2-a61f-796e7ed78ea3 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:57.158721 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d61e11-2716-421f-9a0b-e3f43ba9ba35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:57.159636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d61e11-2716-421f-9a0b-e3f43ba9ba35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:57.159910 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d61e11-2716-421f-9a0b-e3f43ba9ba35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:57.160182 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d61e11-2716-421f-9a0b-e3f43ba9ba35 admin admin] PATH_INFO: `/v3/users/cf05e94fdae74107bee1b7568ee8753e` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:57.161393 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d61e11-2716-421f-9a0b-e3f43ba9ba35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf05e94fdae74107bee1b7568ee8753e)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:57.164466 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d61e11-2716-421f-9a0b-e3f43ba9ba35 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:57.361869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c8d61e11-2716-421f-9a0b-e3f43ba9ba35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf05e94fdae74107bee1b7568ee8753e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:57.374893 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c8d61e11-2716-421f-9a0b-e3f43ba9ba35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf05e94fdae74107bee1b7568ee8753e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:57.450126 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c8d61e11-2716-421f-9a0b-e3f43ba9ba35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf05e94fdae74107bee1b7568ee8753e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:57.450869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c8d61e11-2716-421f-9a0b-e3f43ba9ba35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf05e94fdae74107bee1b7568ee8753e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:57.458256 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c8d61e11-2716-421f-9a0b-e3f43ba9ba35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf05e94fdae74107bee1b7568ee8753e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:57.464472 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1247/2507] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:03:57 2022] DELETE /identity/v3/users/cf05e94fdae74107bee1b7568ee8753e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:03:57.468932 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a90077-8bbb-4f05-9fb8-f610f459e208 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:57.469427 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a90077-8bbb-4f05-9fb8-f610f459e208 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:57.469582 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a90077-8bbb-4f05-9fb8-f610f459e208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:57.487624 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-25a90077-8bbb-4f05-9fb8-f610f459e208 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:03:57.489006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-25a90077-8bbb-4f05-9fb8-f610f459e208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:57.522004 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:57.555501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1261/2508] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:03:57.565207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d61e11-2716-421f-9a0b-e3f43ba9ba35 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:57.566651 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-c8d61e11-2716-421f-9a0b-e3f43ba9ba35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:57.573247 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:57.632579 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d61e11-2716-421f-9a0b-e3f43ba9ba35 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:57.636912 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b41011-3b5f-4f86-be5c-4ebda7ce8cbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:57.637589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b41011-3b5f-4f86-be5c-4ebda7ce8cbd service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:57.637914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b41011-3b5f-4f86-be5c-4ebda7ce8cbd service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:57.638174 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b41011-3b5f-4f86-be5c-4ebda7ce8cbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:57.648190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b41011-3b5f-4f86-be5c-4ebda7ce8cbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:57.649657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b41011-3b5f-4f86-be5c-4ebda7ce8cbd service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:57.659204 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1248/2509] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:03:58.100683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a90077-8bbb-4f05-9fb8-f610f459e208 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:58.102170 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-25a90077-8bbb-4f05-9fb8-f610f459e208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:58.115000 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a90077-8bbb-4f05-9fb8-f610f459e208 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:58.120600 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a940ca-a89c-408f-b47b-eae606b4e38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:58.122285 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a940ca-a89c-408f-b47b-eae606b4e38d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:58.122802 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a940ca-a89c-408f-b47b-eae606b4e38d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:58.123177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a940ca-a89c-408f-b47b-eae606b4e38d admin admin] PATH_INFO: `/v3/projects/c1b53aa7e132475ca8fd13fb1f0f5b35` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:58.124535 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a940ca-a89c-408f-b47b-eae606b4e38d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b53aa7e132475ca8fd13fb1f0f5b35)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:58.126610 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a940ca-a89c-408f-b47b-eae606b4e38d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:58.276069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-61a940ca-a89c-408f-b47b-eae606b4e38d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b53aa7e132475ca8fd13fb1f0f5b35', 'request_id': 'req-61a940ca-a89c-408f-b47b-eae606b4e38d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:58.282309 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-61a940ca-a89c-408f-b47b-eae606b4e38d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b53aa7e132475ca8fd13fb1f0f5b35', 'request_id': 'req-61a940ca-a89c-408f-b47b-eae606b4e38d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:58.291603 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-61a940ca-a89c-408f-b47b-eae606b4e38d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b53aa7e132475ca8fd13fb1f0f5b35', 'request_id': 'req-61a940ca-a89c-408f-b47b-eae606b4e38d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:58.384681 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-61a940ca-a89c-408f-b47b-eae606b4e38d admin admin] The token cache is being invalidate because project c1b53aa7e132475ca8fd13fb1f0f5b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:03:58.384991 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-61a940ca-a89c-408f-b47b-eae606b4e38d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:58.385822 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-61a940ca-a89c-408f-b47b-eae606b4e38d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:58.387717 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1262/2510] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:03:58 2022] DELETE /identity/v3/projects/c1b53aa7e132475ca8fd13fb1f0f5b35 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:03:58.391672 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b41011-3b5f-4f86-be5c-4ebda7ce8cbd service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:58.402059 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b41011-3b5f-4f86-be5c-4ebda7ce8cbd service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:58.470591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b499bd9-6981-4591-b004-9d0819abf172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:58.471952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b499bd9-6981-4591-b004-9d0819abf172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:58.472242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b499bd9-6981-4591-b004-9d0819abf172 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:58.472522 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b499bd9-6981-4591-b004-9d0819abf172 admin admin] PATH_INFO: `/v3/users/7af2df9746cd4ae497a1cb20d1a7c6d9` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:58.473917 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b499bd9-6981-4591-b004-9d0819abf172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af2df9746cd4ae497a1cb20d1a7c6d9)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:58.476739 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b499bd9-6981-4591-b004-9d0819abf172 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:58.670246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4b499bd9-6981-4591-b004-9d0819abf172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af2df9746cd4ae497a1cb20d1a7c6d9'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:58.687408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4b499bd9-6981-4591-b004-9d0819abf172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af2df9746cd4ae497a1cb20d1a7c6d9'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:58.755503 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4b499bd9-6981-4591-b004-9d0819abf172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af2df9746cd4ae497a1cb20d1a7c6d9'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:58.756394 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4b499bd9-6981-4591-b004-9d0819abf172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af2df9746cd4ae497a1cb20d1a7c6d9'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:58.771691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4b499bd9-6981-4591-b004-9d0819abf172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af2df9746cd4ae497a1cb20d1a7c6d9'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:58.774374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1249/2511] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:03:58 2022] DELETE /identity/v3/users/7af2df9746cd4ae497a1cb20d1a7c6d9 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:03:58.838446 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a940ca-a89c-408f-b47b-eae606b4e38d admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:58.840128 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-61a940ca-a89c-408f-b47b-eae606b4e38d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:58.854754 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a940ca-a89c-408f-b47b-eae606b4e38d admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:58.949140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7baef-9e87-4491-bf9d-297fc4e0bdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:58.950943 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7baef-9e87-4491-bf9d-297fc4e0bdea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:58.951242 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7baef-9e87-4491-bf9d-297fc4e0bdea admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:58.951526 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7baef-9e87-4491-bf9d-297fc4e0bdea admin admin] PATH_INFO: `/v3/users/86a37c1ebb414a48baab2df7920704c3` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:58.953542 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7baef-9e87-4491-bf9d-297fc4e0bdea admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a37c1ebb414a48baab2df7920704c3)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:58.958657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7baef-9e87-4491-bf9d-297fc4e0bdea admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:59.163320 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7ae7baef-9e87-4491-bf9d-297fc4e0bdea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a37c1ebb414a48baab2df7920704c3'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:59.172455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:59.177213 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7ae7baef-9e87-4491-bf9d-297fc4e0bdea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a37c1ebb414a48baab2df7920704c3'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:59.246743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7ae7baef-9e87-4491-bf9d-297fc4e0bdea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a37c1ebb414a48baab2df7920704c3'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:59.247431 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7ae7baef-9e87-4491-bf9d-297fc4e0bdea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a37c1ebb414a48baab2df7920704c3'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:59.255296 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-7ae7baef-9e87-4491-bf9d-297fc4e0bdea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a37c1ebb414a48baab2df7920704c3'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:59.263217 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1263/2512] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:03:58 2022] DELETE /identity/v3/users/86a37c1ebb414a48baab2df7920704c3 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:03:59.267819 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478ebb3-b950-447a-b22e-dc67a23e5d5b None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:59.268372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478ebb3-b950-447a-b22e-dc67a23e5d5b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:59.268841 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478ebb3-b950-447a-b22e-dc67a23e5d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:59.293463 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-f478ebb3-b950-447a-b22e-dc67a23e5d5b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:03:59.296462 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f478ebb3-b950-447a-b22e-dc67a23e5d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:59.342914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:03:59.406992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1250/2513] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:03:59.417624 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7baef-9e87-4491-bf9d-297fc4e0bdea admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:59.419146 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7ae7baef-9e87-4491-bf9d-297fc4e0bdea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:59.480117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478ebb3-b950-447a-b22e-dc67a23e5d5b None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:03:59.480652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f478ebb3-b950-447a-b22e-dc67a23e5d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:03:59.496431 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7baef-9e87-4491-bf9d-297fc4e0bdea admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:59.502082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71104a-2f9e-4e39-8699-bf2886266ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:59.502836 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71104a-2f9e-4e39-8699-bf2886266ace service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:59.503183 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71104a-2f9e-4e39-8699-bf2886266ace service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:59.504225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71104a-2f9e-4e39-8699-bf2886266ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:59.505206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478ebb3-b950-447a-b22e-dc67a23e5d5b None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:03:59.510805 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951199c-e9ba-4470-b6b0-2d2fdf39f3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:03:59.511849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951199c-e9ba-4470-b6b0-2d2fdf39f3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:59.512317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951199c-e9ba-4470-b6b0-2d2fdf39f3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:59.512695 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951199c-e9ba-4470-b6b0-2d2fdf39f3c5 admin admin] PATH_INFO: `/v3/projects/503c92c4e569449dae08bdd5ee37a7c1` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:59.514121 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951199c-e9ba-4470-b6b0-2d2fdf39f3c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=503c92c4e569449dae08bdd5ee37a7c1)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:59.516285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951199c-e9ba-4470-b6b0-2d2fdf39f3c5 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:59.528115 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71104a-2f9e-4e39-8699-bf2886266ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:03:59.529908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71104a-2f9e-4e39-8699-bf2886266ace service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:03:59.573419 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1264/2514] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:03:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:03:59.711265 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-2951199c-e9ba-4470-b6b0-2d2fdf39f3c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '503c92c4e569449dae08bdd5ee37a7c1', 'request_id': 'req-2951199c-e9ba-4470-b6b0-2d2fdf39f3c5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:59.722023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-2951199c-e9ba-4470-b6b0-2d2fdf39f3c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '503c92c4e569449dae08bdd5ee37a7c1', 'request_id': 'req-2951199c-e9ba-4470-b6b0-2d2fdf39f3c5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:59.730643 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-2951199c-e9ba-4470-b6b0-2d2fdf39f3c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '503c92c4e569449dae08bdd5ee37a7c1', 'request_id': 'req-2951199c-e9ba-4470-b6b0-2d2fdf39f3c5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:59.837249 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-2951199c-e9ba-4470-b6b0-2d2fdf39f3c5 admin admin] The token cache is being invalidate because project 503c92c4e569449dae08bdd5ee37a7c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:03:59.837834 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-2951199c-e9ba-4470-b6b0-2d2fdf39f3c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:59.838528 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-2951199c-e9ba-4470-b6b0-2d2fdf39f3c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:03:59.841593 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1251/2515] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:03:59 2022] DELETE /identity/v3/projects/503c92c4e569449dae08bdd5ee37a7c1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:03:59.846471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558e329-ebc5-4be6-a450-a3ea000139a0 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:03:59.846999 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558e329-ebc5-4be6-a450-a3ea000139a0 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:03:59.847165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558e329-ebc5-4be6-a450-a3ea000139a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:03:59.870559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-1558e329-ebc5-4be6-a450-a3ea000139a0 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:03:59.871930 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-1558e329-ebc5-4be6-a450-a3ea000139a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:00.000587 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1265/2516] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:00.001837 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031ee11-5261-4dcc-af7f-2b6aafb4030d None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:00.002132 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031ee11-5261-4dcc-af7f-2b6aafb4030d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:00.002840 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031ee11-5261-4dcc-af7f-2b6aafb4030d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:00.026943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-e031ee11-5261-4dcc-af7f-2b6aafb4030d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:00.028198 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e031ee11-5261-4dcc-af7f-2b6aafb4030d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:00.036787 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1252/2517] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:00.048877 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558e329-ebc5-4be6-a450-a3ea000139a0 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:00.059817 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558e329-ebc5-4be6-a450-a3ea000139a0 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:00.064583 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cacbc-f0ba-45bc-8733-fe3f9ffe6182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:00.065423 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cacbc-f0ba-45bc-8733-fe3f9ffe6182 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:00.065711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cacbc-f0ba-45bc-8733-fe3f9ffe6182 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:00.065994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cacbc-f0ba-45bc-8733-fe3f9ffe6182 admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:00.066741 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cacbc-f0ba-45bc-8733-fe3f9ffe6182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:04:00.067058 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cacbc-f0ba-45bc-8733-fe3f9ffe6182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:00.068723 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cacbc-f0ba-45bc-8733-fe3f9ffe6182 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:00.081622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1266/2518] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 20:04:00.086630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031ee11-5261-4dcc-af7f-2b6aafb4030d None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:00.096811 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031ee11-5261-4dcc-af7f-2b6aafb4030d None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:00.102251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411112e7-e5b6-49b6-b8d1-67f76dc83db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:00.103034 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411112e7-e5b6-49b6-b8d1-67f76dc83db6 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:00.103381 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411112e7-e5b6-49b6-b8d1-67f76dc83db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:00.103750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411112e7-e5b6-49b6-b8d1-67f76dc83db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:00.104642 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411112e7-e5b6-49b6-b8d1-67f76dc83db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:00.106856 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411112e7-e5b6-49b6-b8d1-67f76dc83db6 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:00.118639 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cacbc-f0ba-45bc-8733-fe3f9ffe6182 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:00.121275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-6e7cacbc-f0ba-45bc-8733-fe3f9ffe6182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:00.136153 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cacbc-f0ba-45bc-8733-fe3f9ffe6182 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:00.143088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ad5e2-a077-400e-8225-2c40d6a76c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:00.144209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ad5e2-a077-400e-8225-2c40d6a76c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:00.144527 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ad5e2-a077-400e-8225-2c40d6a76c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:00.144838 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ad5e2-a077-400e-8225-2c40d6a76c7d admin admin] PATH_INFO: `/v3/projects/8025fed6d21e4e53a94e33fa450d848a` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:00.146108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ad5e2-a077-400e-8225-2c40d6a76c7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8025fed6d21e4e53a94e33fa450d848a)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:00.149128 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ad5e2-a077-400e-8225-2c40d6a76c7d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:00.229301 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1253/2519] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:00 2022] POST /identity/v3/projects => generated 369 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:00.229301 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411112e7-e5b6-49b6-b8d1-67f76dc83db6 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:00.295599 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-0e4ad5e2-a077-400e-8225-2c40d6a76c7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8025fed6d21e4e53a94e33fa450d848a', 'request_id': 'req-0e4ad5e2-a077-400e-8225-2c40d6a76c7d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:00.303119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-0e4ad5e2-a077-400e-8225-2c40d6a76c7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8025fed6d21e4e53a94e33fa450d848a', 'request_id': 'req-0e4ad5e2-a077-400e-8225-2c40d6a76c7d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:00.313914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-0e4ad5e2-a077-400e-8225-2c40d6a76c7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8025fed6d21e4e53a94e33fa450d848a', 'request_id': 'req-0e4ad5e2-a077-400e-8225-2c40d6a76c7d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:00.321227 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411112e7-e5b6-49b6-b8d1-67f76dc83db6 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:00.324701 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:00.349626 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:00.385797 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61420329-c03e-4dff-9765-c4dce173318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:00.386602 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61420329-c03e-4dff-9765-c4dce173318e admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:00.386961 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61420329-c03e-4dff-9765-c4dce173318e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:00.387316 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61420329-c03e-4dff-9765-c4dce173318e admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:00.388122 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61420329-c03e-4dff-9765-c4dce173318e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:00.390252 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61420329-c03e-4dff-9765-c4dce173318e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:00.402062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-0e4ad5e2-a077-400e-8225-2c40d6a76c7d admin admin] The token cache is being invalidate because project 8025fed6d21e4e53a94e33fa450d848a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:04:00.402062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-0e4ad5e2-a077-400e-8225-2c40d6a76c7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:00.405429 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-0e4ad5e2-a077-400e-8225-2c40d6a76c7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:00.405429 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1267/2520] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:04:00 2022] DELETE /identity/v3/projects/8025fed6d21e4e53a94e33fa450d848a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:00.409348 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00f2df-d8f9-4140-8720-b296b1498e4a None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:00.409642 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00f2df-d8f9-4140-8720-b296b1498e4a None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:00.409927 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00f2df-d8f9-4140-8720-b296b1498e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:00.429837 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-fb00f2df-d8f9-4140-8720-b296b1498e4a None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:00.431060 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-fb00f2df-d8f9-4140-8720-b296b1498e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:00.444597 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1268/2521] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:00.447555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f0c6b-d8e1-49e1-887b-0f1ecf531e2e None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:00.447851 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f0c6b-d8e1-49e1-887b-0f1ecf531e2e None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:00.448138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f0c6b-d8e1-49e1-887b-0f1ecf531e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:00.468735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-950f0c6b-d8e1-49e1-887b-0f1ecf531e2e None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:00.471138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-950f0c6b-d8e1-49e1-887b-0f1ecf531e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:00.480856 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1269/2522] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:04:00.483068 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1254/2523] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:04:00 2022] POST /identity/v3/users => generated 285 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:00.484367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f0c6b-d8e1-49e1-887b-0f1ecf531e2e None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:00.485949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61420329-c03e-4dff-9765-c4dce173318e admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:00.486744 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-950f0c6b-d8e1-49e1-887b-0f1ecf531e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:00.498200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61420329-c03e-4dff-9765-c4dce173318e admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:00.500026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f0c6b-d8e1-49e1-887b-0f1ecf531e2e None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:00.503804 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6aec3-d1a0-4432-9555-cdf37f722f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:00.504791 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6aec3-d1a0-4432-9555-cdf37f722f80 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:00.505042 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f804b1-33fc-44b6-b71b-70dd0321934a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:00.505583 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6aec3-d1a0-4432-9555-cdf37f722f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:00.506472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f804b1-33fc-44b6-b71b-70dd0321934a admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:00.507106 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6aec3-d1a0-4432-9555-cdf37f722f80 admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:00.507362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f804b1-33fc-44b6-b71b-70dd0321934a admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:00.507676 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f804b1-33fc-44b6-b71b-70dd0321934a admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:00.508388 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6aec3-d1a0-4432-9555-cdf37f722f80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:04:00.508512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f804b1-33fc-44b6-b71b-70dd0321934a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:00.508989 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6aec3-d1a0-4432-9555-cdf37f722f80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:00.510142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f804b1-33fc-44b6-b71b-70dd0321934a admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:00.511040 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6aec3-d1a0-4432-9555-cdf37f722f80 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:00.524683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1270/2524] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:00.526001 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f804b1-33fc-44b6-b71b-70dd0321934a admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:00.530859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1255/2525] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 20:04:00.534712 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6aec3-d1a0-4432-9555-cdf37f722f80 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:00.543792 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f804b1-33fc-44b6-b71b-70dd0321934a admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:00.550649 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6aec3-d1a0-4432-9555-cdf37f722f80 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:00.551508 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149afbe-d6b9-480c-9f2f-f344fe9d6ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:00.552383 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149afbe-d6b9-480c-9f2f-f344fe9d6ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:00.554185 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149afbe-d6b9-480c-9f2f-f344fe9d6ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:00.554630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149afbe-d6b9-480c-9f2f-f344fe9d6ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:00.555617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149afbe-d6b9-480c-9f2f-f344fe9d6ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:00.556962 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6e00a-a982-4338-9cca-7f6912a4ed41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:00.557662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6e00a-a982-4338-9cca-7f6912a4ed41 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:00.557950 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6e00a-a982-4338-9cca-7f6912a4ed41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:00.558235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6e00a-a982-4338-9cca-7f6912a4ed41 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:00.558647 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149afbe-d6b9-480c-9f2f-f344fe9d6ae8 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:00.558959 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6e00a-a982-4338-9cca-7f6912a4ed41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:00.561083 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6e00a-a982-4338-9cca-7f6912a4ed41 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:00.572446 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1271/2526] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 20:04:00.578098 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149afbe-d6b9-480c-9f2f-f344fe9d6ae8 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:00.588666 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149afbe-d6b9-480c-9f2f-f344fe9d6ae8 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:00.594077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c65c2a-6068-48a7-86e9-711923847f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:00.594960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c65c2a-6068-48a7-86e9-711923847f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:00.595405 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c65c2a-6068-48a7-86e9-711923847f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:00.595690 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c65c2a-6068-48a7-86e9-711923847f45 admin admin] PATH_INFO: `/v3/projects/1f79da50e5254c559b58b6e54fcd090b/users/b899d6320bea40b092ea3e0453b8aee5/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:00.613419 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c65c2a-6068-48a7-86e9-711923847f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f79da50e5254c559b58b6e54fcd090b, user_id=b899d6320bea40b092ea3e0453b8aee5, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:00.617177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c65c2a-6068-48a7-86e9-711923847f45 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:00.665001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1256/2527] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:00 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:00.666429 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6e00a-a982-4338-9cca-7f6912a4ed41 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:00.696730 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1272/2528] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:00 2022] PUT /identity/v3/projects/1f79da50e5254c559b58b6e54fcd090b/users/b899d6320bea40b092ea3e0453b8aee5/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:00.698315 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e5601-54e1-4db2-8ba3-2a3fe091bde6 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:00.698619 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e5601-54e1-4db2-8ba3-2a3fe091bde6 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:00.698911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e5601-54e1-4db2-8ba3-2a3fe091bde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:00.742821 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-e18e5601-54e1-4db2-8ba3-2a3fe091bde6 None None] MFA Rules not processed for user `b899d6320bea40b092ea3e0453b8aee5`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:00.744007 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e18e5601-54e1-4db2-8ba3-2a3fe091bde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:00.765246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6e00a-a982-4338-9cca-7f6912a4ed41 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:00.838462 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1273/2529] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:00.841120 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b838f-0c09-46fb-b5b3-9aad96b6b82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:00.842158 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b838f-0c09-46fb-b5b3-9aad96b6b82d admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:00.842459 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b838f-0c09-46fb-b5b3-9aad96b6b82d admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:00.842793 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b838f-0c09-46fb-b5b3-9aad96b6b82d admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:00.843103 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e5601-54e1-4db2-8ba3-2a3fe091bde6 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:00.843504 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b838f-0c09-46fb-b5b3-9aad96b6b82d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:00.845630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b838f-0c09-46fb-b5b3-9aad96b6b82d admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:00.856678 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e5601-54e1-4db2-8ba3-2a3fe091bde6 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:00.862870 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd35f10-ef5b-4e2d-b598-57654ee502b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:00.863723 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd35f10-ef5b-4e2d-b598-57654ee502b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:00.864012 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd35f10-ef5b-4e2d-b598-57654ee502b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:00.864289 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd35f10-ef5b-4e2d-b598-57654ee502b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:00.865038 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd35f10-ef5b-4e2d-b598-57654ee502b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:00.867221 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd35f10-ef5b-4e2d-b598-57654ee502b4 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:00.926283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1257/2530] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:04:00 2022] POST /identity/v3/users => generated 283 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:00.930274 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b838f-0c09-46fb-b5b3-9aad96b6b82d admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:00.941129 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b838f-0c09-46fb-b5b3-9aad96b6b82d admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:00.957218 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1274/2531] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:00 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:04:00.957524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf9cf9-6928-4511-93cf-f84d90f44c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:00.957524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf9cf9-6928-4511-93cf-f84d90f44c69 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:00.957524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf9cf9-6928-4511-93cf-f84d90f44c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:00.957524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf9cf9-6928-4511-93cf-f84d90f44c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:00.961216 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf9cf9-6928-4511-93cf-f84d90f44c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:00.961785 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd35f10-ef5b-4e2d-b598-57654ee502b4 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:00.963940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf9cf9-6928-4511-93cf-f84d90f44c69 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:00.976753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1258/2532] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:00.980851 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf9cf9-6928-4511-93cf-f84d90f44c69 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:00.994224 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf9cf9-6928-4511-93cf-f84d90f44c69 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:01.008206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:01.050952 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:01.058744 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd35f10-ef5b-4e2d-b598-57654ee502b4 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:01.064697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21711156-a93b-449b-9b6e-518c0051fc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:01.066597 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21711156-a93b-449b-9b6e-518c0051fc72 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:01.066597 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21711156-a93b-449b-9b6e-518c0051fc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:01.066597 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21711156-a93b-449b-9b6e-518c0051fc72 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:01.067550 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21711156-a93b-449b-9b6e-518c0051fc72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:01.070535 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21711156-a93b-449b-9b6e-518c0051fc72 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:01.080555 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92144086-7646-4a42-9cef-44d14be2fbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:01.081484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92144086-7646-4a42-9cef-44d14be2fbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:01.083227 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92144086-7646-4a42-9cef-44d14be2fbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:01.083459 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92144086-7646-4a42-9cef-44d14be2fbb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:01.086117 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92144086-7646-4a42-9cef-44d14be2fbb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:01.088978 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92144086-7646-4a42-9cef-44d14be2fbb8 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:01.102984 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1259/2533] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 20:04:01.109346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92144086-7646-4a42-9cef-44d14be2fbb8 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:01.124470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92144086-7646-4a42-9cef-44d14be2fbb8 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:01.131307 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef88b3-f8db-48c6-8ef5-0b4aef9b668d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:01.132779 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef88b3-f8db-48c6-8ef5-0b4aef9b668d admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:01.133183 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef88b3-f8db-48c6-8ef5-0b4aef9b668d admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:01.133628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef88b3-f8db-48c6-8ef5-0b4aef9b668d admin admin] PATH_INFO: `/v3/projects/a9e4c0ad64fa4006b7df728ae7919a15/users/f191917ee50142b594a76e46271ccd2a/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:01.159310 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef88b3-f8db-48c6-8ef5-0b4aef9b668d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e4c0ad64fa4006b7df728ae7919a15, user_id=f191917ee50142b594a76e46271ccd2a, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:01.162148 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef88b3-f8db-48c6-8ef5-0b4aef9b668d admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:01.188398 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1275/2534] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:04:00 2022] POST /identity/v3/users => generated 290 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:04:01.192206 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21711156-a93b-449b-9b6e-518c0051fc72 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:01.203402 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21711156-a93b-449b-9b6e-518c0051fc72 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:01.208485 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea85e70-c736-431a-b784-13a9d835af02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:01.209838 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea85e70-c736-431a-b784-13a9d835af02 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:01.210124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea85e70-c736-431a-b784-13a9d835af02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:01.210540 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea85e70-c736-431a-b784-13a9d835af02 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:01.211284 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea85e70-c736-431a-b784-13a9d835af02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:01.212895 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea85e70-c736-431a-b784-13a9d835af02 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:01.223473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1276/2535] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 20:04:01.227811 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea85e70-c736-431a-b784-13a9d835af02 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:01.237507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea85e70-c736-431a-b784-13a9d835af02 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:01.242177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c778b2-3956-434d-9ac0-2b8eb179b039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:01.246530 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c778b2-3956-434d-9ac0-2b8eb179b039 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:01.246530 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c778b2-3956-434d-9ac0-2b8eb179b039 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:01.246530 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c778b2-3956-434d-9ac0-2b8eb179b039 admin admin] PATH_INFO: `/v3/projects/62e9d07d1ec04bcea04337af90408bdb/users/5106afc34c4d4fea8c5deb134a173b74/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:01.259697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c778b2-3956-434d-9ac0-2b8eb179b039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e9d07d1ec04bcea04337af90408bdb, user_id=5106afc34c4d4fea8c5deb134a173b74, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:01.264517 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c778b2-3956-434d-9ac0-2b8eb179b039 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:01.270303 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1260/2536] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:01 2022] PUT /identity/v3/projects/a9e4c0ad64fa4006b7df728ae7919a15/users/f191917ee50142b594a76e46271ccd2a/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:01.282331 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ff9ac-85b9-4777-9645-e210b7a85a17 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:01.282668 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ff9ac-85b9-4777-9645-e210b7a85a17 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:01.283082 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ff9ac-85b9-4777-9645-e210b7a85a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:01.325765 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-d69ff9ac-85b9-4777-9645-e210b7a85a17 None None] MFA Rules not processed for user `f191917ee50142b594a76e46271ccd2a`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:01.327380 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d69ff9ac-85b9-4777-9645-e210b7a85a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:01.393572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1277/2537] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:01 2022] PUT /identity/v3/projects/62e9d07d1ec04bcea04337af90408bdb/users/5106afc34c4d4fea8c5deb134a173b74/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:01.397445 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c778b2-3956-434d-9ac0-2b8eb179b039 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:01.428720 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1261/2538] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:04:01.433952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ff9ac-85b9-4777-9645-e210b7a85a17 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:01.488869 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c778b2-3956-434d-9ac0-2b8eb179b039 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:01.495764 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafca013-e751-400e-9fa7-27b31a4a72ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:01.496900 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafca013-e751-400e-9fa7-27b31a4a72ed admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:01.497814 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafca013-e751-400e-9fa7-27b31a4a72ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:01.498256 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafca013-e751-400e-9fa7-27b31a4a72ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:01.499158 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafca013-e751-400e-9fa7-27b31a4a72ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:01.501182 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafca013-e751-400e-9fa7-27b31a4a72ed admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:01.517580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1278/2539] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:01.521361 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafca013-e751-400e-9fa7-27b31a4a72ed admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:01.545485 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafca013-e751-400e-9fa7-27b31a4a72ed admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:01.558158 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ff9ac-85b9-4777-9645-e210b7a85a17 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:01.565104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65f922-a4aa-48ec-84cd-a2d5936de9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:01.565104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65f922-a4aa-48ec-84cd-a2d5936de9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:01.565104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65f922-a4aa-48ec-84cd-a2d5936de9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:01.565527 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65f922-a4aa-48ec-84cd-a2d5936de9f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:01.566335 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65f922-a4aa-48ec-84cd-a2d5936de9f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:01.569239 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65f922-a4aa-48ec-84cd-a2d5936de9f7 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:01.581787 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8d697-cfb2-405a-99ab-4105423b421e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:01.585541 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:01.587393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8d697-cfb2-405a-99ab-4105423b421e admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:01.588035 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8d697-cfb2-405a-99ab-4105423b421e admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:01.588477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8d697-cfb2-405a-99ab-4105423b421e admin admin] PATH_INFO: `/v3/projects/62e9d07d1ec04bcea04337af90408bdb/users/5106afc34c4d4fea8c5deb134a173b74/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:01.593711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8d697-cfb2-405a-99ab-4105423b421e admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e9d07d1ec04bcea04337af90408bdb, user_id=5106afc34c4d4fea8c5deb134a173b74, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:01.602439 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8d697-cfb2-405a-99ab-4105423b421e admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:01.615701 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1279/2540] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:01 2022] PUT /identity/v3/projects/62e9d07d1ec04bcea04337af90408bdb/users/5106afc34c4d4fea8c5deb134a173b74/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:01.627160 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314cabb-f543-4f2f-a1fb-0fa224f912de None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:01.627467 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314cabb-f543-4f2f-a1fb-0fa224f912de None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:01.627755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314cabb-f543-4f2f-a1fb-0fa224f912de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:01.673254 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-5314cabb-f543-4f2f-a1fb-0fa224f912de None None] MFA Rules not processed for user `5106afc34c4d4fea8c5deb134a173b74`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:01.674908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-5314cabb-f543-4f2f-a1fb-0fa224f912de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:01.734697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1262/2541] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:01 2022] POST /identity/v3/projects => generated 365 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:01.738589 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65f922-a4aa-48ec-84cd-a2d5936de9f7 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:01.774544 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1280/2542] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:04:01.789275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314cabb-f543-4f2f-a1fb-0fa224f912de None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:01.791846 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-5314cabb-f543-4f2f-a1fb-0fa224f912de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:01.825224 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:01.841543 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65f922-a4aa-48ec-84cd-a2d5936de9f7 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:01.849179 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc294da-d4f2-475e-877e-ecb839687730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:01.850820 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc294da-d4f2-475e-877e-ecb839687730 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:01.851222 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc294da-d4f2-475e-877e-ecb839687730 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:01.852057 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc294da-d4f2-475e-877e-ecb839687730 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:01.852946 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc294da-d4f2-475e-877e-ecb839687730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:01.855516 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc294da-d4f2-475e-877e-ecb839687730 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:01.877013 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314cabb-f543-4f2f-a1fb-0fa224f912de None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:01.944274 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15567f-e51f-4c81-a951-c707161b6248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:01.944944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15567f-e51f-4c81-a951-c707161b6248 service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:01.947839 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15567f-e51f-4c81-a951-c707161b6248 service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:01.947839 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15567f-e51f-4c81-a951-c707161b6248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:01.956453 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1263/2543] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:04:01 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:04:01.958045 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc294da-d4f2-475e-877e-ecb839687730 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:01.973483 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc294da-d4f2-475e-877e-ecb839687730 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:01.983548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78636056-8ce3-4148-bb83-70527941ecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:01.984672 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78636056-8ce3-4148-bb83-70527941ecec admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:01.984937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78636056-8ce3-4148-bb83-70527941ecec admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:01.985249 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78636056-8ce3-4148-bb83-70527941ecec admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:01.985986 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78636056-8ce3-4148-bb83-70527941ecec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:01.987736 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78636056-8ce3-4148-bb83-70527941ecec admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:02.004551 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1264/2544] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:02.006794 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78636056-8ce3-4148-bb83-70527941ecec admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:02.018684 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78636056-8ce3-4148-bb83-70527941ecec admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:02.019983 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15567f-e51f-4c81-a951-c707161b6248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:02.022720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15567f-e51f-4c81-a951-c707161b6248 service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:02.024807 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37107e-3e72-4e8a-8ff4-17863bd174d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:02.025737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37107e-3e72-4e8a-8ff4-17863bd174d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:02.026029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37107e-3e72-4e8a-8ff4-17863bd174d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:02.026310 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37107e-3e72-4e8a-8ff4-17863bd174d8 admin admin] PATH_INFO: `/v3/projects/fa441be21a7b41e4bc1f079bf8671ac7/users/5cceb2e62b594b0da8b870da4e628039/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:02.036123 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1281/2545] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 20:04:02.044619 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37107e-3e72-4e8a-8ff4-17863bd174d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa441be21a7b41e4bc1f079bf8671ac7, user_id=5cceb2e62b594b0da8b870da4e628039, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:02.047412 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37107e-3e72-4e8a-8ff4-17863bd174d8 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:02.126601 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1265/2546] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:02 2022] PUT /identity/v3/projects/fa441be21a7b41e4bc1f079bf8671ac7/users/5cceb2e62b594b0da8b870da4e628039/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:02.131362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15567f-e51f-4c81-a951-c707161b6248 service cinder] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:02.142386 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15567f-e51f-4c81-a951-c707161b6248 service cinder] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:02.181341 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37107e-3e72-4e8a-8ff4-17863bd174d8 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:02.183410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-7f37107e-3e72-4e8a-8ff4-17863bd174d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:02.218945 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070b458-ffdd-4b72-a239-53d96aa61552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:02.219908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070b458-ffdd-4b72-a239-53d96aa61552 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:02.220379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070b458-ffdd-4b72-a239-53d96aa61552 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:02.220963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070b458-ffdd-4b72-a239-53d96aa61552 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:02.222248 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070b458-ffdd-4b72-a239-53d96aa61552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:02.224098 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070b458-ffdd-4b72-a239-53d96aa61552 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:02.238659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1282/2547] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:02.242262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070b458-ffdd-4b72-a239-53d96aa61552 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:02.255577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070b458-ffdd-4b72-a239-53d96aa61552 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:02.262811 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06227a-32be-48d2-98c6-d4291c842afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:02.270198 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06227a-32be-48d2-98c6-d4291c842afc admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:02.270198 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06227a-32be-48d2-98c6-d4291c842afc admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:02.270198 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06227a-32be-48d2-98c6-d4291c842afc admin admin] PATH_INFO: `/v3/projects/fa441be21a7b41e4bc1f079bf8671ac7/users/5cceb2e62b594b0da8b870da4e628039/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:02.270198 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c06227a-32be-48d2-98c6-d4291c842afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa441be21a7b41e4bc1f079bf8671ac7, user_id=5cceb2e62b594b0da8b870da4e628039, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:02.273403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37107e-3e72-4e8a-8ff4-17863bd174d8 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:02.275499 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c06227a-32be-48d2-98c6-d4291c842afc admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:02.283490 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b17764-5571-4052-82b6-e54655da16dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:02.284058 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b17764-5571-4052-82b6-e54655da16dd service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:02.284344 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b17764-5571-4052-82b6-e54655da16dd service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:02.284621 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b17764-5571-4052-82b6-e54655da16dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:02.304242 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1283/2548] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:02 2022] PUT /identity/v3/projects/fa441be21a7b41e4bc1f079bf8671ac7/users/5cceb2e62b594b0da8b870da4e628039/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:02.315547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da80f5-2db0-4dbb-9365-f1f255b50b7b None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:02.315842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da80f5-2db0-4dbb-9365-f1f255b50b7b None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:02.316124 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da80f5-2db0-4dbb-9365-f1f255b50b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:02.352756 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-b1da80f5-2db0-4dbb-9365-f1f255b50b7b None None] MFA Rules not processed for user `5cceb2e62b594b0da8b870da4e628039`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:02.354193 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-b1da80f5-2db0-4dbb-9365-f1f255b50b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:02.377091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b17764-5571-4052-82b6-e54655da16dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:02.379116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b17764-5571-4052-82b6-e54655da16dd service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:02.391595 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1266/2549] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 20:04:02.427787 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:02.532085 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1284/2550] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:04:02.541738 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b17764-5571-4052-82b6-e54655da16dd service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:02.548271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:02.554203 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b17764-5571-4052-82b6-e54655da16dd service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:02.626204 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db077b3-6c8e-4e75-bad6-b7c8b6858fda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:02.626859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db077b3-6c8e-4e75-bad6-b7c8b6858fda service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:02.627292 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db077b3-6c8e-4e75-bad6-b7c8b6858fda service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:02.627668 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db077b3-6c8e-4e75-bad6-b7c8b6858fda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:02.643284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db077b3-6c8e-4e75-bad6-b7c8b6858fda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:02.645321 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db077b3-6c8e-4e75-bad6-b7c8b6858fda service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:02.657278 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1267/2551] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:04:02.707306 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00d264-167f-4e5c-a1ea-5ac39e638f69 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:02.707850 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00d264-167f-4e5c-a1ea-5ac39e638f69 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:02.708311 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00d264-167f-4e5c-a1ea-5ac39e638f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:02.739704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-3b00d264-167f-4e5c-a1ea-5ac39e638f69 None None] MFA Rules not processed for user `842655da97c74216bd2288d598fa321c`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:02.742263 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-3b00d264-167f-4e5c-a1ea-5ac39e638f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:02.822039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1285/2552] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:04:02.826564 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db077b3-6c8e-4e75-bad6-b7c8b6858fda service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:02.828483 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-0db077b3-6c8e-4e75-bad6-b7c8b6858fda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:02.860060 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00d264-167f-4e5c-a1ea-5ac39e638f69 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:02.872258 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00d264-167f-4e5c-a1ea-5ac39e638f69 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:02.876443 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee85a76-c481-4faf-b289-429ef855e9bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:02.877352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee85a76-c481-4faf-b289-429ef855e9bd service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:02.877913 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee85a76-c481-4faf-b289-429ef855e9bd service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:02.877913 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee85a76-c481-4faf-b289-429ef855e9bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:02.926776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db077b3-6c8e-4e75-bad6-b7c8b6858fda service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:02.932922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef43b1-f6d1-4c9d-b5cf-ab331fbd5054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:02.933681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef43b1-f6d1-4c9d-b5cf-ab331fbd5054 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:02.933971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef43b1-f6d1-4c9d-b5cf-ab331fbd5054 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:02.934302 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef43b1-f6d1-4c9d-b5cf-ab331fbd5054 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:02.935184 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef43b1-f6d1-4c9d-b5cf-ab331fbd5054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:02.937337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef43b1-f6d1-4c9d-b5cf-ab331fbd5054 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:02.958705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee85a76-c481-4faf-b289-429ef855e9bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:02.961003 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee85a76-c481-4faf-b289-429ef855e9bd service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:02.971692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1286/2553] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 20:04:03.041668 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1268/2554] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:02 2022] POST /identity/v3/projects => generated 371 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:03.045659 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee85a76-c481-4faf-b289-429ef855e9bd service cinder] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:03.060189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee85a76-c481-4faf-b289-429ef855e9bd service cinder] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:03.078950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:03.118593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb8d91-893f-48c5-b6cf-123a2e57d768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:03.119453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb8d91-893f-48c5-b6cf-123a2e57d768 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:03.119629 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb8d91-893f-48c5-b6cf-123a2e57d768 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:03.119908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb8d91-893f-48c5-b6cf-123a2e57d768 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:03.120606 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb8d91-893f-48c5-b6cf-123a2e57d768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:03.122556 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb8d91-893f-48c5-b6cf-123a2e57d768 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:03.242544 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1287/2555] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:04:03 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:03.246411 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef43b1-f6d1-4c9d-b5cf-ab331fbd5054 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:03.257657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef43b1-f6d1-4c9d-b5cf-ab331fbd5054 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:03.262482 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a70a22-68a3-4cbc-b81d-d5eb00354589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:03.262958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a70a22-68a3-4cbc-b81d-d5eb00354589 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:03.263250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a70a22-68a3-4cbc-b81d-d5eb00354589 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:03.263531 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a70a22-68a3-4cbc-b81d-d5eb00354589 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:03.264435 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a70a22-68a3-4cbc-b81d-d5eb00354589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:03.266027 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a70a22-68a3-4cbc-b81d-d5eb00354589 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:03.278282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1269/2556] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:03.285509 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb8d91-893f-48c5-b6cf-123a2e57d768 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:03.299232 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb8d91-893f-48c5-b6cf-123a2e57d768 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:03.303836 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058a360-50ca-4905-867a-ac1e8620d2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:03.304877 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a360-50ca-4905-867a-ac1e8620d2e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:03.305197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a360-50ca-4905-867a-ac1e8620d2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:03.305808 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a360-50ca-4905-867a-ac1e8620d2e4 admin admin] PATH_INFO: `/v3/projects/d41b3b376d5f48d7872a582c7dfba910/users/9e006eaff9d5412d98b4a1e511d3a3da/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:03.322388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058a360-50ca-4905-867a-ac1e8620d2e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41b3b376d5f48d7872a582c7dfba910, user_id=9e006eaff9d5412d98b4a1e511d3a3da, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:03.325148 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058a360-50ca-4905-867a-ac1e8620d2e4 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:03.441203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1288/2557] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:03 2022] PUT /identity/v3/projects/d41b3b376d5f48d7872a582c7dfba910/users/9e006eaff9d5412d98b4a1e511d3a3da/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:03.445999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a70a22-68a3-4cbc-b81d-d5eb00354589 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:03.456241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a70a22-68a3-4cbc-b81d-d5eb00354589 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:03.546693 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f89ed-efb9-4651-bcf1-ccb9660ceb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:03.547424 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f89ed-efb9-4651-bcf1-ccb9660ceb08 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:03.547726 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f89ed-efb9-4651-bcf1-ccb9660ceb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:03.547923 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f89ed-efb9-4651-bcf1-ccb9660ceb08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:03.548702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f89ed-efb9-4651-bcf1-ccb9660ceb08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:03.550306 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f89ed-efb9-4651-bcf1-ccb9660ceb08 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:03.561276 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1270/2558] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:03.565636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058a360-50ca-4905-867a-ac1e8620d2e4 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:03.579018 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058a360-50ca-4905-867a-ac1e8620d2e4 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:03.583741 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65537b5e-2105-40d4-909f-a07fd7b78b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:03.586926 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65537b5e-2105-40d4-909f-a07fd7b78b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:03.586926 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65537b5e-2105-40d4-909f-a07fd7b78b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:03.586926 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65537b5e-2105-40d4-909f-a07fd7b78b98 admin admin] PATH_INFO: `/v3/projects/d41b3b376d5f48d7872a582c7dfba910/users/9e006eaff9d5412d98b4a1e511d3a3da/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:03.588008 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65537b5e-2105-40d4-909f-a07fd7b78b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41b3b376d5f48d7872a582c7dfba910, user_id=9e006eaff9d5412d98b4a1e511d3a3da, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:03.590670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65537b5e-2105-40d4-909f-a07fd7b78b98 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:03.601836 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1289/2559] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:03 2022] PUT /identity/v3/projects/d41b3b376d5f48d7872a582c7dfba910/users/9e006eaff9d5412d98b4a1e511d3a3da/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:09.144377 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f89ed-efb9-4651-bcf1-ccb9660ceb08 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:09.156972 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f89ed-efb9-4651-bcf1-ccb9660ceb08 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:09.174764 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:09.233318 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69761e64-2c8a-46cd-94f7-adbfec3e85ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:09.234395 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69761e64-2c8a-46cd-94f7-adbfec3e85ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:09.234902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69761e64-2c8a-46cd-94f7-adbfec3e85ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:09.239713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69761e64-2c8a-46cd-94f7-adbfec3e85ba admin admin] PATH_INFO: `/v3/users/b899d6320bea40b092ea3e0453b8aee5` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:09.239713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69761e64-2c8a-46cd-94f7-adbfec3e85ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b899d6320bea40b092ea3e0453b8aee5)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:09.241515 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69761e64-2c8a-46cd-94f7-adbfec3e85ba admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:09.450890 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f9f32-6e2b-4886-9a02-11a996fa31ac None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:09.451360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f9f32-6e2b-4886-9a02-11a996fa31ac None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:09.451446 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f9f32-6e2b-4886-9a02-11a996fa31ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:09.491022 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-908f9f32-6e2b-4886-9a02-11a996fa31ac None None] MFA Rules not processed for user `9e006eaff9d5412d98b4a1e511d3a3da`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:09.492148 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-908f9f32-6e2b-4886-9a02-11a996fa31ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:09.532852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-69761e64-2c8a-46cd-94f7-adbfec3e85ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b899d6320bea40b092ea3e0453b8aee5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:09.558959 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-69761e64-2c8a-46cd-94f7-adbfec3e85ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b899d6320bea40b092ea3e0453b8aee5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:09.599128 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1290/2560] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:09 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:09.609052 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f9f32-6e2b-4886-9a02-11a996fa31ac None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:09.610786 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-908f9f32-6e2b-4886-9a02-11a996fa31ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:09.658304 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-69761e64-2c8a-46cd-94f7-adbfec3e85ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b899d6320bea40b092ea3e0453b8aee5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:09.659331 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-69761e64-2c8a-46cd-94f7-adbfec3e85ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b899d6320bea40b092ea3e0453b8aee5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:09.667495 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-69761e64-2c8a-46cd-94f7-adbfec3e85ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b899d6320bea40b092ea3e0453b8aee5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:09.674669 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1271/2561] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:04:09 2022] DELETE /identity/v3/users/b899d6320bea40b092ea3e0453b8aee5 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:09.680574 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646846de-7f41-4910-8670-e922ff100259 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:09.681248 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646846de-7f41-4910-8670-e922ff100259 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:09.681549 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646846de-7f41-4910-8670-e922ff100259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:09.692712 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:09.703607 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-646846de-7f41-4910-8670-e922ff100259 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:09.704834 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-646846de-7f41-4910-8670-e922ff100259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:09.714442 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f9f32-6e2b-4886-9a02-11a996fa31ac None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:09.783115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1272/2562] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:09.788831 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646846de-7f41-4910-8670-e922ff100259 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:09.790343 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-646846de-7f41-4910-8670-e922ff100259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:09.798810 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad88f3d-2411-4265-b656-8a995f0c762f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:09.799648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad88f3d-2411-4265-b656-8a995f0c762f service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:09.800035 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad88f3d-2411-4265-b656-8a995f0c762f service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:09.800390 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad88f3d-2411-4265-b656-8a995f0c762f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:09.803169 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-5ad88f3d-2411-4265-b656-8a995f0c762f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:09.841790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:09.866585 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646846de-7f41-4910-8670-e922ff100259 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:09.872074 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba27b15-74cc-431d-9ee5-7755805b86f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:09.872953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba27b15-74cc-431d-9ee5-7755805b86f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:09.873408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba27b15-74cc-431d-9ee5-7755805b86f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:09.873797 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba27b15-74cc-431d-9ee5-7755805b86f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:09.885315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba27b15-74cc-431d-9ee5-7755805b86f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:09.888040 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba27b15-74cc-431d-9ee5-7755805b86f5 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:09.892650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad88f3d-2411-4265-b656-8a995f0c762f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:09.895066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad88f3d-2411-4265-b656-8a995f0c762f service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:09.905453 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1273/2563] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:04:09.913451 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1291/2564] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 20:04:10.395492 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba27b15-74cc-431d-9ee5-7755805b86f5 service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:10.397965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-2ba27b15-74cc-431d-9ee5-7755805b86f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:10.430186 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba27b15-74cc-431d-9ee5-7755805b86f5 service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:10.437857 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba544fb-ace9-4c70-9900-64fc91198670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:10.439145 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba544fb-ace9-4c70-9900-64fc91198670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:10.439662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba544fb-ace9-4c70-9900-64fc91198670 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:10.439962 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba544fb-ace9-4c70-9900-64fc91198670 admin admin] PATH_INFO: `/v3/projects/1f79da50e5254c559b58b6e54fcd090b` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:10.441865 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba544fb-ace9-4c70-9900-64fc91198670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f79da50e5254c559b58b6e54fcd090b)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:10.445960 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba544fb-ace9-4c70-9900-64fc91198670 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:10.612481 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5ba544fb-ace9-4c70-9900-64fc91198670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f79da50e5254c559b58b6e54fcd090b', 'request_id': 'req-5ba544fb-ace9-4c70-9900-64fc91198670'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:10.619867 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5ba544fb-ace9-4c70-9900-64fc91198670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f79da50e5254c559b58b6e54fcd090b', 'request_id': 'req-5ba544fb-ace9-4c70-9900-64fc91198670'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:10.626641 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5ba544fb-ace9-4c70-9900-64fc91198670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f79da50e5254c559b58b6e54fcd090b', 'request_id': 'req-5ba544fb-ace9-4c70-9900-64fc91198670'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:10.735666 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5ba544fb-ace9-4c70-9900-64fc91198670 admin admin] The token cache is being invalidate because project 1f79da50e5254c559b58b6e54fcd090b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:04:10.735922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5ba544fb-ace9-4c70-9900-64fc91198670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:10.736593 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-5ba544fb-ace9-4c70-9900-64fc91198670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:10.738248 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1274/2565] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:04:10 2022] DELETE /identity/v3/projects/1f79da50e5254c559b58b6e54fcd090b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:10.742360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad88f3d-2411-4265-b656-8a995f0c762f service nova] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:10.753787 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad88f3d-2411-4265-b656-8a995f0c762f service nova] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:10.830553 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254298d8-f98f-497d-b627-eb090cc30703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:10.831436 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254298d8-f98f-497d-b627-eb090cc30703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:10.831720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254298d8-f98f-497d-b627-eb090cc30703 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:10.831999 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254298d8-f98f-497d-b627-eb090cc30703 admin admin] PATH_INFO: `/v3/users/5106afc34c4d4fea8c5deb134a173b74` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:10.833348 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254298d8-f98f-497d-b627-eb090cc30703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5106afc34c4d4fea8c5deb134a173b74)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:10.835381 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254298d8-f98f-497d-b627-eb090cc30703 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:10.997335 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:11.012588 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-254298d8-f98f-497d-b627-eb090cc30703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5106afc34c4d4fea8c5deb134a173b74'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:11.041298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-254298d8-f98f-497d-b627-eb090cc30703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5106afc34c4d4fea8c5deb134a173b74'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:11.147852 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-254298d8-f98f-497d-b627-eb090cc30703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5106afc34c4d4fea8c5deb134a173b74'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:11.148498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-254298d8-f98f-497d-b627-eb090cc30703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5106afc34c4d4fea8c5deb134a173b74'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:11.161215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-254298d8-f98f-497d-b627-eb090cc30703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5106afc34c4d4fea8c5deb134a173b74'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:11.170751 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1292/2566] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:04:10 2022] DELETE /identity/v3/users/5106afc34c4d4fea8c5deb134a173b74 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:11.711541 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba544fb-ace9-4c70-9900-64fc91198670 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:11.713823 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-5ba544fb-ace9-4c70-9900-64fc91198670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:11.729734 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba544fb-ace9-4c70-9900-64fc91198670 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:11.795366 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6c990-4ddf-4a08-a21f-12307ea97a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:11.796230 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6c990-4ddf-4a08-a21f-12307ea97a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:11.796512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6c990-4ddf-4a08-a21f-12307ea97a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:11.796786 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6c990-4ddf-4a08-a21f-12307ea97a13 admin admin] PATH_INFO: `/v3/projects/62e9d07d1ec04bcea04337af90408bdb` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:11.798042 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6c990-4ddf-4a08-a21f-12307ea97a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62e9d07d1ec04bcea04337af90408bdb)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:11.800070 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6c990-4ddf-4a08-a21f-12307ea97a13 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:11.927341 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-75d6c990-4ddf-4a08-a21f-12307ea97a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e9d07d1ec04bcea04337af90408bdb', 'request_id': 'req-75d6c990-4ddf-4a08-a21f-12307ea97a13'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:11.935252 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-75d6c990-4ddf-4a08-a21f-12307ea97a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e9d07d1ec04bcea04337af90408bdb', 'request_id': 'req-75d6c990-4ddf-4a08-a21f-12307ea97a13'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:11.944074 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-75d6c990-4ddf-4a08-a21f-12307ea97a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e9d07d1ec04bcea04337af90408bdb', 'request_id': 'req-75d6c990-4ddf-4a08-a21f-12307ea97a13'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:11.947685 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:12.048421 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-75d6c990-4ddf-4a08-a21f-12307ea97a13 admin admin] The token cache is being invalidate because project 62e9d07d1ec04bcea04337af90408bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:04:12.048951 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-75d6c990-4ddf-4a08-a21f-12307ea97a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:12.049802 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-75d6c990-4ddf-4a08-a21f-12307ea97a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:12.051707 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1275/2567] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:04:11 2022] DELETE /identity/v3/projects/62e9d07d1ec04bcea04337af90408bdb => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:12.056819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f686b-5b0d-4106-b0af-89c1266e29a5 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:12.057350 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f686b-5b0d-4106-b0af-89c1266e29a5 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:12.057459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f686b-5b0d-4106-b0af-89c1266e29a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:12.080089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-369f686b-5b0d-4106-b0af-89c1266e29a5 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:12.081448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-369f686b-5b0d-4106-b0af-89c1266e29a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:12.161297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1293/2568] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:12.164121 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209d80a-190f-414f-a902-caf3d5f0d55c None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:12.164433 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209d80a-190f-414f-a902-caf3d5f0d55c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:12.164710 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209d80a-190f-414f-a902-caf3d5f0d55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:12.183897 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-4209d80a-190f-414f-a902-caf3d5f0d55c None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:12.185110 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-4209d80a-190f-414f-a902-caf3d5f0d55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:12.200382 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1276/2569] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:12.205465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f686b-5b0d-4106-b0af-89c1266e29a5 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:12.216935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f686b-5b0d-4106-b0af-89c1266e29a5 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:12.221967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98833004-12f3-4a1a-b64e-72ad417c1815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:12.222635 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98833004-12f3-4a1a-b64e-72ad417c1815 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:12.223110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98833004-12f3-4a1a-b64e-72ad417c1815 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:12.223395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98833004-12f3-4a1a-b64e-72ad417c1815 admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:12.224136 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98833004-12f3-4a1a-b64e-72ad417c1815 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:04:12.224978 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98833004-12f3-4a1a-b64e-72ad417c1815 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:12.226857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98833004-12f3-4a1a-b64e-72ad417c1815 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:12.242360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1294/2570] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 20:04:12.246595 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209d80a-190f-414f-a902-caf3d5f0d55c None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:12.257885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209d80a-190f-414f-a902-caf3d5f0d55c None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:12.268682 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3159fc9-b598-4b69-8504-3702b69da195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:12.268682 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3159fc9-b598-4b69-8504-3702b69da195 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:12.268682 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3159fc9-b598-4b69-8504-3702b69da195 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:12.268682 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3159fc9-b598-4b69-8504-3702b69da195 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:12.269005 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3159fc9-b598-4b69-8504-3702b69da195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:12.271505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3159fc9-b598-4b69-8504-3702b69da195 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:12.382795 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1277/2571] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:12 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:12.390408 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98833004-12f3-4a1a-b64e-72ad417c1815 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:12.426331 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98833004-12f3-4a1a-b64e-72ad417c1815 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:12.547004 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ee66b-1475-40fb-85ad-d1359a2850d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:12.553338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ee66b-1475-40fb-85ad-d1359a2850d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:12.553338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ee66b-1475-40fb-85ad-d1359a2850d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:12.553338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ee66b-1475-40fb-85ad-d1359a2850d9 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:12.553338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ee66b-1475-40fb-85ad-d1359a2850d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:12.553338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ee66b-1475-40fb-85ad-d1359a2850d9 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:12.661269 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1295/2572] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:04:12 2022] POST /identity/v3/users => generated 291 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:12.665582 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3159fc9-b598-4b69-8504-3702b69da195 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:12.679514 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3159fc9-b598-4b69-8504-3702b69da195 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:12.686380 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c76702-663b-4ccb-92d8-c0a0aec3f202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:12.687940 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c76702-663b-4ccb-92d8-c0a0aec3f202 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:12.688312 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c76702-663b-4ccb-92d8-c0a0aec3f202 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:12.688660 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c76702-663b-4ccb-92d8-c0a0aec3f202 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:12.689518 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c76702-663b-4ccb-92d8-c0a0aec3f202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:12.691627 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c76702-663b-4ccb-92d8-c0a0aec3f202 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:12.705073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1278/2573] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:12.708579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ee66b-1475-40fb-85ad-d1359a2850d9 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:12.719607 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ee66b-1475-40fb-85ad-d1359a2850d9 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:12.725049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348fc65-f330-4643-8b1f-98c50f995688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:12.729739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348fc65-f330-4643-8b1f-98c50f995688 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:12.729739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348fc65-f330-4643-8b1f-98c50f995688 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:12.729739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348fc65-f330-4643-8b1f-98c50f995688 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:12.729739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348fc65-f330-4643-8b1f-98c50f995688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:12.729739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348fc65-f330-4643-8b1f-98c50f995688 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:12.741763 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1296/2574] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:12.746200 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c76702-663b-4ccb-92d8-c0a0aec3f202 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:12.763781 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c76702-663b-4ccb-92d8-c0a0aec3f202 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:12.769105 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ab4b8-67cb-4eb8-b07f-d21088a5a900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:12.770153 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ab4b8-67cb-4eb8-b07f-d21088a5a900 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:12.770543 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ab4b8-67cb-4eb8-b07f-d21088a5a900 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:12.770999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ab4b8-67cb-4eb8-b07f-d21088a5a900 admin admin] PATH_INFO: `/v3/projects/256e37611058485b9bdb46e2f1c3e019/users/98fb2eb1ac7646a29c4d18108988efe5/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:12.772082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348fc65-f330-4643-8b1f-98c50f995688 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:12.773963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-2348fc65-f330-4643-8b1f-98c50f995688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:12.791932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ab4b8-67cb-4eb8-b07f-d21088a5a900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=256e37611058485b9bdb46e2f1c3e019, user_id=98fb2eb1ac7646a29c4d18108988efe5, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:12.795320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ab4b8-67cb-4eb8-b07f-d21088a5a900 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:12.810601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348fc65-f330-4643-8b1f-98c50f995688 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:12.816601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7b7ab-057e-4610-8cbb-dacc022cbe3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:12.816887 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7b7ab-057e-4610-8cbb-dacc022cbe3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:12.817282 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7b7ab-057e-4610-8cbb-dacc022cbe3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:12.817686 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7b7ab-057e-4610-8cbb-dacc022cbe3e admin admin] PATH_INFO: `/v3/users/f191917ee50142b594a76e46271ccd2a` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:12.819914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7b7ab-057e-4610-8cbb-dacc022cbe3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f191917ee50142b594a76e46271ccd2a)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:12.822068 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7b7ab-057e-4610-8cbb-dacc022cbe3e admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:12.844473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:12.930774 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1279/2575] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:12 2022] PUT /identity/v3/projects/256e37611058485b9bdb46e2f1c3e019/users/98fb2eb1ac7646a29c4d18108988efe5/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:12.933832 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83d01c-bc75-4aeb-8b04-c59e0ceecd40 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:12.934354 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83d01c-bc75-4aeb-8b04-c59e0ceecd40 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:12.934869 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83d01c-bc75-4aeb-8b04-c59e0ceecd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:12.973498 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-bd83d01c-bc75-4aeb-8b04-c59e0ceecd40 None None] MFA Rules not processed for user `98fb2eb1ac7646a29c4d18108988efe5`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:12.975916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-bd83d01c-bc75-4aeb-8b04-c59e0ceecd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:13.063634 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1280/2576] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:13.063634 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bcc95-9dad-4258-be10-d13614a554ae None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:13.063634 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bcc95-9dad-4258-be10-d13614a554ae None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:13.063634 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bcc95-9dad-4258-be10-d13614a554ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:13.082138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2ae7b7ab-057e-4610-8cbb-dacc022cbe3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f191917ee50142b594a76e46271ccd2a'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:13.087670 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-e72bcc95-9dad-4258-be10-d13614a554ae None None] MFA Rules not processed for user `842655da97c74216bd2288d598fa321c`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:13.090071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e72bcc95-9dad-4258-be10-d13614a554ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:13.108636 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2ae7b7ab-057e-4610-8cbb-dacc022cbe3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f191917ee50142b594a76e46271ccd2a'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:13.162066 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1281/2577] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:13.166352 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bcc95-9dad-4258-be10-d13614a554ae None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:13.166472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2ae7b7ab-057e-4610-8cbb-dacc022cbe3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f191917ee50142b594a76e46271ccd2a'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:13.167047 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2ae7b7ab-057e-4610-8cbb-dacc022cbe3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f191917ee50142b594a76e46271ccd2a'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:13.175531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2ae7b7ab-057e-4610-8cbb-dacc022cbe3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f191917ee50142b594a76e46271ccd2a'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:13.189613 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1297/2578] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:04:12 2022] DELETE /identity/v3/users/f191917ee50142b594a76e46271ccd2a => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:13.195845 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e663217-10a7-48bf-a264-4217a70ffc8e None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:13.196233 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e663217-10a7-48bf-a264-4217a70ffc8e None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:13.196696 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e663217-10a7-48bf-a264-4217a70ffc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:13.207574 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:13.218466 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-7e663217-10a7-48bf-a264-4217a70ffc8e None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:13.221810 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7e663217-10a7-48bf-a264-4217a70ffc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:13.252362 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bcc95-9dad-4258-be10-d13614a554ae None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:13.312892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1298/2579] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:13.324039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e663217-10a7-48bf-a264-4217a70ffc8e None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:13.325533 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7e663217-10a7-48bf-a264-4217a70ffc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:13.354354 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bf676-97dc-4751-8167-c6d972ab3ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:13.358118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bf676-97dc-4751-8167-c6d972ab3ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:13.358118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bf676-97dc-4751-8167-c6d972ab3ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:13.358118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bf676-97dc-4751-8167-c6d972ab3ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:13.358118 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bf676-97dc-4751-8167-c6d972ab3ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:13.358568 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bf676-97dc-4751-8167-c6d972ab3ff1 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:13.409990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e663217-10a7-48bf-a264-4217a70ffc8e None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:13.415359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da48b8-6894-4293-9311-3f53a4c1fa64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:13.416203 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da48b8-6894-4293-9311-3f53a4c1fa64 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:13.416478 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da48b8-6894-4293-9311-3f53a4c1fa64 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:13.416910 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da48b8-6894-4293-9311-3f53a4c1fa64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:13.428704 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da48b8-6894-4293-9311-3f53a4c1fa64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:13.430513 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da48b8-6894-4293-9311-3f53a4c1fa64 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:13.442975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1299/2580] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 20:04:13.474513 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1282/2581] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:13 2022] POST /identity/v3/projects => generated 387 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:13.475509 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da48b8-6894-4293-9311-3f53a4c1fa64 service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:13.478397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f2da48b8-6894-4293-9311-3f53a4c1fa64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:13.500047 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da48b8-6894-4293-9311-3f53a4c1fa64 service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:13.575209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134e6f9-cd31-4c08-81d1-a3650e0d0572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:13.576921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134e6f9-cd31-4c08-81d1-a3650e0d0572 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:13.576921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134e6f9-cd31-4c08-81d1-a3650e0d0572 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:13.576921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134e6f9-cd31-4c08-81d1-a3650e0d0572 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:13.577391 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134e6f9-cd31-4c08-81d1-a3650e0d0572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:13.579409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134e6f9-cd31-4c08-81d1-a3650e0d0572 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:13.690061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1300/2582] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:04:13 2022] POST /identity/v3/users => generated 300 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:13.692948 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bf676-97dc-4751-8167-c6d972ab3ff1 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:13.703398 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bf676-97dc-4751-8167-c6d972ab3ff1 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:13.707969 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8376a-a74f-4ecb-9bd4-6439edf964ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:13.710637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8376a-a74f-4ecb-9bd4-6439edf964ac admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:13.710932 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8376a-a74f-4ecb-9bd4-6439edf964ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:13.711214 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8376a-a74f-4ecb-9bd4-6439edf964ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:13.712006 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8376a-a74f-4ecb-9bd4-6439edf964ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:13.713923 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8376a-a74f-4ecb-9bd4-6439edf964ac admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:13.731545 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1283/2583] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:13.733480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134e6f9-cd31-4c08-81d1-a3650e0d0572 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:13.746473 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134e6f9-cd31-4c08-81d1-a3650e0d0572 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:13.754374 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6f5f4-c0a0-43e6-9fd7-4354ba2fdc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:13.755356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6f5f4-c0a0-43e6-9fd7-4354ba2fdc77 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:13.755719 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6f5f4-c0a0-43e6-9fd7-4354ba2fdc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:13.756142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6f5f4-c0a0-43e6-9fd7-4354ba2fdc77 admin admin] PATH_INFO: `/v3/projects/629b4e777b9f44c3a0ff7331b287efab/users/c234bdbdaeec4f6f98747eb2d218dfb1/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:13.773108 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6f5f4-c0a0-43e6-9fd7-4354ba2fdc77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629b4e777b9f44c3a0ff7331b287efab, user_id=c234bdbdaeec4f6f98747eb2d218dfb1, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:13.776029 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6f5f4-c0a0-43e6-9fd7-4354ba2fdc77 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:13.838744 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:13.904501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1301/2584] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:13 2022] PUT /identity/v3/projects/629b4e777b9f44c3a0ff7331b287efab/users/c234bdbdaeec4f6f98747eb2d218dfb1/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:13.908682 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8376a-a74f-4ecb-9bd4-6439edf964ac admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:13.919629 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8376a-a74f-4ecb-9bd4-6439edf964ac admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:13.968864 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6f5f4-c0a0-43e6-9fd7-4354ba2fdc77 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:13.971857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-06c6f5f4-c0a0-43e6-9fd7-4354ba2fdc77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:13.988659 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8eb38b-ff66-445e-887d-f78d4eee20d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:13.988659 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eb38b-ff66-445e-887d-f78d4eee20d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:13.988659 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eb38b-ff66-445e-887d-f78d4eee20d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:13.988659 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eb38b-ff66-445e-887d-f78d4eee20d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:13.989384 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8eb38b-ff66-445e-887d-f78d4eee20d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:13.989384 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8eb38b-ff66-445e-887d-f78d4eee20d4 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:14.000207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1284/2585] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:14.004474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8eb38b-ff66-445e-887d-f78d4eee20d4 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:14.016473 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8eb38b-ff66-445e-887d-f78d4eee20d4 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:14.020179 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f86dd9-f136-4f02-b0b9-e0add7dd7588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:14.021749 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f86dd9-f136-4f02-b0b9-e0add7dd7588 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:14.022175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f86dd9-f136-4f02-b0b9-e0add7dd7588 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:14.022528 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f86dd9-f136-4f02-b0b9-e0add7dd7588 admin admin] PATH_INFO: `/v3/projects/629b4e777b9f44c3a0ff7331b287efab/users/c234bdbdaeec4f6f98747eb2d218dfb1/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:14.024620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f86dd9-f136-4f02-b0b9-e0add7dd7588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629b4e777b9f44c3a0ff7331b287efab, user_id=c234bdbdaeec4f6f98747eb2d218dfb1, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:14.027295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f86dd9-f136-4f02-b0b9-e0add7dd7588 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:14.039471 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1285/2586] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:14 2022] PUT /identity/v3/projects/629b4e777b9f44c3a0ff7331b287efab/users/c234bdbdaeec4f6f98747eb2d218dfb1/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:14.050633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af18d69-03c0-4794-b029-bfb86772db47 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:14.050922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af18d69-03c0-4794-b029-bfb86772db47 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:14.051202 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af18d69-03c0-4794-b029-bfb86772db47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:14.051303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6f5f4-c0a0-43e6-9fd7-4354ba2fdc77 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:14.086355 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-0af18d69-03c0-4794-b029-bfb86772db47 None None] MFA Rules not processed for user `c234bdbdaeec4f6f98747eb2d218dfb1`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:14.087651 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-0af18d69-03c0-4794-b029-bfb86772db47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:14.127504 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f177a-c29e-40d0-9ac5-4dc98f12caea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:14.128396 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f177a-c29e-40d0-9ac5-4dc98f12caea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:14.128686 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f177a-c29e-40d0-9ac5-4dc98f12caea admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:14.128968 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f177a-c29e-40d0-9ac5-4dc98f12caea admin admin] PATH_INFO: `/v3/projects/a9e4c0ad64fa4006b7df728ae7919a15` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:14.130999 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f177a-c29e-40d0-9ac5-4dc98f12caea admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e4c0ad64fa4006b7df728ae7919a15)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:14.133067 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f177a-c29e-40d0-9ac5-4dc98f12caea admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:14.168641 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1286/2587] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:04:14.180777 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af18d69-03c0-4794-b029-bfb86772db47 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:14.182188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-0af18d69-03c0-4794-b029-bfb86772db47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:14.256880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af18d69-03c0-4794-b029-bfb86772db47 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:14.274431 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ca0f177a-c29e-40d0-9ac5-4dc98f12caea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e4c0ad64fa4006b7df728ae7919a15', 'request_id': 'req-ca0f177a-c29e-40d0-9ac5-4dc98f12caea'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:14.281292 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ca0f177a-c29e-40d0-9ac5-4dc98f12caea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e4c0ad64fa4006b7df728ae7919a15', 'request_id': 'req-ca0f177a-c29e-40d0-9ac5-4dc98f12caea'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:14.286921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ca0f177a-c29e-40d0-9ac5-4dc98f12caea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e4c0ad64fa4006b7df728ae7919a15', 'request_id': 'req-ca0f177a-c29e-40d0-9ac5-4dc98f12caea'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:14.313583 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6d4a2-f87d-47ba-9550-81992a6e6b2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:14.314301 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6d4a2-f87d-47ba-9550-81992a6e6b2a service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:14.315014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6d4a2-f87d-47ba-9550-81992a6e6b2a service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:14.315307 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6d4a2-f87d-47ba-9550-81992a6e6b2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:14.359940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ca0f177a-c29e-40d0-9ac5-4dc98f12caea admin admin] The token cache is being invalidate because project a9e4c0ad64fa4006b7df728ae7919a15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:04:14.360235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ca0f177a-c29e-40d0-9ac5-4dc98f12caea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:14.360870 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-ca0f177a-c29e-40d0-9ac5-4dc98f12caea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:14.362975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1302/2588] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:04:13 2022] DELETE /identity/v3/projects/a9e4c0ad64fa4006b7df728ae7919a15 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:14.372139 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f177a-c29e-40d0-9ac5-4dc98f12caea admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:14.372139 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ca0f177a-c29e-40d0-9ac5-4dc98f12caea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:14.381728 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6d4a2-f87d-47ba-9550-81992a6e6b2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:14.383173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6d4a2-f87d-47ba-9550-81992a6e6b2a service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:14.393961 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1287/2589] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 20:04:14.424151 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6d4a2-f87d-47ba-9550-81992a6e6b2a service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:14.434004 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:14.449239 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f177a-c29e-40d0-9ac5-4dc98f12caea admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:14.454088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3d83f-ccfa-47e7-a942-4ceb70254eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:14.454976 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3d83f-ccfa-47e7-a942-4ceb70254eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:14.455259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3d83f-ccfa-47e7-a942-4ceb70254eea admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:14.455541 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3d83f-ccfa-47e7-a942-4ceb70254eea admin admin] PATH_INFO: `/v3/users/5cceb2e62b594b0da8b870da4e628039` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:14.456920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3d83f-ccfa-47e7-a942-4ceb70254eea admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cceb2e62b594b0da8b870da4e628039)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:14.459101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3d83f-ccfa-47e7-a942-4ceb70254eea admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:14.498115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6d4a2-f87d-47ba-9550-81992a6e6b2a service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:14.502665 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad68ae-4849-4782-bcc7-6c89be609938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:14.503707 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad68ae-4849-4782-bcc7-6c89be609938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:14.503991 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad68ae-4849-4782-bcc7-6c89be609938 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:14.504271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad68ae-4849-4782-bcc7-6c89be609938 admin admin] PATH_INFO: `/v3/users/98fb2eb1ac7646a29c4d18108988efe5` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:14.505547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad68ae-4849-4782-bcc7-6c89be609938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98fb2eb1ac7646a29c4d18108988efe5)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:14.507650 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad68ae-4849-4782-bcc7-6c89be609938 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:14.679689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-91c3d83f-ccfa-47e7-a942-4ceb70254eea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cceb2e62b594b0da8b870da4e628039'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:14.693795 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:14.700339 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-91c3d83f-ccfa-47e7-a942-4ceb70254eea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cceb2e62b594b0da8b870da4e628039'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:14.710681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c6ad68ae-4849-4782-bcc7-6c89be609938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98fb2eb1ac7646a29c4d18108988efe5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:14.726444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c6ad68ae-4849-4782-bcc7-6c89be609938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98fb2eb1ac7646a29c4d18108988efe5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:14.778627 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:14.806468 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-91c3d83f-ccfa-47e7-a942-4ceb70254eea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cceb2e62b594b0da8b870da4e628039'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:14.807090 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-91c3d83f-ccfa-47e7-a942-4ceb70254eea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cceb2e62b594b0da8b870da4e628039'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:14.814739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-91c3d83f-ccfa-47e7-a942-4ceb70254eea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cceb2e62b594b0da8b870da4e628039'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:14.821376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1303/2590] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:04:14 2022] DELETE /identity/v3/users/5cceb2e62b594b0da8b870da4e628039 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:14.910077 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c6ad68ae-4849-4782-bcc7-6c89be609938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98fb2eb1ac7646a29c4d18108988efe5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:14.911507 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c6ad68ae-4849-4782-bcc7-6c89be609938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98fb2eb1ac7646a29c4d18108988efe5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:14.921349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c6ad68ae-4849-4782-bcc7-6c89be609938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98fb2eb1ac7646a29c4d18108988efe5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:14.927639 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1288/2591] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:04:14 2022] DELETE /identity/v3/users/98fb2eb1ac7646a29c4d18108988efe5 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:14.934198 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71175cf5-8934-4f22-b0bc-b0650f220bed None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:14.934665 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71175cf5-8934-4f22-b0bc-b0650f220bed None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:14.935031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71175cf5-8934-4f22-b0bc-b0650f220bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:14.953691 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-71175cf5-8934-4f22-b0bc-b0650f220bed None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:14.954976 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-71175cf5-8934-4f22-b0bc-b0650f220bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:15.024152 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1304/2592] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:15.034664 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad68ae-4849-4782-bcc7-6c89be609938 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:15.034664 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-c6ad68ae-4849-4782-bcc7-6c89be609938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:15.091487 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad68ae-4849-4782-bcc7-6c89be609938 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:15.095845 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63b17a-52a5-4c3e-9e67-fc7a642d9a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:15.096767 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63b17a-52a5-4c3e-9e67-fc7a642d9a0e service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:15.097051 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63b17a-52a5-4c3e-9e67-fc7a642d9a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:15.097358 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63b17a-52a5-4c3e-9e67-fc7a642d9a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:15.107488 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63b17a-52a5-4c3e-9e67-fc7a642d9a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:15.109039 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63b17a-52a5-4c3e-9e67-fc7a642d9a0e service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:15.120617 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1289/2593] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:04:15.296172 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:15.433521 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71175cf5-8934-4f22-b0bc-b0650f220bed None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:15.435132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-71175cf5-8934-4f22-b0bc-b0650f220bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:15.468677 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71175cf5-8934-4f22-b0bc-b0650f220bed None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:15.481698 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32911e-fb15-477d-977d-46dff7ac3174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:15.483109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32911e-fb15-477d-977d-46dff7ac3174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:15.483787 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32911e-fb15-477d-977d-46dff7ac3174 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:15.484286 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32911e-fb15-477d-977d-46dff7ac3174 admin admin] PATH_INFO: `/v3/projects/fa441be21a7b41e4bc1f079bf8671ac7` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:15.492507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32911e-fb15-477d-977d-46dff7ac3174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa441be21a7b41e4bc1f079bf8671ac7)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:15.492507 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32911e-fb15-477d-977d-46dff7ac3174 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:15.639650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2f32911e-fb15-477d-977d-46dff7ac3174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa441be21a7b41e4bc1f079bf8671ac7', 'request_id': 'req-2f32911e-fb15-477d-977d-46dff7ac3174'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:15.647282 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2f32911e-fb15-477d-977d-46dff7ac3174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa441be21a7b41e4bc1f079bf8671ac7', 'request_id': 'req-2f32911e-fb15-477d-977d-46dff7ac3174'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:15.656914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2f32911e-fb15-477d-977d-46dff7ac3174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa441be21a7b41e4bc1f079bf8671ac7', 'request_id': 'req-2f32911e-fb15-477d-977d-46dff7ac3174'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:15.727500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63b17a-52a5-4c3e-9e67-fc7a642d9a0e service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:15.730880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ed63b17a-52a5-4c3e-9e67-fc7a642d9a0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:15.752969 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2f32911e-fb15-477d-977d-46dff7ac3174 admin admin] The token cache is being invalidate because project fa441be21a7b41e4bc1f079bf8671ac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:04:15.752969 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2f32911e-fb15-477d-977d-46dff7ac3174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:15.760789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2f32911e-fb15-477d-977d-46dff7ac3174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:15.761183 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63b17a-52a5-4c3e-9e67-fc7a642d9a0e service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:15.763562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1305/2594] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:04:15 2022] DELETE /identity/v3/projects/fa441be21a7b41e4bc1f079bf8671ac7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:15.770352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bdcf3-c4eb-4d16-abdf-5ab89e145234 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:15.771920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bdcf3-c4eb-4d16-abdf-5ab89e145234 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:15.773221 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bdcf3-c4eb-4d16-abdf-5ab89e145234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:15.805482 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-9a1bdcf3-c4eb-4d16-abdf-5ab89e145234 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:15.807669 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-9a1bdcf3-c4eb-4d16-abdf-5ab89e145234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:15.839994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:15.863228 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965b543-7bae-4fa8-9e73-0cf3a0ad82b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:15.864583 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965b543-7bae-4fa8-9e73-0cf3a0ad82b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:15.865270 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965b543-7bae-4fa8-9e73-0cf3a0ad82b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:15.869624 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965b543-7bae-4fa8-9e73-0cf3a0ad82b6 admin admin] PATH_INFO: `/v3/projects/256e37611058485b9bdb46e2f1c3e019` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:15.869624 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965b543-7bae-4fa8-9e73-0cf3a0ad82b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=256e37611058485b9bdb46e2f1c3e019)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:15.869624 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965b543-7bae-4fa8-9e73-0cf3a0ad82b6 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:15.917865 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1306/2595] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:15.924328 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca55a0-9fb2-4b26-b0a8-a583e6742d81 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:15.925110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca55a0-9fb2-4b26-b0a8-a583e6742d81 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:15.925508 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca55a0-9fb2-4b26-b0a8-a583e6742d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:15.950713 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-04ca55a0-9fb2-4b26-b0a8-a583e6742d81 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:15.952175 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-04ca55a0-9fb2-4b26-b0a8-a583e6742d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:15.961656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1307/2596] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:15.965843 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca55a0-9fb2-4b26-b0a8-a583e6742d81 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:15.976092 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca55a0-9fb2-4b26-b0a8-a583e6742d81 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:15.981914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628ce1a-b317-49ef-acf9-22f87dd9f748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:15.982602 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628ce1a-b317-49ef-acf9-22f87dd9f748 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:15.982896 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628ce1a-b317-49ef-acf9-22f87dd9f748 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:15.983180 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628ce1a-b317-49ef-acf9-22f87dd9f748 admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:15.983934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628ce1a-b317-49ef-acf9-22f87dd9f748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:04:15.984250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628ce1a-b317-49ef-acf9-22f87dd9f748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:15.986092 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628ce1a-b317-49ef-acf9-22f87dd9f748 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:16.000110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1308/2597] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 20:04:16.002359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628ce1a-b317-49ef-acf9-22f87dd9f748 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:16.012953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628ce1a-b317-49ef-acf9-22f87dd9f748 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:16.020816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eacf2a-b53a-49c6-8364-688784dd8340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:16.020816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eacf2a-b53a-49c6-8364-688784dd8340 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:16.020816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eacf2a-b53a-49c6-8364-688784dd8340 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:16.020816 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eacf2a-b53a-49c6-8364-688784dd8340 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:16.021922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eacf2a-b53a-49c6-8364-688784dd8340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:16.022677 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eacf2a-b53a-49c6-8364-688784dd8340 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:16.057811 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6965b543-7bae-4fa8-9e73-0cf3a0ad82b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '256e37611058485b9bdb46e2f1c3e019', 'request_id': 'req-6965b543-7bae-4fa8-9e73-0cf3a0ad82b6'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:16.064355 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6965b543-7bae-4fa8-9e73-0cf3a0ad82b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '256e37611058485b9bdb46e2f1c3e019', 'request_id': 'req-6965b543-7bae-4fa8-9e73-0cf3a0ad82b6'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:16.076433 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6965b543-7bae-4fa8-9e73-0cf3a0ad82b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '256e37611058485b9bdb46e2f1c3e019', 'request_id': 'req-6965b543-7bae-4fa8-9e73-0cf3a0ad82b6'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:16.151269 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6965b543-7bae-4fa8-9e73-0cf3a0ad82b6 admin admin] The token cache is being invalidate because project 256e37611058485b9bdb46e2f1c3e019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:04:16.151764 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6965b543-7bae-4fa8-9e73-0cf3a0ad82b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:16.155955 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6965b543-7bae-4fa8-9e73-0cf3a0ad82b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:16.157748 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1309/2598] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:16 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:04:16.158354 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1290/2599] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:04:15 2022] DELETE /identity/v3/projects/256e37611058485b9bdb46e2f1c3e019 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:16.161976 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eacf2a-b53a-49c6-8364-688784dd8340 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:16.162146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965b543-7bae-4fa8-9e73-0cf3a0ad82b6 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:16.163482 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-6965b543-7bae-4fa8-9e73-0cf3a0ad82b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:16.163848 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d7eacf2a-b53a-49c6-8364-688784dd8340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:16.225887 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:16.259717 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eacf2a-b53a-49c6-8364-688784dd8340 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:16.266873 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80b45c-bd3a-47a3-8efe-f8592c35179e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:16.267811 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80b45c-bd3a-47a3-8efe-f8592c35179e admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:16.267941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80b45c-bd3a-47a3-8efe-f8592c35179e admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:16.268235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80b45c-bd3a-47a3-8efe-f8592c35179e admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:16.269094 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80b45c-bd3a-47a3-8efe-f8592c35179e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:16.269501 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965b543-7bae-4fa8-9e73-0cf3a0ad82b6 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:16.272037 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80b45c-bd3a-47a3-8efe-f8592c35179e admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:16.275584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aae23c-0d0c-4f57-95bd-2d2c9f4d08c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:16.276603 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aae23c-0d0c-4f57-95bd-2d2c9f4d08c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:16.277246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aae23c-0d0c-4f57-95bd-2d2c9f4d08c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:16.277605 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aae23c-0d0c-4f57-95bd-2d2c9f4d08c9 admin admin] PATH_INFO: `/v3/users/c234bdbdaeec4f6f98747eb2d218dfb1` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:16.292635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aae23c-0d0c-4f57-95bd-2d2c9f4d08c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c234bdbdaeec4f6f98747eb2d218dfb1)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:16.292635 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aae23c-0d0c-4f57-95bd-2d2c9f4d08c9 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:16.443482 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1310/2600] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:04:16 2022] POST /identity/v3/users => generated 291 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:16.449597 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80b45c-bd3a-47a3-8efe-f8592c35179e admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:16.462328 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80b45c-bd3a-47a3-8efe-f8592c35179e admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:16.467529 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14730353-54eb-43c4-8e78-e85f756dbb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:16.468227 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14730353-54eb-43c4-8e78-e85f756dbb00 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:16.468514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14730353-54eb-43c4-8e78-e85f756dbb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:16.468814 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14730353-54eb-43c4-8e78-e85f756dbb00 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:16.469605 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14730353-54eb-43c4-8e78-e85f756dbb00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:16.471207 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14730353-54eb-43c4-8e78-e85f756dbb00 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:16.483677 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1311/2601] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:16.487994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14730353-54eb-43c4-8e78-e85f756dbb00 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:16.498912 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14730353-54eb-43c4-8e78-e85f756dbb00 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:16.503980 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff77a71-717f-4e79-9b03-c13b1c2c02ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:16.504730 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff77a71-717f-4e79-9b03-c13b1c2c02ce admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:16.505114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff77a71-717f-4e79-9b03-c13b1c2c02ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:16.505458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff77a71-717f-4e79-9b03-c13b1c2c02ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:16.506209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff77a71-717f-4e79-9b03-c13b1c2c02ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:16.508095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff77a71-717f-4e79-9b03-c13b1c2c02ce admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:16.518859 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1312/2602] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:16.523981 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff77a71-717f-4e79-9b03-c13b1c2c02ce admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:16.537928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff77a71-717f-4e79-9b03-c13b1c2c02ce admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:16.543471 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782501e5-2baa-4723-a2ad-f0104c31fcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:16.544367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782501e5-2baa-4723-a2ad-f0104c31fcc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:16.544657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782501e5-2baa-4723-a2ad-f0104c31fcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:16.544939 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782501e5-2baa-4723-a2ad-f0104c31fcc2 admin admin] PATH_INFO: `/v3/projects/97854d7baf264750a1f849f9834f699e/users/32133ae35fad4850b47f677425494d62/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:16.560993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782501e5-2baa-4723-a2ad-f0104c31fcc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97854d7baf264750a1f849f9834f699e, user_id=32133ae35fad4850b47f677425494d62, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:16.565236 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782501e5-2baa-4723-a2ad-f0104c31fcc2 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:16.569250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e9aae23c-0d0c-4f57-95bd-2d2c9f4d08c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c234bdbdaeec4f6f98747eb2d218dfb1'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:16.584076 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e9aae23c-0d0c-4f57-95bd-2d2c9f4d08c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c234bdbdaeec4f6f98747eb2d218dfb1'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:16.641736 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1313/2603] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:16 2022] PUT /identity/v3/projects/97854d7baf264750a1f849f9834f699e/users/32133ae35fad4850b47f677425494d62/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:16.652728 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ae5fa-a10e-4569-ad19-47be741a66d6 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:16.653026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ae5fa-a10e-4569-ad19-47be741a66d6 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:16.653345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ae5fa-a10e-4569-ad19-47be741a66d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:16.668644 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e9aae23c-0d0c-4f57-95bd-2d2c9f4d08c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c234bdbdaeec4f6f98747eb2d218dfb1'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:16.669447 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e9aae23c-0d0c-4f57-95bd-2d2c9f4d08c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c234bdbdaeec4f6f98747eb2d218dfb1'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:16.679219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e9aae23c-0d0c-4f57-95bd-2d2c9f4d08c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c234bdbdaeec4f6f98747eb2d218dfb1'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:16.685176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-1a4ae5fa-a10e-4569-ad19-47be741a66d6 None None] MFA Rules not processed for user `32133ae35fad4850b47f677425494d62`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:16.685849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1291/2604] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:04:16 2022] DELETE /identity/v3/users/c234bdbdaeec4f6f98747eb2d218dfb1 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:16.686490 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-1a4ae5fa-a10e-4569-ad19-47be741a66d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:16.783066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1314/2605] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:04:16.788034 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aae23c-0d0c-4f57-95bd-2d2c9f4d08c9 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:16.801265 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e9aae23c-0d0c-4f57-95bd-2d2c9f4d08c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:16.869838 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aae23c-0d0c-4f57-95bd-2d2c9f4d08c9 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:16.877290 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22576839-8995-4efd-b588-f43ad939f258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:16.877984 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22576839-8995-4efd-b588-f43ad939f258 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:16.878300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22576839-8995-4efd-b588-f43ad939f258 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:16.878587 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22576839-8995-4efd-b588-f43ad939f258 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:16.879408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22576839-8995-4efd-b588-f43ad939f258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:16.882028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22576839-8995-4efd-b588-f43ad939f258 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:16.972409 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1292/2606] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:16 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:16.977130 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ae5fa-a10e-4569-ad19-47be741a66d6 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:16.990622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ae5fa-a10e-4569-ad19-47be741a66d6 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:17.061048 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531288bb-1e8e-4832-ab37-b73ba1470a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:17.061900 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531288bb-1e8e-4832-ab37-b73ba1470a88 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:17.062483 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531288bb-1e8e-4832-ab37-b73ba1470a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:17.062827 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531288bb-1e8e-4832-ab37-b73ba1470a88 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:17.067299 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531288bb-1e8e-4832-ab37-b73ba1470a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:17.067431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:17.067989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531288bb-1e8e-4832-ab37-b73ba1470a88 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:17.157048 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1315/2607] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:04:16 2022] POST /identity/v3/users => generated 296 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:17.159846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22576839-8995-4efd-b588-f43ad939f258 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:17.172772 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22576839-8995-4efd-b588-f43ad939f258 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:17.179063 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d6484-b157-4532-822a-67f7c16f4dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:17.179855 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d6484-b157-4532-822a-67f7c16f4dbc admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:17.180217 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d6484-b157-4532-822a-67f7c16f4dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:17.180578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d6484-b157-4532-822a-67f7c16f4dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:17.181537 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d6484-b157-4532-822a-67f7c16f4dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:17.183286 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d6484-b157-4532-822a-67f7c16f4dbc admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:17.196878 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1293/2608] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:17.200516 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531288bb-1e8e-4832-ab37-b73ba1470a88 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:17.212210 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531288bb-1e8e-4832-ab37-b73ba1470a88 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:17.217686 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae19cbf-c169-45a7-ac11-5efcd80a3e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:17.218589 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae19cbf-c169-45a7-ac11-5efcd80a3e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:17.218872 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae19cbf-c169-45a7-ac11-5efcd80a3e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:17.219151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae19cbf-c169-45a7-ac11-5efcd80a3e7b admin admin] PATH_INFO: `/v3/projects/442c36e80ce04ab4b2d16f8da8b29c83/users/2a8fecec9f6f48d49bc8750d995557ce/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:17.235376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:17.242832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae19cbf-c169-45a7-ac11-5efcd80a3e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=442c36e80ce04ab4b2d16f8da8b29c83, user_id=2a8fecec9f6f48d49bc8750d995557ce, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:17.245912 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae19cbf-c169-45a7-ac11-5efcd80a3e7b admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:17.331532 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1316/2609] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:17 2022] PUT /identity/v3/projects/442c36e80ce04ab4b2d16f8da8b29c83/users/2a8fecec9f6f48d49bc8750d995557ce/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:17.333176 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d6484-b157-4532-822a-67f7c16f4dbc admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:17.345561 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d6484-b157-4532-822a-67f7c16f4dbc admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:17.414570 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a090f-f9fc-4898-9542-221058259556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:17.415245 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a090f-f9fc-4898-9542-221058259556 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:17.415533 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a090f-f9fc-4898-9542-221058259556 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:17.415814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a090f-f9fc-4898-9542-221058259556 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:17.416594 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a090f-f9fc-4898-9542-221058259556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:17.418229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a090f-f9fc-4898-9542-221058259556 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:17.429220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1294/2610] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:17.433459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae19cbf-c169-45a7-ac11-5efcd80a3e7b admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:17.444293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae19cbf-c169-45a7-ac11-5efcd80a3e7b admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:17.449325 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ba46b-24a4-4cd9-a9cd-373271928b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:17.449857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ba46b-24a4-4cd9-a9cd-373271928b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:17.450283 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ba46b-24a4-4cd9-a9cd-373271928b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:17.450564 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ba46b-24a4-4cd9-a9cd-373271928b75 admin admin] PATH_INFO: `/v3/projects/442c36e80ce04ab4b2d16f8da8b29c83/users/2a8fecec9f6f48d49bc8750d995557ce/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:17.452515 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ba46b-24a4-4cd9-a9cd-373271928b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=442c36e80ce04ab4b2d16f8da8b29c83, user_id=2a8fecec9f6f48d49bc8750d995557ce, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:17.455165 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ba46b-24a4-4cd9-a9cd-373271928b75 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:17.466045 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1317/2611] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:17 2022] PUT /identity/v3/projects/442c36e80ce04ab4b2d16f8da8b29c83/users/2a8fecec9f6f48d49bc8750d995557ce/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:17.480391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e7238-a4eb-4440-b83c-070bea83b08c None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:17.480556 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e7238-a4eb-4440-b83c-070bea83b08c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:17.480846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e7238-a4eb-4440-b83c-070bea83b08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:17.509621 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ba46b-24a4-4cd9-a9cd-373271928b75 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:17.514919 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-642ba46b-24a4-4cd9-a9cd-373271928b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:17.529289 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-ee9e7238-a4eb-4440-b83c-070bea83b08c None None] MFA Rules not processed for user `2a8fecec9f6f48d49bc8750d995557ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:17.530703 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ee9e7238-a4eb-4440-b83c-070bea83b08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:17.603457 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:17.612499 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ba46b-24a4-4cd9-a9cd-373271928b75 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:17.618478 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bf48f-cd90-4c5a-8a18-f6371115da9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:17.619350 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bf48f-cd90-4c5a-8a18-f6371115da9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:17.619632 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bf48f-cd90-4c5a-8a18-f6371115da9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:17.619908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bf48f-cd90-4c5a-8a18-f6371115da9b admin admin] PATH_INFO: `/v3/projects/629b4e777b9f44c3a0ff7331b287efab` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:17.621177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bf48f-cd90-4c5a-8a18-f6371115da9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=629b4e777b9f44c3a0ff7331b287efab)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:17.623160 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bf48f-cd90-4c5a-8a18-f6371115da9b admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:17.626324 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1295/2612] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:17.641652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e7238-a4eb-4440-b83c-070bea83b08c None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:17.643074 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ee9e7238-a4eb-4440-b83c-070bea83b08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:17.705375 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e7238-a4eb-4440-b83c-070bea83b08c None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:17.709665 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73981939-a748-4f75-acf2-8065d6e0411e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:17.710344 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73981939-a748-4f75-acf2-8065d6e0411e service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:17.710631 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73981939-a748-4f75-acf2-8065d6e0411e service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:17.710914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73981939-a748-4f75-acf2-8065d6e0411e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:17.721877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73981939-a748-4f75-acf2-8065d6e0411e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:17.723622 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73981939-a748-4f75-acf2-8065d6e0411e service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:17.737309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1296/2613] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 20:04:17.746733 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d86bf48f-cd90-4c5a-8a18-f6371115da9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629b4e777b9f44c3a0ff7331b287efab', 'request_id': 'req-d86bf48f-cd90-4c5a-8a18-f6371115da9b'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:17.754763 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d86bf48f-cd90-4c5a-8a18-f6371115da9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629b4e777b9f44c3a0ff7331b287efab', 'request_id': 'req-d86bf48f-cd90-4c5a-8a18-f6371115da9b'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:17.762514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d86bf48f-cd90-4c5a-8a18-f6371115da9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629b4e777b9f44c3a0ff7331b287efab', 'request_id': 'req-d86bf48f-cd90-4c5a-8a18-f6371115da9b'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:17.847020 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d86bf48f-cd90-4c5a-8a18-f6371115da9b admin admin] The token cache is being invalidate because project 629b4e777b9f44c3a0ff7331b287efab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:04:17.847393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d86bf48f-cd90-4c5a-8a18-f6371115da9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:17.848159 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d86bf48f-cd90-4c5a-8a18-f6371115da9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:17.850384 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1318/2614] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:04:17 2022] DELETE /identity/v3/projects/629b4e777b9f44c3a0ff7331b287efab => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:17.855442 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c828bb5-dd18-4e0a-99d3-f4531824a57f None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:17.855818 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c828bb5-dd18-4e0a-99d3-f4531824a57f None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:17.856172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c828bb5-dd18-4e0a-99d3-f4531824a57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:17.876604 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-3c828bb5-dd18-4e0a-99d3-f4531824a57f None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:17.877922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-3c828bb5-dd18-4e0a-99d3-f4531824a57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:17.950907 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1297/2615] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:17.960141 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e46f0-a72b-461c-b6ec-4f5dcecb56e9 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:17.960434 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e46f0-a72b-461c-b6ec-4f5dcecb56e9 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:17.960750 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e46f0-a72b-461c-b6ec-4f5dcecb56e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:17.981349 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-d02e46f0-a72b-461c-b6ec-4f5dcecb56e9 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:17.982717 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d02e46f0-a72b-461c-b6ec-4f5dcecb56e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:17.991230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1319/2616] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:17.995578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c828bb5-dd18-4e0a-99d3-f4531824a57f None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:18.006160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c828bb5-dd18-4e0a-99d3-f4531824a57f None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:18.011538 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52172da5-8dfc-4a78-a164-3af24683b73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:18.012347 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52172da5-8dfc-4a78-a164-3af24683b73e admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:18.012782 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52172da5-8dfc-4a78-a164-3af24683b73e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:18.013049 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52172da5-8dfc-4a78-a164-3af24683b73e admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:18.014033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52172da5-8dfc-4a78-a164-3af24683b73e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:04:18.014408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52172da5-8dfc-4a78-a164-3af24683b73e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:18.016417 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52172da5-8dfc-4a78-a164-3af24683b73e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:18.029804 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1298/2617] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 20:04:18.038700 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e46f0-a72b-461c-b6ec-4f5dcecb56e9 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:18.047705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e46f0-a72b-461c-b6ec-4f5dcecb56e9 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:18.053069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2243a6-d484-43ff-afb1-c3bb3e7f8186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:18.053833 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2243a6-d484-43ff-afb1-c3bb3e7f8186 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:18.054118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2243a6-d484-43ff-afb1-c3bb3e7f8186 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:18.054404 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2243a6-d484-43ff-afb1-c3bb3e7f8186 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:18.055115 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2243a6-d484-43ff-afb1-c3bb3e7f8186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:18.061201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2243a6-d484-43ff-afb1-c3bb3e7f8186 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:18.186769 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1320/2618] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:18 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:04:18.191407 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52172da5-8dfc-4a78-a164-3af24683b73e admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:18.203823 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52172da5-8dfc-4a78-a164-3af24683b73e admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:18.280859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a01a1-d60e-4fd2-94ec-9889e243dd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:18.282001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a01a1-d60e-4fd2-94ec-9889e243dd42 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:18.282001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a01a1-d60e-4fd2-94ec-9889e243dd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:18.282267 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a01a1-d60e-4fd2-94ec-9889e243dd42 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:18.282994 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a01a1-d60e-4fd2-94ec-9889e243dd42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:18.285306 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a01a1-d60e-4fd2-94ec-9889e243dd42 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:18.377998 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1299/2619] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:04:18 2022] POST /identity/v3/users => generated 291 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:18.386219 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2243a6-d484-43ff-afb1-c3bb3e7f8186 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:18.403491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2243a6-d484-43ff-afb1-c3bb3e7f8186 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:18.409531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25ed5e-1664-410a-bdcd-70d6f3823569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:18.417451 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25ed5e-1664-410a-bdcd-70d6f3823569 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:18.417821 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25ed5e-1664-410a-bdcd-70d6f3823569 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:18.418199 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25ed5e-1664-410a-bdcd-70d6f3823569 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:18.419030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25ed5e-1664-410a-bdcd-70d6f3823569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:18.420828 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25ed5e-1664-410a-bdcd-70d6f3823569 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:18.437572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1321/2620] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 20:04:18.438925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a01a1-d60e-4fd2-94ec-9889e243dd42 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:18.451513 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a01a1-d60e-4fd2-94ec-9889e243dd42 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:18.456563 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fd3df-7e04-4f3d-a585-8570934ee09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:18.457266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fd3df-7e04-4f3d-a585-8570934ee09e admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:18.457552 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fd3df-7e04-4f3d-a585-8570934ee09e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:18.457830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fd3df-7e04-4f3d-a585-8570934ee09e admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:18.459187 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fd3df-7e04-4f3d-a585-8570934ee09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:18.461013 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fd3df-7e04-4f3d-a585-8570934ee09e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:18.462561 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:18.472873 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1300/2621] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:18.477474 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25ed5e-1664-410a-bdcd-70d6f3823569 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:18.487779 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25ed5e-1664-410a-bdcd-70d6f3823569 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:18.492714 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc083b8f-a1f0-42f5-9032-d70a030aba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:18.493626 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc083b8f-a1f0-42f5-9032-d70a030aba08 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:18.493911 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc083b8f-a1f0-42f5-9032-d70a030aba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:18.494188 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc083b8f-a1f0-42f5-9032-d70a030aba08 admin admin] PATH_INFO: `/v3/projects/73135901c6cb4012b315c1bfbf3f8493/users/a3d123c18c4b477eb2f12e8dafafce7f/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:18.507102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:18.524141 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc083b8f-a1f0-42f5-9032-d70a030aba08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73135901c6cb4012b315c1bfbf3f8493, user_id=a3d123c18c4b477eb2f12e8dafafce7f, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:18.527408 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc083b8f-a1f0-42f5-9032-d70a030aba08 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:18.608085 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1322/2622] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:18 2022] PUT /identity/v3/projects/73135901c6cb4012b315c1bfbf3f8493/users/a3d123c18c4b477eb2f12e8dafafce7f/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:18.620847 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d42f1-124d-4875-831c-9070b84034c1 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:18.621140 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d42f1-124d-4875-831c-9070b84034c1 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:18.621465 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d42f1-124d-4875-831c-9070b84034c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:18.651462 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-b93d42f1-124d-4875-831c-9070b84034c1 None None] MFA Rules not processed for user `a3d123c18c4b477eb2f12e8dafafce7f`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:18.652763 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-b93d42f1-124d-4875-831c-9070b84034c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:18.725524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1301/2623] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:18.730142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc083b8f-a1f0-42f5-9032-d70a030aba08 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:18.745766 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d42f1-124d-4875-831c-9070b84034c1 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:18.747286 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-b93d42f1-124d-4875-831c-9070b84034c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:18.798154 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc083b8f-a1f0-42f5-9032-d70a030aba08 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:18.803649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8db750-5dbc-45f7-890a-12706a1a698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:18.804319 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db750-5dbc-45f7-890a-12706a1a698b admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:18.804608 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db750-5dbc-45f7-890a-12706a1a698b admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:18.804902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db750-5dbc-45f7-890a-12706a1a698b admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:18.805633 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8db750-5dbc-45f7-890a-12706a1a698b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:18.807742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8db750-5dbc-45f7-890a-12706a1a698b admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:18.824298 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d42f1-124d-4875-831c-9070b84034c1 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:18.829316 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570de79-836e-4b63-b450-4c311e155be6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a8fecec9f6f48d49bc8750d995557ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442c36e80ce04ab4b2d16f8da8b29c83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:18.830171 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570de79-836e-4b63-b450-4c311e155be6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:18.830459 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570de79-836e-4b63-b450-4c311e155be6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:18.830748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570de79-836e-4b63-b450-4c311e155be6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:18.831584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570de79-836e-4b63-b450-4c311e155be6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:04:18.831929 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570de79-836e-4b63-b450-4c311e155be6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:18.834261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570de79-836e-4b63-b450-4c311e155be6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:18.847460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1302/2624] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 20:04:18.851895 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570de79-836e-4b63-b450-4c311e155be6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:18.867605 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570de79-836e-4b63-b450-4c311e155be6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:18.875547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe78a11-9e06-4f4e-abdc-9261b620fcf9 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a8fecec9f6f48d49bc8750d995557ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442c36e80ce04ab4b2d16f8da8b29c83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:18.876413 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe78a11-9e06-4f4e-abdc-9261b620fcf9 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:18.876778 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe78a11-9e06-4f4e-abdc-9261b620fcf9 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:18.877387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe78a11-9e06-4f4e-abdc-9261b620fcf9 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:18.878457 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe78a11-9e06-4f4e-abdc-9261b620fcf9 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:18.880431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe78a11-9e06-4f4e-abdc-9261b620fcf9 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:18.915404 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1323/2625] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:18 2022] POST /identity/v3/projects => generated 381 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:18.919394 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8db750-5dbc-45f7-890a-12706a1a698b admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:18.988429 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8db750-5dbc-45f7-890a-12706a1a698b admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:18.994054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b522b-55b4-4b35-aa48-00a3729a3e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:18.994728 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b522b-55b4-4b35-aa48-00a3729a3e10 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:18.995021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b522b-55b4-4b35-aa48-00a3729a3e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:18.995299 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b522b-55b4-4b35-aa48-00a3729a3e10 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:18.996005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b522b-55b4-4b35-aa48-00a3729a3e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:18.998426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b522b-55b4-4b35-aa48-00a3729a3e10 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:19.006523 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1303/2626] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:18 2022] POST /identity/v3/projects => generated 355 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:04:19.010777 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe78a11-9e06-4f4e-abdc-9261b620fcf9 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:19.073250 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:19.077255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe78a11-9e06-4f4e-abdc-9261b620fcf9 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:19.082614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd5237-b4cc-4bd2-bacd-3269f23738d6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a8fecec9f6f48d49bc8750d995557ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442c36e80ce04ab4b2d16f8da8b29c83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:19.083347 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd5237-b4cc-4bd2-bacd-3269f23738d6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:19.083973 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd5237-b4cc-4bd2-bacd-3269f23738d6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:19.084254 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd5237-b4cc-4bd2-bacd-3269f23738d6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:19.089321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1324/2627] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:04:18 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:04:19.089534 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd5237-b4cc-4bd2-bacd-3269f23738d6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:04:19.089534 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd5237-b4cc-4bd2-bacd-3269f23738d6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:19.089534 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd5237-b4cc-4bd2-bacd-3269f23738d6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:19.089821 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b522b-55b4-4b35-aa48-00a3729a3e10 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:19.100803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b522b-55b4-4b35-aa48-00a3729a3e10 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:19.103084 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1304/2628] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 20:04:19.140543 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd5237-b4cc-4bd2-bacd-3269f23738d6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:19.151231 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd5237-b4cc-4bd2-bacd-3269f23738d6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:19.156468 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a90e71-fe0e-4e8d-b8de-dfd435340fb6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a8fecec9f6f48d49bc8750d995557ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '442c36e80ce04ab4b2d16f8da8b29c83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:19.157396 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a90e71-fe0e-4e8d-b8de-dfd435340fb6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:19.157691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a90e71-fe0e-4e8d-b8de-dfd435340fb6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:19.158028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a90e71-fe0e-4e8d-b8de-dfd435340fb6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] PATH_INFO: `/v3/projects/2e152522a2c54cc8a7b1011530da4b66` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:19.159214 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a90e71-fe0e-4e8d-b8de-dfd435340fb6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2e152522a2c54cc8a7b1011530da4b66)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:19.161334 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a90e71-fe0e-4e8d-b8de-dfd435340fb6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:19.164966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e0601-a627-46ce-bf43-55645d6d6ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:19.165675 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e0601-a627-46ce-bf43-55645d6d6ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:19.165960 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e0601-a627-46ce-bf43-55645d6d6ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:19.166330 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e0601-a627-46ce-bf43-55645d6d6ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:19.167137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e0601-a627-46ce-bf43-55645d6d6ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:19.168832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e0601-a627-46ce-bf43-55645d6d6ea3 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:19.183795 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1325/2629] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 20:04:19.188152 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e0601-a627-46ce-bf43-55645d6d6ea3 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:19.193340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:19.198713 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e0601-a627-46ce-bf43-55645d6d6ea3 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:19.203380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15879b-c48f-4494-9bfe-812203956fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:19.206054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15879b-c48f-4494-9bfe-812203956fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:19.206054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15879b-c48f-4494-9bfe-812203956fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:19.206054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15879b-c48f-4494-9bfe-812203956fa1 admin admin] PATH_INFO: `/v3/projects/8e50697bbc53451f98f65ffab6812751/users/fd0556bdb43d49bc842fe37864612187/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:19.220838 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15879b-c48f-4494-9bfe-812203956fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e50697bbc53451f98f65ffab6812751, user_id=fd0556bdb43d49bc842fe37864612187, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:19.223735 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15879b-c48f-4494-9bfe-812203956fa1 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:19.292302 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1326/2630] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:19 2022] PUT /identity/v3/projects/8e50697bbc53451f98f65ffab6812751/users/fd0556bdb43d49bc842fe37864612187/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:19.296231 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15879b-c48f-4494-9bfe-812203956fa1 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:19.309237 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c4a90e71-fe0e-4e8d-b8de-dfd435340fb6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e152522a2c54cc8a7b1011530da4b66', 'request_id': 'req-c4a90e71-fe0e-4e8d-b8de-dfd435340fb6'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:19.317095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c4a90e71-fe0e-4e8d-b8de-dfd435340fb6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e152522a2c54cc8a7b1011530da4b66', 'request_id': 'req-c4a90e71-fe0e-4e8d-b8de-dfd435340fb6'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:19.322808 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c4a90e71-fe0e-4e8d-b8de-dfd435340fb6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e152522a2c54cc8a7b1011530da4b66', 'request_id': 'req-c4a90e71-fe0e-4e8d-b8de-dfd435340fb6'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:19.365702 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15879b-c48f-4494-9bfe-812203956fa1 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:19.391478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c4a90e71-fe0e-4e8d-b8de-dfd435340fb6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] The token cache is being invalidate because project 2e152522a2c54cc8a7b1011530da4b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:04:19.391989 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c4a90e71-fe0e-4e8d-b8de-dfd435340fb6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:19.392810 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c4a90e71-fe0e-4e8d-b8de-dfd435340fb6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:19.394421 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1305/2631] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:04:19 2022] DELETE /identity/v3/projects/2e152522a2c54cc8a7b1011530da4b66 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:19.449505 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818cf3e-9317-456f-ba45-c4781a02645a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:19.450532 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818cf3e-9317-456f-ba45-c4781a02645a admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:19.450824 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818cf3e-9317-456f-ba45-c4781a02645a admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:19.451290 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818cf3e-9317-456f-ba45-c4781a02645a admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:19.452031 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818cf3e-9317-456f-ba45-c4781a02645a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:19.454280 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818cf3e-9317-456f-ba45-c4781a02645a admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:19.469206 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1327/2632] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 20:04:19.470542 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a90e71-fe0e-4e8d-b8de-dfd435340fb6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:19.475035 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-c4a90e71-fe0e-4e8d-b8de-dfd435340fb6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:19.491627 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a90e71-fe0e-4e8d-b8de-dfd435340fb6 tempest-VolumeQuotaClassesTest-329121036 tempest-VolumeQuotaClassesTest-329121036-project-admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:19.499346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b4cb5-f6b5-48d8-9f03-9f61139aec1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:19.501059 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b4cb5-f6b5-48d8-9f03-9f61139aec1f admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:19.501744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b4cb5-f6b5-48d8-9f03-9f61139aec1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:19.502166 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b4cb5-f6b5-48d8-9f03-9f61139aec1f admin admin] PATH_INFO: `/v3/projects/8e50697bbc53451f98f65ffab6812751/users/fd0556bdb43d49bc842fe37864612187/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:19.509203 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b4cb5-f6b5-48d8-9f03-9f61139aec1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e50697bbc53451f98f65ffab6812751, user_id=fd0556bdb43d49bc842fe37864612187, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:19.511867 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b4cb5-f6b5-48d8-9f03-9f61139aec1f admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:19.532329 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1306/2633] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:19 2022] PUT /identity/v3/projects/8e50697bbc53451f98f65ffab6812751/users/fd0556bdb43d49bc842fe37864612187/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:19.543215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb98551-13c2-4b08-9c88-3ff56a2912e8 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:19.543700 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb98551-13c2-4b08-9c88-3ff56a2912e8 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:19.543783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb98551-13c2-4b08-9c88-3ff56a2912e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:19.579917 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-9bb98551-13c2-4b08-9c88-3ff56a2912e8 None None] MFA Rules not processed for user `fd0556bdb43d49bc842fe37864612187`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:19.581131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-9bb98551-13c2-4b08-9c88-3ff56a2912e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:19.666132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1328/2634] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:19.766498 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b4cb5-f6b5-48d8-9f03-9f61139aec1f admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:19.768232 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-262b4cb5-f6b5-48d8-9f03-9f61139aec1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:19.831737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b4cb5-f6b5-48d8-9f03-9f61139aec1f admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:19.836842 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbadd67a-ec4b-47ec-9231-315d91f7b723 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:19.837532 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadd67a-ec4b-47ec-9231-315d91f7b723 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:19.837819 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadd67a-ec4b-47ec-9231-315d91f7b723 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:19.838308 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadd67a-ec4b-47ec-9231-315d91f7b723 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:19.847630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbadd67a-ec4b-47ec-9231-315d91f7b723 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:19.849054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbadd67a-ec4b-47ec-9231-315d91f7b723 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:19.858903 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1307/2635] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:04:20.042576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb98551-13c2-4b08-9c88-3ff56a2912e8 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:20.052679 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb98551-13c2-4b08-9c88-3ff56a2912e8 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:20.056441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f79223-ba12-453c-81ee-de0010da470c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:20.057078 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f79223-ba12-453c-81ee-de0010da470c service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:20.057412 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f79223-ba12-453c-81ee-de0010da470c service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:20.057695 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f79223-ba12-453c-81ee-de0010da470c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:20.059451 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-74f79223-ba12-453c-81ee-de0010da470c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:20.064340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:20.129640 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f79223-ba12-453c-81ee-de0010da470c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:20.134451 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f79223-ba12-453c-81ee-de0010da470c service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:20.135449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbadd67a-ec4b-47ec-9231-315d91f7b723 service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:20.136929 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-dbadd67a-ec4b-47ec-9231-315d91f7b723 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:20.141600 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1329/2636] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:04:20.210164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbadd67a-ec4b-47ec-9231-315d91f7b723 service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:20.214928 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2249d-afce-44b5-ab0c-c89cc5a49bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:20.215791 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2249d-afce-44b5-ab0c-c89cc5a49bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:20.216087 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2249d-afce-44b5-ab0c-c89cc5a49bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:20.216370 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2249d-afce-44b5-ab0c-c89cc5a49bb4 admin admin] PATH_INFO: `/v3/users/32133ae35fad4850b47f677425494d62` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:20.217703 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2249d-afce-44b5-ab0c-c89cc5a49bb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32133ae35fad4850b47f677425494d62)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:20.220015 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2249d-afce-44b5-ab0c-c89cc5a49bb4 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:20.226753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:20.493765 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-16a2249d-afce-44b5-ab0c-c89cc5a49bb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32133ae35fad4850b47f677425494d62'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:20.506888 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-16a2249d-afce-44b5-ab0c-c89cc5a49bb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32133ae35fad4850b47f677425494d62'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:20.589286 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-16a2249d-afce-44b5-ab0c-c89cc5a49bb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32133ae35fad4850b47f677425494d62'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:20.589933 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-16a2249d-afce-44b5-ab0c-c89cc5a49bb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32133ae35fad4850b47f677425494d62'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:20.598096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-16a2249d-afce-44b5-ab0c-c89cc5a49bb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32133ae35fad4850b47f677425494d62'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:20.605131 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1308/2637] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:04:20 2022] DELETE /identity/v3/users/32133ae35fad4850b47f677425494d62 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:20.609993 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5174673-2e02-4de0-ade2-e579fdb9e776 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:20.610555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5174673-2e02-4de0-ade2-e579fdb9e776 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:20.610644 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5174673-2e02-4de0-ade2-e579fdb9e776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:20.629445 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-e5174673-2e02-4de0-ade2-e579fdb9e776 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:20.630726 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e5174673-2e02-4de0-ade2-e579fdb9e776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:20.639946 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2249d-afce-44b5-ab0c-c89cc5a49bb4 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:20.641668 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-16a2249d-afce-44b5-ab0c-c89cc5a49bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:20.697411 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1330/2638] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:04:20.707643 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5174673-2e02-4de0-ade2-e579fdb9e776 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:20.709468 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e5174673-2e02-4de0-ade2-e579fdb9e776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:20.713145 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2249d-afce-44b5-ab0c-c89cc5a49bb4 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:20.717981 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209441c-3e14-4f0f-8e01-fa88a103c6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:20.718862 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209441c-3e14-4f0f-8e01-fa88a103c6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:20.719144 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209441c-3e14-4f0f-8e01-fa88a103c6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:20.719415 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209441c-3e14-4f0f-8e01-fa88a103c6d8 admin admin] PATH_INFO: `/v3/users/a3d123c18c4b477eb2f12e8dafafce7f` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:20.720716 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209441c-3e14-4f0f-8e01-fa88a103c6d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d123c18c4b477eb2f12e8dafafce7f)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:20.722924 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209441c-3e14-4f0f-8e01-fa88a103c6d8 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:20.772279 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5174673-2e02-4de0-ade2-e579fdb9e776 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:20.775947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4a49f-d041-4c97-8e9e-8c9098ceeb89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:20.776572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4a49f-d041-4c97-8e9e-8c9098ceeb89 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:20.776855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4a49f-d041-4c97-8e9e-8c9098ceeb89 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:20.777133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4a49f-d041-4c97-8e9e-8c9098ceeb89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:20.789421 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4a49f-d041-4c97-8e9e-8c9098ceeb89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:20.790925 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4a49f-d041-4c97-8e9e-8c9098ceeb89 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:20.801102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1331/2639] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:04:20.923674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c209441c-3e14-4f0f-8e01-fa88a103c6d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d123c18c4b477eb2f12e8dafafce7f'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:20.947256 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c209441c-3e14-4f0f-8e01-fa88a103c6d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d123c18c4b477eb2f12e8dafafce7f'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:21.053696 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c209441c-3e14-4f0f-8e01-fa88a103c6d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d123c18c4b477eb2f12e8dafafce7f'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:21.054336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c209441c-3e14-4f0f-8e01-fa88a103c6d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d123c18c4b477eb2f12e8dafafce7f'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:21.076550 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-c209441c-3e14-4f0f-8e01-fa88a103c6d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d123c18c4b477eb2f12e8dafafce7f'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:21.092713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1309/2640] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:04:20 2022] DELETE /identity/v3/users/a3d123c18c4b477eb2f12e8dafafce7f => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:21.097356 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4a49f-d041-4c97-8e9e-8c9098ceeb89 service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:21.108014 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4a49f-d041-4c97-8e9e-8c9098ceeb89 service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:21.108184 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a85ea6-f346-487d-a380-59f7941523c8 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:21.108537 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a85ea6-f346-487d-a380-59f7941523c8 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:21.109054 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a85ea6-f346-487d-a380-59f7941523c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:21.121499 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:21.138242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-94a85ea6-f346-487d-a380-59f7941523c8 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:21.141325 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-94a85ea6-f346-487d-a380-59f7941523c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:21.186183 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:21.191721 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfedf43-0ade-41d7-884e-f6c8636ac6cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:21.192378 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfedf43-0ade-41d7-884e-f6c8636ac6cd service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:21.192658 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfedf43-0ade-41d7-884e-f6c8636ac6cd service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:21.192976 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfedf43-0ade-41d7-884e-f6c8636ac6cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:21.195628 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0dfedf43-0ade-41d7-884e-f6c8636ac6cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:21.213918 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1310/2641] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:21.229477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a85ea6-f346-487d-a380-59f7941523c8 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:21.229477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-94a85ea6-f346-487d-a380-59f7941523c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:21.241506 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a85ea6-f346-487d-a380-59f7941523c8 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:21.245289 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88f3e6-a666-4a35-a3c2-e296ca0124d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:21.245939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88f3e6-a666-4a35-a3c2-e296ca0124d6 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:21.246226 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88f3e6-a666-4a35-a3c2-e296ca0124d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:21.246501 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88f3e6-a666-4a35-a3c2-e296ca0124d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:21.256244 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88f3e6-a666-4a35-a3c2-e296ca0124d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:21.257919 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88f3e6-a666-4a35-a3c2-e296ca0124d6 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:21.267038 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfedf43-0ade-41d7-884e-f6c8636ac6cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:21.271598 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfedf43-0ade-41d7-884e-f6c8636ac6cd service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:21.276830 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1311/2642] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 20:04:21.285942 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88f3e6-a666-4a35-a3c2-e296ca0124d6 service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:21.286224 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1332/2643] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:04:21.290244 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-af88f3e6-a666-4a35-a3c2-e296ca0124d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:21.308409 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88f3e6-a666-4a35-a3c2-e296ca0124d6 service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:21.313907 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968ea57-ffd7-4fd2-b3de-3e6aee0b053a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:21.314864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968ea57-ffd7-4fd2-b3de-3e6aee0b053a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:21.315258 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968ea57-ffd7-4fd2-b3de-3e6aee0b053a admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:21.315537 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968ea57-ffd7-4fd2-b3de-3e6aee0b053a admin admin] PATH_INFO: `/v3/projects/97854d7baf264750a1f849f9834f699e` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:21.316769 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968ea57-ffd7-4fd2-b3de-3e6aee0b053a admin admin] RBAC: Authorizing `identity:delete_project(project_id=97854d7baf264750a1f849f9834f699e)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:21.318800 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968ea57-ffd7-4fd2-b3de-3e6aee0b053a admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:21.438293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-a968ea57-ffd7-4fd2-b3de-3e6aee0b053a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97854d7baf264750a1f849f9834f699e', 'request_id': 'req-a968ea57-ffd7-4fd2-b3de-3e6aee0b053a'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:21.449992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-a968ea57-ffd7-4fd2-b3de-3e6aee0b053a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97854d7baf264750a1f849f9834f699e', 'request_id': 'req-a968ea57-ffd7-4fd2-b3de-3e6aee0b053a'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:21.457558 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-a968ea57-ffd7-4fd2-b3de-3e6aee0b053a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97854d7baf264750a1f849f9834f699e', 'request_id': 'req-a968ea57-ffd7-4fd2-b3de-3e6aee0b053a'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:21.565572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-a968ea57-ffd7-4fd2-b3de-3e6aee0b053a admin admin] The token cache is being invalidate because project 97854d7baf264750a1f849f9834f699e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:04:21.566213 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-a968ea57-ffd7-4fd2-b3de-3e6aee0b053a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:21.566583 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-a968ea57-ffd7-4fd2-b3de-3e6aee0b053a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:21.572084 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1312/2644] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:04:21 2022] DELETE /identity/v3/projects/97854d7baf264750a1f849f9834f699e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:21.573270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfedf43-0ade-41d7-884e-f6c8636ac6cd service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:21.584278 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfedf43-0ade-41d7-884e-f6c8636ac6cd service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:21.671053 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760676e-c04a-4aaa-b052-7592acf7a51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:21.672048 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760676e-c04a-4aaa-b052-7592acf7a51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:21.672355 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760676e-c04a-4aaa-b052-7592acf7a51b admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:21.672642 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760676e-c04a-4aaa-b052-7592acf7a51b admin admin] PATH_INFO: `/v3/users/2a8fecec9f6f48d49bc8750d995557ce` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:21.674005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760676e-c04a-4aaa-b052-7592acf7a51b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a8fecec9f6f48d49bc8750d995557ce)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:21.677893 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760676e-c04a-4aaa-b052-7592acf7a51b admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:21.860504 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2760676e-c04a-4aaa-b052-7592acf7a51b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a8fecec9f6f48d49bc8750d995557ce'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:21.886995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2760676e-c04a-4aaa-b052-7592acf7a51b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a8fecec9f6f48d49bc8750d995557ce'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:21.926501 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968ea57-ffd7-4fd2-b3de-3e6aee0b053a admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:21.928852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-a968ea57-ffd7-4fd2-b3de-3e6aee0b053a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:21.946707 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2760676e-c04a-4aaa-b052-7592acf7a51b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a8fecec9f6f48d49bc8750d995557ce'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:21.947041 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968ea57-ffd7-4fd2-b3de-3e6aee0b053a admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:21.947338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2760676e-c04a-4aaa-b052-7592acf7a51b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a8fecec9f6f48d49bc8750d995557ce'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:21.955934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-2760676e-c04a-4aaa-b052-7592acf7a51b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a8fecec9f6f48d49bc8750d995557ce'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:21.962116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d087e-71a2-4166-a0e5-24f7ed4a196c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:21.963647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d087e-71a2-4166-a0e5-24f7ed4a196c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:21.964226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1333/2645] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:04:21 2022] DELETE /identity/v3/users/2a8fecec9f6f48d49bc8750d995557ce => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:21.964359 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d087e-71a2-4166-a0e5-24f7ed4a196c admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:21.970849 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d087e-71a2-4166-a0e5-24f7ed4a196c admin admin] PATH_INFO: `/v3/projects/73135901c6cb4012b315c1bfbf3f8493` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:21.972831 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d087e-71a2-4166-a0e5-24f7ed4a196c admin admin] RBAC: Authorizing `identity:delete_project(project_id=73135901c6cb4012b315c1bfbf3f8493)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:21.975760 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d087e-71a2-4166-a0e5-24f7ed4a196c admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:22.126671 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9a6d087e-71a2-4166-a0e5-24f7ed4a196c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73135901c6cb4012b315c1bfbf3f8493', 'request_id': 'req-9a6d087e-71a2-4166-a0e5-24f7ed4a196c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:22.144416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9a6d087e-71a2-4166-a0e5-24f7ed4a196c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73135901c6cb4012b315c1bfbf3f8493', 'request_id': 'req-9a6d087e-71a2-4166-a0e5-24f7ed4a196c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:22.151569 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9a6d087e-71a2-4166-a0e5-24f7ed4a196c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73135901c6cb4012b315c1bfbf3f8493', 'request_id': 'req-9a6d087e-71a2-4166-a0e5-24f7ed4a196c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:22.156893 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:22.223890 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9a6d087e-71a2-4166-a0e5-24f7ed4a196c admin admin] The token cache is being invalidate because project 73135901c6cb4012b315c1bfbf3f8493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:04:22.224829 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9a6d087e-71a2-4166-a0e5-24f7ed4a196c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:22.226951 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9a6d087e-71a2-4166-a0e5-24f7ed4a196c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:22.227536 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1313/2646] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:04:21 2022] DELETE /identity/v3/projects/73135901c6cb4012b315c1bfbf3f8493 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:22.231731 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760676e-c04a-4aaa-b052-7592acf7a51b admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:22.233866 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-2760676e-c04a-4aaa-b052-7592acf7a51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:22.266573 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:22.324894 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760676e-c04a-4aaa-b052-7592acf7a51b admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:22.389764 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d087e-71a2-4166-a0e5-24f7ed4a196c admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:22.391641 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-9a6d087e-71a2-4166-a0e5-24f7ed4a196c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:22.393712 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3261727-3d24-4bf9-a53d-8f90bfac8477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:22.395027 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3261727-3d24-4bf9-a53d-8f90bfac8477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:22.395394 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3261727-3d24-4bf9-a53d-8f90bfac8477 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:22.395811 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3261727-3d24-4bf9-a53d-8f90bfac8477 admin admin] PATH_INFO: `/v3/users/fd0556bdb43d49bc842fe37864612187` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:22.399148 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3261727-3d24-4bf9-a53d-8f90bfac8477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd0556bdb43d49bc842fe37864612187)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:22.401739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3261727-3d24-4bf9-a53d-8f90bfac8477 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:22.409169 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d087e-71a2-4166-a0e5-24f7ed4a196c admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:22.416165 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7044f-bfff-48b5-a057-6e1f62505291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:22.417895 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7044f-bfff-48b5-a057-6e1f62505291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:22.418167 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7044f-bfff-48b5-a057-6e1f62505291 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:22.418445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7044f-bfff-48b5-a057-6e1f62505291 admin admin] PATH_INFO: `/v3/projects/442c36e80ce04ab4b2d16f8da8b29c83` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:22.420864 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7044f-bfff-48b5-a057-6e1f62505291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=442c36e80ce04ab4b2d16f8da8b29c83)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:22.427648 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7044f-bfff-48b5-a057-6e1f62505291 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:22.553145 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b6d7044f-bfff-48b5-a057-6e1f62505291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '442c36e80ce04ab4b2d16f8da8b29c83', 'request_id': 'req-b6d7044f-bfff-48b5-a057-6e1f62505291'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:22.560920 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b6d7044f-bfff-48b5-a057-6e1f62505291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '442c36e80ce04ab4b2d16f8da8b29c83', 'request_id': 'req-b6d7044f-bfff-48b5-a057-6e1f62505291'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:22.568128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b6d7044f-bfff-48b5-a057-6e1f62505291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '442c36e80ce04ab4b2d16f8da8b29c83', 'request_id': 'req-b6d7044f-bfff-48b5-a057-6e1f62505291'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:22.648697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b6d7044f-bfff-48b5-a057-6e1f62505291 admin admin] The token cache is being invalidate because project 442c36e80ce04ab4b2d16f8da8b29c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:04:22.651961 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b6d7044f-bfff-48b5-a057-6e1f62505291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:22.651961 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-b6d7044f-bfff-48b5-a057-6e1f62505291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:22.656582 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1314/2647] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:04:22 2022] DELETE /identity/v3/projects/442c36e80ce04ab4b2d16f8da8b29c83 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:22.658891 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827326c5-db8d-4ae9-bb62-5193fb418e40 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:22.659233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827326c5-db8d-4ae9-bb62-5193fb418e40 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:22.659716 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827326c5-db8d-4ae9-bb62-5193fb418e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:22.679779 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d3261727-3d24-4bf9-a53d-8f90bfac8477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd0556bdb43d49bc842fe37864612187'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:22.709377 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-827326c5-db8d-4ae9-bb62-5193fb418e40 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:22.709377 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-827326c5-db8d-4ae9-bb62-5193fb418e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:22.714064 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d3261727-3d24-4bf9-a53d-8f90bfac8477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd0556bdb43d49bc842fe37864612187'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:22.798657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d3261727-3d24-4bf9-a53d-8f90bfac8477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd0556bdb43d49bc842fe37864612187'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:22.799574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d3261727-3d24-4bf9-a53d-8f90bfac8477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd0556bdb43d49bc842fe37864612187'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:22.805071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1315/2648] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:22.811783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d3261727-3d24-4bf9-a53d-8f90bfac8477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd0556bdb43d49bc842fe37864612187'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:22.816576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee427a-9fe5-4d15-92f5-1e7c59e32c26 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:22.816576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee427a-9fe5-4d15-92f5-1e7c59e32c26 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:22.816576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee427a-9fe5-4d15-92f5-1e7c59e32c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:22.821456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1334/2649] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:04:22 2022] DELETE /identity/v3/users/fd0556bdb43d49bc842fe37864612187 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:22.845999 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-86ee427a-9fe5-4d15-92f5-1e7c59e32c26 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:22.847617 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-86ee427a-9fe5-4d15-92f5-1e7c59e32c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:22.929637 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1316/2650] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:22.933973 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3261727-3d24-4bf9-a53d-8f90bfac8477 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:22.945422 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3261727-3d24-4bf9-a53d-8f90bfac8477 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:22.951550 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecad39e-5033-40a9-be37-144643a760d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:22.952332 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecad39e-5033-40a9-be37-144643a760d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:22.952680 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecad39e-5033-40a9-be37-144643a760d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:22.953026 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecad39e-5033-40a9-be37-144643a760d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:22.953933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecad39e-5033-40a9-be37-144643a760d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:04:22.954301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecad39e-5033-40a9-be37-144643a760d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:22.955973 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecad39e-5033-40a9-be37-144643a760d9 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:22.968476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1335/2651] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 20:04:22.973087 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee427a-9fe5-4d15-92f5-1e7c59e32c26 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:22.984188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee427a-9fe5-4d15-92f5-1e7c59e32c26 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:22.991478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7241427-5c76-4f7d-bdf7-ace6d987e6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:22.991478 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7241427-5c76-4f7d-bdf7-ace6d987e6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:22.991773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7241427-5c76-4f7d-bdf7-ace6d987e6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:22.991876 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7241427-5c76-4f7d-bdf7-ace6d987e6c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:22.992766 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7241427-5c76-4f7d-bdf7-ace6d987e6c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:22.995217 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7241427-5c76-4f7d-bdf7-ace6d987e6c0 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:23.068233 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:23.085315 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1317/2652] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:22 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:23.089457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecad39e-5033-40a9-be37-144643a760d9 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:23.100884 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecad39e-5033-40a9-be37-144643a760d9 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:23.153666 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:23.184757 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b1da5-2304-4a53-b4ce-b193aa2646e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:23.185398 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b1da5-2304-4a53-b4ce-b193aa2646e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:23.185689 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b1da5-2304-4a53-b4ce-b193aa2646e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:23.186275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b1da5-2304-4a53-b4ce-b193aa2646e5 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:23.186737 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b1da5-2304-4a53-b4ce-b193aa2646e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:23.188897 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b1da5-2304-4a53-b4ce-b193aa2646e5 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:23.311169 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1336/2653] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:04:23 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:23.312268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7241427-5c76-4f7d-bdf7-ace6d987e6c0 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:23.327917 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7241427-5c76-4f7d-bdf7-ace6d987e6c0 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:23.335508 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8331778-8d84-45e7-902c-1bb5b7041539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:23.337192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8331778-8d84-45e7-902c-1bb5b7041539 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:23.337192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8331778-8d84-45e7-902c-1bb5b7041539 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:23.340236 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8331778-8d84-45e7-902c-1bb5b7041539 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:23.341863 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8331778-8d84-45e7-902c-1bb5b7041539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:23.344011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8331778-8d84-45e7-902c-1bb5b7041539 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:23.362519 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1318/2654] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:23.367071 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b1da5-2304-4a53-b4ce-b193aa2646e5 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:23.385285 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b1da5-2304-4a53-b4ce-b193aa2646e5 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:23.390761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb99ac5-1439-4a4f-b06b-022bb053f902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:23.391601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb99ac5-1439-4a4f-b06b-022bb053f902 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:23.391895 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb99ac5-1439-4a4f-b06b-022bb053f902 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:23.392377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb99ac5-1439-4a4f-b06b-022bb053f902 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:23.393178 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb99ac5-1439-4a4f-b06b-022bb053f902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:23.395022 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb99ac5-1439-4a4f-b06b-022bb053f902 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:23.407501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1337/2655] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:23.412323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8331778-8d84-45e7-902c-1bb5b7041539 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:23.423161 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8331778-8d84-45e7-902c-1bb5b7041539 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:23.428380 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10e9e0-4542-4709-92fe-f403716d7010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:23.429330 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10e9e0-4542-4709-92fe-f403716d7010 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:23.429613 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10e9e0-4542-4709-92fe-f403716d7010 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:23.429892 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10e9e0-4542-4709-92fe-f403716d7010 admin admin] PATH_INFO: `/v3/projects/7ce11a9acbb44173951514b68d39a98d/users/33f74a13563d4a12ab9cca7bd645141e/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:23.442514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb99ac5-1439-4a4f-b06b-022bb053f902 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:23.446707 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-9fb99ac5-1439-4a4f-b06b-022bb053f902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:23.447221 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10e9e0-4542-4709-92fe-f403716d7010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce11a9acbb44173951514b68d39a98d, user_id=33f74a13563d4a12ab9cca7bd645141e, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:23.449908 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10e9e0-4542-4709-92fe-f403716d7010 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:23.502864 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb99ac5-1439-4a4f-b06b-022bb053f902 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:23.502864 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965612ce-5e6c-480e-9abe-fd678370c75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:23.502864 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965612ce-5e6c-480e-9abe-fd678370c75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:23.502864 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965612ce-5e6c-480e-9abe-fd678370c75a admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:23.503668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965612ce-5e6c-480e-9abe-fd678370c75a admin admin] PATH_INFO: `/v3/projects/8e50697bbc53451f98f65ffab6812751` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:23.503668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965612ce-5e6c-480e-9abe-fd678370c75a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e50697bbc53451f98f65ffab6812751)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:23.504233 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965612ce-5e6c-480e-9abe-fd678370c75a admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:23.582310 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1319/2656] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:23 2022] PUT /identity/v3/projects/7ce11a9acbb44173951514b68d39a98d/users/33f74a13563d4a12ab9cca7bd645141e/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:23.595837 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3365e-48b9-4339-b506-4b299ff7190d None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:23.596127 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3365e-48b9-4339-b506-4b299ff7190d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:23.596405 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3365e-48b9-4339-b506-4b299ff7190d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:23.625789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-dfc3365e-48b9-4339-b506-4b299ff7190d None None] MFA Rules not processed for user `33f74a13563d4a12ab9cca7bd645141e`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:23.627026 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-dfc3365e-48b9-4339-b506-4b299ff7190d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:23.685523 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-965612ce-5e6c-480e-9abe-fd678370c75a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e50697bbc53451f98f65ffab6812751', 'request_id': 'req-965612ce-5e6c-480e-9abe-fd678370c75a'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:23.697090 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-965612ce-5e6c-480e-9abe-fd678370c75a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e50697bbc53451f98f65ffab6812751', 'request_id': 'req-965612ce-5e6c-480e-9abe-fd678370c75a'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:23.704223 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-965612ce-5e6c-480e-9abe-fd678370c75a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e50697bbc53451f98f65ffab6812751', 'request_id': 'req-965612ce-5e6c-480e-9abe-fd678370c75a'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:23.720392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1320/2657] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:04:23.724958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3365e-48b9-4339-b506-4b299ff7190d None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:23.780496 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-965612ce-5e6c-480e-9abe-fd678370c75a admin admin] The token cache is being invalidate because project 8e50697bbc53451f98f65ffab6812751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:04:23.780838 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-965612ce-5e6c-480e-9abe-fd678370c75a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:23.782279 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-965612ce-5e6c-480e-9abe-fd678370c75a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:23.785672 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1338/2658] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:04:23 2022] DELETE /identity/v3/projects/8e50697bbc53451f98f65ffab6812751 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:23.790952 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75106538-4cca-4b56-a587-921ceefc79a9 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:23.791273 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75106538-4cca-4b56-a587-921ceefc79a9 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:23.791586 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75106538-4cca-4b56-a587-921ceefc79a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:23.831522 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-75106538-4cca-4b56-a587-921ceefc79a9 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:23.834202 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-75106538-4cca-4b56-a587-921ceefc79a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:23.856929 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3365e-48b9-4339-b506-4b299ff7190d None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:23.934374 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1339/2659] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:04:23.940234 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a91fc-244c-4b79-a32d-cb30114985d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:23.940477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a91fc-244c-4b79-a32d-cb30114985d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:23.940889 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a91fc-244c-4b79-a32d-cb30114985d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:23.941389 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a91fc-244c-4b79-a32d-cb30114985d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:23.942614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a91fc-244c-4b79-a32d-cb30114985d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:23.944059 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300b949-262a-4630-adf9-101c7872a44d None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:23.944395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300b949-262a-4630-adf9-101c7872a44d None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:23.944519 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a91fc-244c-4b79-a32d-cb30114985d8 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:23.944922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300b949-262a-4630-adf9-101c7872a44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:23.988689 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:23.989406 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-0300b949-262a-4630-adf9-101c7872a44d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:23.989406 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0300b949-262a-4630-adf9-101c7872a44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:23.989406 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1340/2660] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:04:23.999134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300b949-262a-4630-adf9-101c7872a44d None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:24.009758 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300b949-262a-4630-adf9-101c7872a44d None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:24.015500 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669948b-d9d1-41c5-83fb-78fe45690962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:24.016881 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669948b-d9d1-41c5-83fb-78fe45690962 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:24.017545 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669948b-d9d1-41c5-83fb-78fe45690962 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:24.018161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669948b-d9d1-41c5-83fb-78fe45690962 admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:24.019195 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669948b-d9d1-41c5-83fb-78fe45690962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:04:24.019619 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669948b-d9d1-41c5-83fb-78fe45690962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:24.022600 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669948b-d9d1-41c5-83fb-78fe45690962 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:24.039715 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1341/2661] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 20:04:24.044132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669948b-d9d1-41c5-83fb-78fe45690962 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:24.054257 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669948b-d9d1-41c5-83fb-78fe45690962 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:24.058918 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a22238-bc54-4488-9cb7-f5154a17ae0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:24.059557 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a22238-bc54-4488-9cb7-f5154a17ae0f admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:24.059844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a22238-bc54-4488-9cb7-f5154a17ae0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:24.060125 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a22238-bc54-4488-9cb7-f5154a17ae0f admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:24.060813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a22238-bc54-4488-9cb7-f5154a17ae0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:24.062820 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a22238-bc54-4488-9cb7-f5154a17ae0f admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:24.073325 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:24.247115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1321/2662] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:23 2022] POST /identity/v3/projects => generated 389 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:24.247845 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1342/2663] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:24 2022] POST /identity/v3/projects => generated 385 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:04:24.250697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a91fc-244c-4b79-a32d-cb30114985d8 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:24.251722 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a22238-bc54-4488-9cb7-f5154a17ae0f admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:24.254501 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-434a91fc-244c-4b79-a32d-cb30114985d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:24.349106 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a22238-bc54-4488-9cb7-f5154a17ae0f admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:24.354595 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a91fc-244c-4b79-a32d-cb30114985d8 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:24.355873 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846a0c5-c3df-435d-a65c-aac91386751f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:24.356730 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846a0c5-c3df-435d-a65c-aac91386751f admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:24.357034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846a0c5-c3df-435d-a65c-aac91386751f admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:24.357387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846a0c5-c3df-435d-a65c-aac91386751f admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:24.358251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846a0c5-c3df-435d-a65c-aac91386751f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:24.360334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846a0c5-c3df-435d-a65c-aac91386751f admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:24.363610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6507c-3186-4bac-9a8e-1dd8d52a32dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:24.366035 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6507c-3186-4bac-9a8e-1dd8d52a32dc admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:24.366035 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6507c-3186-4bac-9a8e-1dd8d52a32dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:24.366035 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6507c-3186-4bac-9a8e-1dd8d52a32dc admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:24.368087 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6507c-3186-4bac-9a8e-1dd8d52a32dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:24.369715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6507c-3186-4bac-9a8e-1dd8d52a32dc admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:24.467953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1343/2664] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:04:24 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:24.479051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846a0c5-c3df-435d-a65c-aac91386751f admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:24.479262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1322/2665] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:04:24 2022] POST /identity/v3/users => generated 301 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:24.481618 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6507c-3186-4bac-9a8e-1dd8d52a32dc admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:24.482012 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846a0c5-c3df-435d-a65c-aac91386751f admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:24.489236 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f19e90-5549-40dd-86b9-9cd7c2dd7188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:24.489236 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f19e90-5549-40dd-86b9-9cd7c2dd7188 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:24.489236 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f19e90-5549-40dd-86b9-9cd7c2dd7188 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:24.489236 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f19e90-5549-40dd-86b9-9cd7c2dd7188 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:24.490322 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f19e90-5549-40dd-86b9-9cd7c2dd7188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:24.492112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f19e90-5549-40dd-86b9-9cd7c2dd7188 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:24.494647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6507c-3186-4bac-9a8e-1dd8d52a32dc admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:24.499538 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c261ea-5880-400f-adcd-527563ee366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:24.500242 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c261ea-5880-400f-adcd-527563ee366d admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:24.500600 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c261ea-5880-400f-adcd-527563ee366d admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:24.500953 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c261ea-5880-400f-adcd-527563ee366d admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:24.501783 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c261ea-5880-400f-adcd-527563ee366d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:24.505070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1344/2666] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:24.505276 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c261ea-5880-400f-adcd-527563ee366d admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:24.506657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f19e90-5549-40dd-86b9-9cd7c2dd7188 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:24.514885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1323/2667] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:24.519091 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f19e90-5549-40dd-86b9-9cd7c2dd7188 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:24.520770 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c295565-1e4e-4d35-bb25-03f5a484adc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:24.522410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c261ea-5880-400f-adcd-527563ee366d admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:24.522779 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c295565-1e4e-4d35-bb25-03f5a484adc6 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:24.523065 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c295565-1e4e-4d35-bb25-03f5a484adc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:24.523345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c295565-1e4e-4d35-bb25-03f5a484adc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:24.524066 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c295565-1e4e-4d35-bb25-03f5a484adc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:24.525684 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c295565-1e4e-4d35-bb25-03f5a484adc6 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:24.532340 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c261ea-5880-400f-adcd-527563ee366d admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:24.536533 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1345/2668] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 20:04:24.540769 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a83b9-251c-4f25-9aa6-b3ff6cf75a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:24.541080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c295565-1e4e-4d35-bb25-03f5a484adc6 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:24.541799 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a83b9-251c-4f25-9aa6-b3ff6cf75a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:24.542106 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a83b9-251c-4f25-9aa6-b3ff6cf75a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:24.542366 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a83b9-251c-4f25-9aa6-b3ff6cf75a45 admin admin] PATH_INFO: `/v3/projects/cbbf63f32e1b41f683962206ec06462e/users/058fd987aba44eb0945c58cdf1c60a42/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:24.550724 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c295565-1e4e-4d35-bb25-03f5a484adc6 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:24.555962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd5cf3-ac70-47e6-9c6c-eae0614e5efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:24.556815 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd5cf3-ac70-47e6-9c6c-eae0614e5efb admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:24.557096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd5cf3-ac70-47e6-9c6c-eae0614e5efb admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:24.557406 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd5cf3-ac70-47e6-9c6c-eae0614e5efb admin admin] PATH_INFO: `/v3/projects/fd5cfd1d93e54d9994b779a5e17a307e/users/81bb1b84cdf746f9955a561dd0578655/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:24.557968 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a83b9-251c-4f25-9aa6-b3ff6cf75a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbbf63f32e1b41f683962206ec06462e, user_id=058fd987aba44eb0945c58cdf1c60a42, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:24.560825 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a83b9-251c-4f25-9aa6-b3ff6cf75a45 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:24.572724 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd5cf3-ac70-47e6-9c6c-eae0614e5efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd5cfd1d93e54d9994b779a5e17a307e, user_id=81bb1b84cdf746f9955a561dd0578655, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:24.575400 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd5cf3-ac70-47e6-9c6c-eae0614e5efb admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:24.623962 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1324/2669] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:24 2022] PUT /identity/v3/projects/cbbf63f32e1b41f683962206ec06462e/users/058fd987aba44eb0945c58cdf1c60a42/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:24.631151 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a83b9-251c-4f25-9aa6-b3ff6cf75a45 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:24.682924 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1346/2670] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:24 2022] PUT /identity/v3/projects/fd5cfd1d93e54d9994b779a5e17a307e/users/81bb1b84cdf746f9955a561dd0578655/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:24.694260 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41b92b-18eb-432e-b4d9-9f09514da445 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:24.694834 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41b92b-18eb-432e-b4d9-9f09514da445 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:24.694834 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41b92b-18eb-432e-b4d9-9f09514da445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:24.714199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a83b9-251c-4f25-9aa6-b3ff6cf75a45 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:24.734541 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-0b41b92b-18eb-432e-b4d9-9f09514da445 None None] MFA Rules not processed for user `81bb1b84cdf746f9955a561dd0578655`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:24.736550 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0b41b92b-18eb-432e-b4d9-9f09514da445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:24.784060 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:24.802821 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581d6ad-708a-4f89-a72d-3b5c9c46fe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:24.803772 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581d6ad-708a-4f89-a72d-3b5c9c46fe77 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:24.804064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581d6ad-708a-4f89-a72d-3b5c9c46fe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:24.804349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581d6ad-708a-4f89-a72d-3b5c9c46fe77 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:24.805894 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581d6ad-708a-4f89-a72d-3b5c9c46fe77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:24.807866 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581d6ad-708a-4f89-a72d-3b5c9c46fe77 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:24.821923 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1325/2671] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 20:04:24.826203 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581d6ad-708a-4f89-a72d-3b5c9c46fe77 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:24.826717 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1347/2672] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:04:24.831043 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41b92b-18eb-432e-b4d9-9f09514da445 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:24.836811 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581d6ad-708a-4f89-a72d-3b5c9c46fe77 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:24.842304 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a8dd2-eadd-4766-bd0b-75b0a4243741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:24.843488 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a8dd2-eadd-4766-bd0b-75b0a4243741 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:24.843877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a8dd2-eadd-4766-bd0b-75b0a4243741 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:24.844260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a8dd2-eadd-4766-bd0b-75b0a4243741 admin admin] PATH_INFO: `/v3/projects/cbbf63f32e1b41f683962206ec06462e/users/058fd987aba44eb0945c58cdf1c60a42/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:24.847973 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a8dd2-eadd-4766-bd0b-75b0a4243741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbbf63f32e1b41f683962206ec06462e, user_id=058fd987aba44eb0945c58cdf1c60a42, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:24.848132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41b92b-18eb-432e-b4d9-9f09514da445 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:24.850966 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a8dd2-eadd-4766-bd0b-75b0a4243741 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:24.854705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2890af-ce5a-4002-bc13-2a2eec1cce6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:24.858944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2890af-ce5a-4002-bc13-2a2eec1cce6a admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:24.858944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2890af-ce5a-4002-bc13-2a2eec1cce6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:24.858944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2890af-ce5a-4002-bc13-2a2eec1cce6a admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:24.858944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2890af-ce5a-4002-bc13-2a2eec1cce6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:24.860470 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2890af-ce5a-4002-bc13-2a2eec1cce6a admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:24.865997 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1326/2673] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:24 2022] PUT /identity/v3/projects/cbbf63f32e1b41f683962206ec06462e/users/058fd987aba44eb0945c58cdf1c60a42/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:24.877547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56067305-1f63-4c90-8874-c42870ce1817 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:24.883084 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56067305-1f63-4c90-8874-c42870ce1817 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:24.883084 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56067305-1f63-4c90-8874-c42870ce1817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:24.907026 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-56067305-1f63-4c90-8874-c42870ce1817 None None] MFA Rules not processed for user `058fd987aba44eb0945c58cdf1c60a42`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:24.908273 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-56067305-1f63-4c90-8874-c42870ce1817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:24.975441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1348/2674] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:24 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:24.979414 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1327/2675] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:24.979578 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2890af-ce5a-4002-bc13-2a2eec1cce6a admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:24.985705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:24.992382 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56067305-1f63-4c90-8874-c42870ce1817 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:24.994063 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-56067305-1f63-4c90-8874-c42870ce1817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:25.078949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56067305-1f63-4c90-8874-c42870ce1817 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:25.079933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2890af-ce5a-4002-bc13-2a2eec1cce6a admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:25.084932 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76267a91-d847-4b8a-94b1-186822dea2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:25.086234 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76267a91-d847-4b8a-94b1-186822dea2b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:25.086234 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76267a91-d847-4b8a-94b1-186822dea2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:25.090765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76267a91-d847-4b8a-94b1-186822dea2b3 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:25.091834 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76267a91-d847-4b8a-94b1-186822dea2b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:25.094169 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76267a91-d847-4b8a-94b1-186822dea2b3 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:25.177010 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cce13-7e73-4e6b-9cdc-6b5101d4676b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:25.178062 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cce13-7e73-4e6b-9cdc-6b5101d4676b service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:25.178368 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cce13-7e73-4e6b-9cdc-6b5101d4676b service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:25.178604 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cce13-7e73-4e6b-9cdc-6b5101d4676b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:25.218486 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1349/2676] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:04:24 2022] POST /identity/v3/users => generated 299 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:04:25.222454 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76267a91-d847-4b8a-94b1-186822dea2b3 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:25.226915 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:25.236524 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76267a91-d847-4b8a-94b1-186822dea2b3 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:25.244150 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e893b99-0062-48d6-a964-d5cb6c57a71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:25.245360 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e893b99-0062-48d6-a964-d5cb6c57a71f admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:25.245657 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e893b99-0062-48d6-a964-d5cb6c57a71f admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:25.246354 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e893b99-0062-48d6-a964-d5cb6c57a71f admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:25.247119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e893b99-0062-48d6-a964-d5cb6c57a71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:25.250664 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e893b99-0062-48d6-a964-d5cb6c57a71f admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:25.265102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1350/2677] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 20:04:25.270109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e893b99-0062-48d6-a964-d5cb6c57a71f admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:25.283727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cce13-7e73-4e6b-9cdc-6b5101d4676b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:25.283727 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cce13-7e73-4e6b-9cdc-6b5101d4676b service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:25.297581 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e893b99-0062-48d6-a964-d5cb6c57a71f admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:25.299282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1328/2678] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 20:04:25.304432 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829d7f7-86b1-41df-b505-254986024cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:25.305708 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829d7f7-86b1-41df-b505-254986024cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:25.305856 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829d7f7-86b1-41df-b505-254986024cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:25.306015 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829d7f7-86b1-41df-b505-254986024cf9 admin admin] PATH_INFO: `/v3/projects/ecfe22b814f8445a8c3c391c56890bdb/users/47221c6715e84de1add2b44058bd7d50/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:25.330608 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829d7f7-86b1-41df-b505-254986024cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecfe22b814f8445a8c3c391c56890bdb, user_id=47221c6715e84de1add2b44058bd7d50, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:25.338016 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829d7f7-86b1-41df-b505-254986024cf9 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:25.459146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cce13-7e73-4e6b-9cdc-6b5101d4676b service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:25.462055 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1351/2679] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:25 2022] PUT /identity/v3/projects/ecfe22b814f8445a8c3c391c56890bdb/users/47221c6715e84de1add2b44058bd7d50/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:25.466132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829d7f7-86b1-41df-b505-254986024cf9 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:25.479096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cce13-7e73-4e6b-9cdc-6b5101d4676b service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:25.556692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829d7f7-86b1-41df-b505-254986024cf9 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:25.563207 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7519bc0-78ff-41fb-af9f-f2e14ee1aba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:25.563899 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7519bc0-78ff-41fb-af9f-f2e14ee1aba4 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:25.564182 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7519bc0-78ff-41fb-af9f-f2e14ee1aba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:25.564457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7519bc0-78ff-41fb-af9f-f2e14ee1aba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:25.565324 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7519bc0-78ff-41fb-af9f-f2e14ee1aba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:25.567318 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7519bc0-78ff-41fb-af9f-f2e14ee1aba4 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:25.570246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd5049-be89-4785-ac29-f18360c7778f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:25.571766 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd5049-be89-4785-ac29-f18360c7778f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:25.572091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd5049-be89-4785-ac29-f18360c7778f admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:25.572572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd5049-be89-4785-ac29-f18360c7778f admin admin] PATH_INFO: `/v3/users/33f74a13563d4a12ab9cca7bd645141e` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:25.575085 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd5049-be89-4785-ac29-f18360c7778f admin admin] RBAC: Authorizing `identity:delete_user(user_id=33f74a13563d4a12ab9cca7bd645141e)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:25.577807 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd5049-be89-4785-ac29-f18360c7778f admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:25.582132 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1352/2680] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:25.586434 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7519bc0-78ff-41fb-af9f-f2e14ee1aba4 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:25.600506 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7519bc0-78ff-41fb-af9f-f2e14ee1aba4 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:25.606897 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd8463-ff15-448e-ae96-6b5b246179a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:25.608029 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd8463-ff15-448e-ae96-6b5b246179a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:25.608319 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd8463-ff15-448e-ae96-6b5b246179a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:25.608596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd8463-ff15-448e-ae96-6b5b246179a8 admin admin] PATH_INFO: `/v3/projects/ecfe22b814f8445a8c3c391c56890bdb/users/47221c6715e84de1add2b44058bd7d50/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:25.612358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd8463-ff15-448e-ae96-6b5b246179a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecfe22b814f8445a8c3c391c56890bdb, user_id=47221c6715e84de1add2b44058bd7d50, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:25.615972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd8463-ff15-448e-ae96-6b5b246179a8 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:25.634367 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1353/2681] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:25 2022] PUT /identity/v3/projects/ecfe22b814f8445a8c3c391c56890bdb/users/47221c6715e84de1add2b44058bd7d50/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:25.645067 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dba1c1-5367-48a1-bfc0-5573f4d8e13e None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:25.645415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dba1c1-5367-48a1-bfc0-5573f4d8e13e None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:25.645700 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dba1c1-5367-48a1-bfc0-5573f4d8e13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:25.675685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-85dba1c1-5367-48a1-bfc0-5573f4d8e13e None None] MFA Rules not processed for user `47221c6715e84de1add2b44058bd7d50`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:25.676950 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-85dba1c1-5367-48a1-bfc0-5573f4d8e13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:25.715388 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:25.753535 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1354/2682] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:25.764230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dba1c1-5367-48a1-bfc0-5573f4d8e13e None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:25.824395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dba1c1-5367-48a1-bfc0-5573f4d8e13e None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:25.824877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d8fd5049-be89-4785-ac29-f18360c7778f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33f74a13563d4a12ab9cca7bd645141e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:25.829207 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982f9f3-e49d-48b6-9dda-a29c4edddefa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:25.830081 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982f9f3-e49d-48b6-9dda-a29c4edddefa service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:25.830628 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982f9f3-e49d-48b6-9dda-a29c4edddefa service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:25.831079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982f9f3-e49d-48b6-9dda-a29c4edddefa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:25.838382 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d8fd5049-be89-4785-ac29-f18360c7778f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33f74a13563d4a12ab9cca7bd645141e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:25.916218 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982f9f3-e49d-48b6-9dda-a29c4edddefa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:25.921733 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982f9f3-e49d-48b6-9dda-a29c4edddefa service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:25.928465 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1355/2683] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 20:04:25.928920 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982f9f3-e49d-48b6-9dda-a29c4edddefa service cinder] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:25.930238 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-0982f9f3-e49d-48b6-9dda-a29c4edddefa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:25.941968 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d8fd5049-be89-4785-ac29-f18360c7778f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33f74a13563d4a12ab9cca7bd645141e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:25.944941 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d8fd5049-be89-4785-ac29-f18360c7778f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33f74a13563d4a12ab9cca7bd645141e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:25.961083 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d8fd5049-be89-4785-ac29-f18360c7778f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33f74a13563d4a12ab9cca7bd645141e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:25.968943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1329/2684] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:04:25 2022] DELETE /identity/v3/users/33f74a13563d4a12ab9cca7bd645141e => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:25.974690 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49e64c-c4c0-475c-9341-c7a7ad0cd820 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:25.975464 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49e64c-c4c0-475c-9341-c7a7ad0cd820 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:25.975464 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49e64c-c4c0-475c-9341-c7a7ad0cd820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:25.995439 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-4d49e64c-c4c0-475c-9341-c7a7ad0cd820 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:25.997444 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-4d49e64c-c4c0-475c-9341-c7a7ad0cd820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:26.010928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982f9f3-e49d-48b6-9dda-a29c4edddefa service cinder] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:26.034961 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:26.037754 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=100 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:26.064212 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1330/2685] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:26.073808 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49e64c-c4c0-475c-9341-c7a7ad0cd820 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:26.074266 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947c3b5-e0bc-4333-8bac-1dbcc54e129d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:26.075390 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947c3b5-e0bc-4333-8bac-1dbcc54e129d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:26.075540 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-4d49e64c-c4c0-475c-9341-c7a7ad0cd820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:26.075733 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947c3b5-e0bc-4333-8bac-1dbcc54e129d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:26.076082 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947c3b5-e0bc-4333-8bac-1dbcc54e129d admin admin] PATH_INFO: `/v3/users/073ea72b0441442ebfbbf045eecee2b6` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:26.077744 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947c3b5-e0bc-4333-8bac-1dbcc54e129d admin admin] RBAC: Authorizing `identity:delete_user(user_id=073ea72b0441442ebfbbf045eecee2b6)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:26.080114 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947c3b5-e0bc-4333-8bac-1dbcc54e129d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:26.134723 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49e64c-c4c0-475c-9341-c7a7ad0cd820 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:26.139110 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2fc23-002b-49a7-b30c-89e5508567cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:26.139977 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2fc23-002b-49a7-b30c-89e5508567cf service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:26.140268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2fc23-002b-49a7-b30c-89e5508567cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:26.140550 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2fc23-002b-49a7-b30c-89e5508567cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:26.150850 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2fc23-002b-49a7-b30c-89e5508567cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:26.152293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2fc23-002b-49a7-b30c-89e5508567cf service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:26.162653 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1331/2686] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 20:04:26.320346 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-a947c3b5-e0bc-4333-8bac-1dbcc54e129d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '073ea72b0441442ebfbbf045eecee2b6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:26.332055 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-a947c3b5-e0bc-4333-8bac-1dbcc54e129d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '073ea72b0441442ebfbbf045eecee2b6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:26.451765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-a947c3b5-e0bc-4333-8bac-1dbcc54e129d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '073ea72b0441442ebfbbf045eecee2b6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:26.452543 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-a947c3b5-e0bc-4333-8bac-1dbcc54e129d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '073ea72b0441442ebfbbf045eecee2b6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:26.460780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-a947c3b5-e0bc-4333-8bac-1dbcc54e129d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '073ea72b0441442ebfbbf045eecee2b6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:26.467336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1356/2687] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:04:25 2022] DELETE /identity/v3/users/073ea72b0441442ebfbbf045eecee2b6 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:26.612655 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2fc23-002b-49a7-b30c-89e5508567cf service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:26.614212 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-07d2fc23-002b-49a7-b30c-89e5508567cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:26.628145 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2fc23-002b-49a7-b30c-89e5508567cf service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:26.698281 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4e007-267b-4985-9bb6-f0ae8acf20e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:26.699174 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4e007-267b-4985-9bb6-f0ae8acf20e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:26.699460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4e007-267b-4985-9bb6-f0ae8acf20e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:26.699741 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4e007-267b-4985-9bb6-f0ae8acf20e8 admin admin] PATH_INFO: `/v3/projects/7ce11a9acbb44173951514b68d39a98d` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:26.700916 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4e007-267b-4985-9bb6-f0ae8acf20e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce11a9acbb44173951514b68d39a98d)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:26.702892 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4e007-267b-4985-9bb6-f0ae8acf20e8 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:26.745623 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947c3b5-e0bc-4333-8bac-1dbcc54e129d admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:26.749389 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-a947c3b5-e0bc-4333-8bac-1dbcc54e129d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:26.765656 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947c3b5-e0bc-4333-8bac-1dbcc54e129d admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:26.770441 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237eaf2-20e4-4c1c-b89c-8e1fa5cdbfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:26.779545 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237eaf2-20e4-4c1c-b89c-8e1fa5cdbfde admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:26.779862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237eaf2-20e4-4c1c-b89c-8e1fa5cdbfde admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:26.780151 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237eaf2-20e4-4c1c-b89c-8e1fa5cdbfde admin admin] PATH_INFO: `/v3/projects/507476ff29b34a1085822fdd3e68dcaf` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:26.781564 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237eaf2-20e4-4c1c-b89c-8e1fa5cdbfde admin admin] RBAC: Authorizing `identity:delete_project(project_id=507476ff29b34a1085822fdd3e68dcaf)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:26.783559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237eaf2-20e4-4c1c-b89c-8e1fa5cdbfde admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:26.828594 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f7e4e007-267b-4985-9bb6-f0ae8acf20e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce11a9acbb44173951514b68d39a98d', 'request_id': 'req-f7e4e007-267b-4985-9bb6-f0ae8acf20e8'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:26.836050 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f7e4e007-267b-4985-9bb6-f0ae8acf20e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce11a9acbb44173951514b68d39a98d', 'request_id': 'req-f7e4e007-267b-4985-9bb6-f0ae8acf20e8'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:26.841825 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f7e4e007-267b-4985-9bb6-f0ae8acf20e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce11a9acbb44173951514b68d39a98d', 'request_id': 'req-f7e4e007-267b-4985-9bb6-f0ae8acf20e8'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:26.908072 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6237eaf2-20e4-4c1c-b89c-8e1fa5cdbfde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507476ff29b34a1085822fdd3e68dcaf', 'request_id': 'req-6237eaf2-20e4-4c1c-b89c-8e1fa5cdbfde'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:26.914690 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6237eaf2-20e4-4c1c-b89c-8e1fa5cdbfde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507476ff29b34a1085822fdd3e68dcaf', 'request_id': 'req-6237eaf2-20e4-4c1c-b89c-8e1fa5cdbfde'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:26.920784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6237eaf2-20e4-4c1c-b89c-8e1fa5cdbfde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507476ff29b34a1085822fdd3e68dcaf', 'request_id': 'req-6237eaf2-20e4-4c1c-b89c-8e1fa5cdbfde'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:26.952253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f7e4e007-267b-4985-9bb6-f0ae8acf20e8 admin admin] The token cache is being invalidate because project 7ce11a9acbb44173951514b68d39a98d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:04:26.952481 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f7e4e007-267b-4985-9bb6-f0ae8acf20e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:26.953075 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-f7e4e007-267b-4985-9bb6-f0ae8acf20e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:26.954824 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1332/2688] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:04:26 2022] DELETE /identity/v3/projects/7ce11a9acbb44173951514b68d39a98d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:26.959091 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4e007-267b-4985-9bb6-f0ae8acf20e8 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:26.960519 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f7e4e007-267b-4985-9bb6-f0ae8acf20e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:26.976154 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:27.015199 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6237eaf2-20e4-4c1c-b89c-8e1fa5cdbfde admin admin] The token cache is being invalidate because project 507476ff29b34a1085822fdd3e68dcaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:04:27.015498 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6237eaf2-20e4-4c1c-b89c-8e1fa5cdbfde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:27.016137 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-6237eaf2-20e4-4c1c-b89c-8e1fa5cdbfde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:27.017736 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1357/2689] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:04:26 2022] DELETE /identity/v3/projects/507476ff29b34a1085822fdd3e68dcaf => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:27.022650 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb891513-6d90-4c0e-a36a-969a93424be3 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:27.023560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb891513-6d90-4c0e-a36a-969a93424be3 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:27.023854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb891513-6d90-4c0e-a36a-969a93424be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:27.029220 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4e007-267b-4985-9bb6-f0ae8acf20e8 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:27.042174 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-cb891513-6d90-4c0e-a36a-969a93424be3 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:27.043381 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-cb891513-6d90-4c0e-a36a-969a93424be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:27.070853 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:27.092155 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4c43d-7ea5-4675-b3bd-f95bb1c7eb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:27.092958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4c43d-7ea5-4675-b3bd-f95bb1c7eb09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:27.093271 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4c43d-7ea5-4675-b3bd-f95bb1c7eb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:27.093560 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4c43d-7ea5-4675-b3bd-f95bb1c7eb09 admin admin] PATH_INFO: `/v3/users/058fd987aba44eb0945c58cdf1c60a42` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:27.094800 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4c43d-7ea5-4675-b3bd-f95bb1c7eb09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=058fd987aba44eb0945c58cdf1c60a42)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:27.096980 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4c43d-7ea5-4675-b3bd-f95bb1c7eb09 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:27.106409 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1358/2690] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:27.114316 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d65951-57a1-48ee-a412-ffbae1fa0ff3 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:27.115386 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d65951-57a1-48ee-a412-ffbae1fa0ff3 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:27.115739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d65951-57a1-48ee-a412-ffbae1fa0ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:27.136002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-05d65951-57a1-48ee-a412-ffbae1fa0ff3 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:27.136002 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-05d65951-57a1-48ee-a412-ffbae1fa0ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:27.144152 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1359/2691] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:04:27.148328 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d65951-57a1-48ee-a412-ffbae1fa0ff3 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:27.157531 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d65951-57a1-48ee-a412-ffbae1fa0ff3 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:27.163191 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44c238-ee35-4959-a5de-bced48b3af96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:27.163833 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44c238-ee35-4959-a5de-bced48b3af96 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:27.164525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44c238-ee35-4959-a5de-bced48b3af96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:27.164525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44c238-ee35-4959-a5de-bced48b3af96 admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:27.165131 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44c238-ee35-4959-a5de-bced48b3af96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:04:27.165495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44c238-ee35-4959-a5de-bced48b3af96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:27.167096 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44c238-ee35-4959-a5de-bced48b3af96 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:27.179957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1360/2692] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 20:04:27.184273 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44c238-ee35-4959-a5de-bced48b3af96 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:27.194233 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44c238-ee35-4959-a5de-bced48b3af96 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:27.198823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfaa8c1-2eb1-465e-a166-9521c8ebe9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:27.199434 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfaa8c1-2eb1-465e-a166-9521c8ebe9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:27.199719 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfaa8c1-2eb1-465e-a166-9521c8ebe9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:27.199996 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfaa8c1-2eb1-465e-a166-9521c8ebe9d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:27.200664 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfaa8c1-2eb1-465e-a166-9521c8ebe9d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:27.202553 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfaa8c1-2eb1-465e-a166-9521c8ebe9d9 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:27.316527 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1361/2693] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:27 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:04:27.321020 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfaa8c1-2eb1-465e-a166-9521c8ebe9d9 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:27.346026 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-50f4c43d-7ea5-4675-b3bd-f95bb1c7eb09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '058fd987aba44eb0945c58cdf1c60a42'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:27.358615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-50f4c43d-7ea5-4675-b3bd-f95bb1c7eb09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '058fd987aba44eb0945c58cdf1c60a42'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:27.384534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfaa8c1-2eb1-465e-a166-9521c8ebe9d9 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:27.389417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac5549-dd64-4a62-aa23-2ab5160c4add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:27.390099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac5549-dd64-4a62-aa23-2ab5160c4add admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:27.390393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac5549-dd64-4a62-aa23-2ab5160c4add admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:27.390670 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac5549-dd64-4a62-aa23-2ab5160c4add admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:27.391347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac5549-dd64-4a62-aa23-2ab5160c4add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:27.393338 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac5549-dd64-4a62-aa23-2ab5160c4add admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:27.423912 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-50f4c43d-7ea5-4675-b3bd-f95bb1c7eb09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '058fd987aba44eb0945c58cdf1c60a42'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:27.424592 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-50f4c43d-7ea5-4675-b3bd-f95bb1c7eb09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '058fd987aba44eb0945c58cdf1c60a42'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:27.432598 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-50f4c43d-7ea5-4675-b3bd-f95bb1c7eb09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '058fd987aba44eb0945c58cdf1c60a42'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:27.438486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1333/2694] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:04:26 2022] DELETE /identity/v3/users/058fd987aba44eb0945c58cdf1c60a42 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:27.490412 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1362/2695] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:04:27 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:04:27.493173 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4c43d-7ea5-4675-b3bd-f95bb1c7eb09 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:27.494608 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-50f4c43d-7ea5-4675-b3bd-f95bb1c7eb09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:27.560075 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4c43d-7ea5-4675-b3bd-f95bb1c7eb09 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:27.564599 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25794e2-516d-46d3-8967-358b464e4e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:27.565291 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25794e2-516d-46d3-8967-358b464e4e3c admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:27.565574 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25794e2-516d-46d3-8967-358b464e4e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:27.565848 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25794e2-516d-46d3-8967-358b464e4e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:27.566569 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25794e2-516d-46d3-8967-358b464e4e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:27.568189 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25794e2-516d-46d3-8967-358b464e4e3c admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:27.577842 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1334/2696] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:27.583966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac5549-dd64-4a62-aa23-2ab5160c4add admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:27.592739 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac5549-dd64-4a62-aa23-2ab5160c4add admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:27.597601 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b058103-be23-45f1-8743-e7e3c572c7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:27.598193 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b058103-be23-45f1-8743-e7e3c572c7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:27.598477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b058103-be23-45f1-8743-e7e3c572c7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:27.598756 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b058103-be23-45f1-8743-e7e3c572c7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:27.600261 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b058103-be23-45f1-8743-e7e3c572c7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:27.601892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b058103-be23-45f1-8743-e7e3c572c7b9 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:27.611485 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1363/2697] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:27.615654 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25794e2-516d-46d3-8967-358b464e4e3c admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:27.625787 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25794e2-516d-46d3-8967-358b464e4e3c admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:27.630621 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33548b08-a886-40b2-b2cc-1a197fcb212d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:27.631517 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33548b08-a886-40b2-b2cc-1a197fcb212d admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:27.631803 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33548b08-a886-40b2-b2cc-1a197fcb212d admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:27.632081 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33548b08-a886-40b2-b2cc-1a197fcb212d admin admin] PATH_INFO: `/v3/projects/2a94c2bc051848fbbb59be2d314991d2/users/8d9530f903d14b5fbf1ffbc32c6e7b07/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:27.647925 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33548b08-a886-40b2-b2cc-1a197fcb212d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a94c2bc051848fbbb59be2d314991d2, user_id=8d9530f903d14b5fbf1ffbc32c6e7b07, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:27.650666 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33548b08-a886-40b2-b2cc-1a197fcb212d admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:27.747816 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1335/2698] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:27 2022] PUT /identity/v3/projects/2a94c2bc051848fbbb59be2d314991d2/users/8d9530f903d14b5fbf1ffbc32c6e7b07/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:27.752962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61baed-203c-4040-86bf-cbba6d5494df None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:27.753472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61baed-203c-4040-86bf-cbba6d5494df None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:27.753595 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61baed-203c-4040-86bf-cbba6d5494df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:27.772038 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-2c61baed-203c-4040-86bf-cbba6d5494df None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:27.773520 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-2c61baed-203c-4040-86bf-cbba6d5494df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:27.842196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1364/2699] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:27.857752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33548b08-a886-40b2-b2cc-1a197fcb212d admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:27.857752 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-33548b08-a886-40b2-b2cc-1a197fcb212d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:27.893182 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61baed-203c-4040-86bf-cbba6d5494df None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:27.898645 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-2c61baed-203c-4040-86bf-cbba6d5494df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:27.919161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61baed-203c-4040-86bf-cbba6d5494df None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:27.930833 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354746a-cf2e-41fe-9f90-d29111616666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:27.932377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354746a-cf2e-41fe-9f90-d29111616666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:27.932663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354746a-cf2e-41fe-9f90-d29111616666 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:27.932968 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354746a-cf2e-41fe-9f90-d29111616666 admin admin] PATH_INFO: `/v3/projects/cbbf63f32e1b41f683962206ec06462e` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:27.934371 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354746a-cf2e-41fe-9f90-d29111616666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbbf63f32e1b41f683962206ec06462e)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:27.940054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354746a-cf2e-41fe-9f90-d29111616666 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:27.940194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33548b08-a886-40b2-b2cc-1a197fcb212d admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:27.944931 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cefd51-b19e-4205-92f3-e59a15d8f095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:27.945705 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cefd51-b19e-4205-92f3-e59a15d8f095 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:27.946074 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cefd51-b19e-4205-92f3-e59a15d8f095 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:27.946449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cefd51-b19e-4205-92f3-e59a15d8f095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:27.957205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cefd51-b19e-4205-92f3-e59a15d8f095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:27.959419 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cefd51-b19e-4205-92f3-e59a15d8f095 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:27.970628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1336/2700] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:04:28.115696 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9354746a-cf2e-41fe-9f90-d29111616666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbbf63f32e1b41f683962206ec06462e', 'request_id': 'req-9354746a-cf2e-41fe-9f90-d29111616666'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:28.120127 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9354746a-cf2e-41fe-9f90-d29111616666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbbf63f32e1b41f683962206ec06462e', 'request_id': 'req-9354746a-cf2e-41fe-9f90-d29111616666'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:28.127747 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9354746a-cf2e-41fe-9f90-d29111616666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbbf63f32e1b41f683962206ec06462e', 'request_id': 'req-9354746a-cf2e-41fe-9f90-d29111616666'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:28.209903 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9354746a-cf2e-41fe-9f90-d29111616666 admin admin] The token cache is being invalidate because project cbbf63f32e1b41f683962206ec06462e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:04:28.210212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9354746a-cf2e-41fe-9f90-d29111616666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:28.210944 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-9354746a-cf2e-41fe-9f90-d29111616666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:28.212615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1365/2701] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:04:27 2022] DELETE /identity/v3/projects/cbbf63f32e1b41f683962206ec06462e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:04:28.217808 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddf059-d1de-4ba1-958a-88c47817d127 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:28.218099 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddf059-d1de-4ba1-958a-88c47817d127 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:28.218381 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddf059-d1de-4ba1-958a-88c47817d127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:28.239664 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-63ddf059-d1de-4ba1-958a-88c47817d127 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:28.242204 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-63ddf059-d1de-4ba1-958a-88c47817d127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:28.305141 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1337/2702] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:28.310419 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:28.312719 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd35a1e-a9a9-4a81-8f23-aff39d1d41bc None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:28.313013 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd35a1e-a9a9-4a81-8f23-aff39d1d41bc None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:28.313334 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd35a1e-a9a9-4a81-8f23-aff39d1d41bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:28.331638 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-ddd35a1e-a9a9-4a81-8f23-aff39d1d41bc None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:28.332864 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ddd35a1e-a9a9-4a81-8f23-aff39d1d41bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:28.342352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1366/2703] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:28.347057 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddf059-d1de-4ba1-958a-88c47817d127 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:28.358512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddf059-d1de-4ba1-958a-88c47817d127 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:28.363301 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca949bc9-436f-4c3a-ad39-7590140aff94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:28.363962 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca949bc9-436f-4c3a-ad39-7590140aff94 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:28.364247 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca949bc9-436f-4c3a-ad39-7590140aff94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:28.364554 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca949bc9-436f-4c3a-ad39-7590140aff94 admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:28.366023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca949bc9-436f-4c3a-ad39-7590140aff94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:04:28.366256 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca949bc9-436f-4c3a-ad39-7590140aff94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:28.367868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca949bc9-436f-4c3a-ad39-7590140aff94 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:28.385361 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1338/2704] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 20:04:28.387254 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd35a1e-a9a9-4a81-8f23-aff39d1d41bc None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:28.397835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd35a1e-a9a9-4a81-8f23-aff39d1d41bc None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:28.404443 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50c2d1-f8af-4c2b-af9b-42ff2d99e1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:28.404961 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:28.405506 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50c2d1-f8af-4c2b-af9b-42ff2d99e1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:28.405730 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50c2d1-f8af-4c2b-af9b-42ff2d99e1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:28.406013 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50c2d1-f8af-4c2b-af9b-42ff2d99e1e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:28.406765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50c2d1-f8af-4c2b-af9b-42ff2d99e1e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:28.408706 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50c2d1-f8af-4c2b-af9b-42ff2d99e1e5 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:28.504163 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca949bc9-436f-4c3a-ad39-7590140aff94 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:28.506178 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ca949bc9-436f-4c3a-ad39-7590140aff94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:28.518215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1367/2705] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:28 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:28.523149 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50c2d1-f8af-4c2b-af9b-42ff2d99e1e5 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:28.575562 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca949bc9-436f-4c3a-ad39-7590140aff94 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:28.605134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50c2d1-f8af-4c2b-af9b-42ff2d99e1e5 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:28.612320 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded9958-a575-49db-9c30-c0e899cb7bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:28.613091 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded9958-a575-49db-9c30-c0e899cb7bfe admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:28.613479 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded9958-a575-49db-9c30-c0e899cb7bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:28.613832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded9958-a575-49db-9c30-c0e899cb7bfe admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:28.614974 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded9958-a575-49db-9c30-c0e899cb7bfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:28.617044 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded9958-a575-49db-9c30-c0e899cb7bfe admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:28.631937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe3e25-3c64-4d1b-bde2-db48d1443adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:28.632594 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe3e25-3c64-4d1b-bde2-db48d1443adc service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:28.632880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe3e25-3c64-4d1b-bde2-db48d1443adc service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:28.633205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe3e25-3c64-4d1b-bde2-db48d1443adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:28.635020 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f8fe3e25-3c64-4d1b-bde2-db48d1443adc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:28.644576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe3e25-3c64-4d1b-bde2-db48d1443adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:28.646670 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe3e25-3c64-4d1b-bde2-db48d1443adc service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:28.654690 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1339/2706] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 20:04:28.742337 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1368/2707] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:04:28 2022] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:04:28.746401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe3e25-3c64-4d1b-bde2-db48d1443adc service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:28.760159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe3e25-3c64-4d1b-bde2-db48d1443adc service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:28.765001 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e348bb-2f8e-47ae-b651-169f68d9a4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:28.765836 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e348bb-2f8e-47ae-b651-169f68d9a4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:28.766128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e348bb-2f8e-47ae-b651-169f68d9a4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:28.766839 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e348bb-2f8e-47ae-b651-169f68d9a4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:28.767577 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e348bb-2f8e-47ae-b651-169f68d9a4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:28.769228 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e348bb-2f8e-47ae-b651-169f68d9a4e8 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:28.783826 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1340/2708] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:28.785211 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded9958-a575-49db-9c30-c0e899cb7bfe admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:28.795380 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded9958-a575-49db-9c30-c0e899cb7bfe admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:28.800042 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91806a-ea3f-4307-aa3c-912da07761ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:28.800705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91806a-ea3f-4307-aa3c-912da07761ff admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:28.800995 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91806a-ea3f-4307-aa3c-912da07761ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:28.801326 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91806a-ea3f-4307-aa3c-912da07761ff admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:28.802120 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91806a-ea3f-4307-aa3c-912da07761ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:28.803953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91806a-ea3f-4307-aa3c-912da07761ff admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:28.813890 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1369/2709] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:28.818550 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e348bb-2f8e-47ae-b651-169f68d9a4e8 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:28.828853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e348bb-2f8e-47ae-b651-169f68d9a4e8 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:28.834568 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b7987-c1ab-40d3-a405-0c53a04e4f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:28.835544 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b7987-c1ab-40d3-a405-0c53a04e4f61 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:28.835900 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b7987-c1ab-40d3-a405-0c53a04e4f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:28.836248 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b7987-c1ab-40d3-a405-0c53a04e4f61 admin admin] PATH_INFO: `/v3/projects/5f70acc2104745e798aba0704cb0fd2a/users/72e3bad99e7c4d5398e757c4eda9b0a2/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:28.852323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b7987-c1ab-40d3-a405-0c53a04e4f61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f70acc2104745e798aba0704cb0fd2a, user_id=72e3bad99e7c4d5398e757c4eda9b0a2, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:28.855165 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b7987-c1ab-40d3-a405-0c53a04e4f61 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:28.967738 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1341/2710] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:28 2022] PUT /identity/v3/projects/5f70acc2104745e798aba0704cb0fd2a/users/72e3bad99e7c4d5398e757c4eda9b0a2/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:28.980030 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1d091-54b6-458e-b19c-23a481d087df None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:28.980327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1d091-54b6-458e-b19c-23a481d087df None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:28.980608 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1d091-54b6-458e-b19c-23a481d087df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:29.012768 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-e4d1d091-54b6-458e-b19c-23a481d087df None None] MFA Rules not processed for user `72e3bad99e7c4d5398e757c4eda9b0a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:29.015919 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e4d1d091-54b6-458e-b19c-23a481d087df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:29.087608 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1370/2711] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:29.092169 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b7987-c1ab-40d3-a405-0c53a04e4f61 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:29.169035 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b7987-c1ab-40d3-a405-0c53a04e4f61 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:29.173976 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d186801-37a1-4411-9138-cbd45a7798cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:29.174636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d186801-37a1-4411-9138-cbd45a7798cd admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:29.174924 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d186801-37a1-4411-9138-cbd45a7798cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:29.175206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d186801-37a1-4411-9138-cbd45a7798cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:29.175913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d186801-37a1-4411-9138-cbd45a7798cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:29.178691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d186801-37a1-4411-9138-cbd45a7798cd admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:29.256052 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:29.263780 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1342/2712] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:29 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:29.267796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1d091-54b6-458e-b19c-23a481d087df None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:29.280294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1d091-54b6-458e-b19c-23a481d087df None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:29.341474 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff063b0-b320-43c7-9acd-af2f149230c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:29.342190 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:29.342336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff063b0-b320-43c7-9acd-af2f149230c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:29.342684 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff063b0-b320-43c7-9acd-af2f149230c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:29.343051 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff063b0-b320-43c7-9acd-af2f149230c7 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:29.343747 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff063b0-b320-43c7-9acd-af2f149230c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:29.345703 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff063b0-b320-43c7-9acd-af2f149230c7 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:29.454190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1371/2713] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:04:29 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:29.460716 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d186801-37a1-4411-9138-cbd45a7798cd admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:29.477453 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d186801-37a1-4411-9138-cbd45a7798cd admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:29.489800 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2ae78-6088-496b-9c11-04afbdfe1133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:29.490656 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2ae78-6088-496b-9c11-04afbdfe1133 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:29.490947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2ae78-6088-496b-9c11-04afbdfe1133 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:29.491965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2ae78-6088-496b-9c11-04afbdfe1133 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:29.491965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2ae78-6088-496b-9c11-04afbdfe1133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:29.493698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2ae78-6088-496b-9c11-04afbdfe1133 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:29.506154 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1343/2714] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:29.510118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff063b0-b320-43c7-9acd-af2f149230c7 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:29.522688 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff063b0-b320-43c7-9acd-af2f149230c7 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:29.527302 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673db619-782d-4f52-b0cf-bb81dbb7ff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:29.528235 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673db619-782d-4f52-b0cf-bb81dbb7ff83 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:29.528643 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673db619-782d-4f52-b0cf-bb81dbb7ff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:29.528927 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673db619-782d-4f52-b0cf-bb81dbb7ff83 admin admin] PATH_INFO: `/v3/projects/1578a168cd6043f8b1dc45efe17e089c/users/05580e5b3db641f8994204f972538726/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:29.563288 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673db619-782d-4f52-b0cf-bb81dbb7ff83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1578a168cd6043f8b1dc45efe17e089c, user_id=05580e5b3db641f8994204f972538726, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:29.566621 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673db619-782d-4f52-b0cf-bb81dbb7ff83 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:29.673876 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1372/2715] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:29 2022] PUT /identity/v3/projects/1578a168cd6043f8b1dc45efe17e089c/users/05580e5b3db641f8994204f972538726/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:29.674678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2ae78-6088-496b-9c11-04afbdfe1133 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:29.685612 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2ae78-6088-496b-9c11-04afbdfe1133 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:29.766657 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599daa91-8a00-4a71-b096-9fb1196b7c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:29.768246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599daa91-8a00-4a71-b096-9fb1196b7c3f admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:29.768755 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599daa91-8a00-4a71-b096-9fb1196b7c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:29.769397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599daa91-8a00-4a71-b096-9fb1196b7c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:29.770524 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599daa91-8a00-4a71-b096-9fb1196b7c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:29.774787 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599daa91-8a00-4a71-b096-9fb1196b7c3f admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:29.791653 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1344/2716] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:29.792497 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673db619-782d-4f52-b0cf-bb81dbb7ff83 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:29.804989 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673db619-782d-4f52-b0cf-bb81dbb7ff83 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:29.810176 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad375d-eebe-42b5-abba-d36df2ecf197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:29.811163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad375d-eebe-42b5-abba-d36df2ecf197 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:29.811574 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad375d-eebe-42b5-abba-d36df2ecf197 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:29.811921 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad375d-eebe-42b5-abba-d36df2ecf197 admin admin] PATH_INFO: `/v3/projects/1578a168cd6043f8b1dc45efe17e089c/users/05580e5b3db641f8994204f972538726/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:29.813992 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad375d-eebe-42b5-abba-d36df2ecf197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1578a168cd6043f8b1dc45efe17e089c, user_id=05580e5b3db641f8994204f972538726, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:29.816700 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad375d-eebe-42b5-abba-d36df2ecf197 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:29.829551 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1373/2717] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:29 2022] PUT /identity/v3/projects/1578a168cd6043f8b1dc45efe17e089c/users/05580e5b3db641f8994204f972538726/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:29.840395 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92779a-4d49-4459-9a7b-d4bcf111820e None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:29.840691 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92779a-4d49-4459-9a7b-d4bcf111820e None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:29.840972 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92779a-4d49-4459-9a7b-d4bcf111820e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:29.869852 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-6d92779a-4d49-4459-9a7b-d4bcf111820e None None] MFA Rules not processed for user `05580e5b3db641f8994204f972538726`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:29.871077 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-6d92779a-4d49-4459-9a7b-d4bcf111820e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:29.953006 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1345/2718] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:29.975220 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad375d-eebe-42b5-abba-d36df2ecf197 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:29.977135 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-a6ad375d-eebe-42b5-abba-d36df2ecf197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:30.050303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad375d-eebe-42b5-abba-d36df2ecf197 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:30.058352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfe27b-b0e2-410e-8b7e-60132374a437 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:30.059212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfe27b-b0e2-410e-8b7e-60132374a437 service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:30.059655 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfe27b-b0e2-410e-8b7e-60132374a437 service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:30.060769 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfe27b-b0e2-410e-8b7e-60132374a437 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:30.067655 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:30.152684 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acfe27b-b0e2-410e-8b7e-60132374a437 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:30.154293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acfe27b-b0e2-410e-8b7e-60132374a437 service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:30.166357 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1374/2719] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:04:30.536387 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:31.599896 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92779a-4d49-4459-9a7b-d4bcf111820e None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:31.625986 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92779a-4d49-4459-9a7b-d4bcf111820e None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:31.637218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c269a-989a-4790-91c3-218b8188a0ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:31.637904 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c269a-989a-4790-91c3-218b8188a0ea service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:31.638414 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c269a-989a-4790-91c3-218b8188a0ea service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:31.638990 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c269a-989a-4790-91c3-218b8188a0ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:31.647633 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-a28c269a-989a-4790-91c3-218b8188a0ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:31.744533 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c269a-989a-4790-91c3-218b8188a0ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:31.746378 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c269a-989a-4790-91c3-218b8188a0ea service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:31.772115 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1346/2720] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:04:33.435562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfe27b-b0e2-410e-8b7e-60132374a437 service cinder] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:33.515840 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfe27b-b0e2-410e-8b7e-60132374a437 service cinder] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:33.522867 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088076e-81ab-4d0c-a885-ad75b58fbef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:33.523833 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088076e-81ab-4d0c-a885-ad75b58fbef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:33.524183 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088076e-81ab-4d0c-a885-ad75b58fbef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:33.524527 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088076e-81ab-4d0c-a885-ad75b58fbef4 admin admin] PATH_INFO: `/v3/users/72e3bad99e7c4d5398e757c4eda9b0a2` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:33.525916 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088076e-81ab-4d0c-a885-ad75b58fbef4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e3bad99e7c4d5398e757c4eda9b0a2)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:33.528153 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088076e-81ab-4d0c-a885-ad75b58fbef4 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:33.765913 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-1088076e-81ab-4d0c-a885-ad75b58fbef4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e3bad99e7c4d5398e757c4eda9b0a2'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:33.783246 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-1088076e-81ab-4d0c-a885-ad75b58fbef4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e3bad99e7c4d5398e757c4eda9b0a2'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:33.869260 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-1088076e-81ab-4d0c-a885-ad75b58fbef4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e3bad99e7c4d5398e757c4eda9b0a2'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:33.869962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-1088076e-81ab-4d0c-a885-ad75b58fbef4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e3bad99e7c4d5398e757c4eda9b0a2'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:33.897873 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-1088076e-81ab-4d0c-a885-ad75b58fbef4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e3bad99e7c4d5398e757c4eda9b0a2'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:33.919373 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1375/2721] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:04:33 2022] DELETE /identity/v3/users/72e3bad99e7c4d5398e757c4eda9b0a2 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:33.923939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279e97b-7022-4e21-83a0-b8c0903a83bf None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:33.924792 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279e97b-7022-4e21-83a0-b8c0903a83bf None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:33.925298 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279e97b-7022-4e21-83a0-b8c0903a83bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:33.968095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-c279e97b-7022-4e21-83a0-b8c0903a83bf None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:33.969547 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-c279e97b-7022-4e21-83a0-b8c0903a83bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:34.049895 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=100 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:34.097214 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1347/2722] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:34.110448 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088076e-81ab-4d0c-a885-ad75b58fbef4 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:34.111966 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-1088076e-81ab-4d0c-a885-ad75b58fbef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:34.256672 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088076e-81ab-4d0c-a885-ad75b58fbef4 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:34.262285 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43682324-3702-4acf-a836-0cf74613285e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:34.263321 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43682324-3702-4acf-a836-0cf74613285e service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:34.263614 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43682324-3702-4acf-a836-0cf74613285e service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:34.263897 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43682324-3702-4acf-a836-0cf74613285e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:34.303918 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43682324-3702-4acf-a836-0cf74613285e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:34.305789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43682324-3702-4acf-a836-0cf74613285e service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:34.313375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:34.326990 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1376/2723] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:04:34.606733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e096734-8065-4567-b477-88a0e51ddc24 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:34.607029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e096734-8065-4567-b477-88a0e51ddc24 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:34.607335 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e096734-8065-4567-b477-88a0e51ddc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:34.636875 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-3e096734-8065-4567-b477-88a0e51ddc24 None None] MFA Rules not processed for user `8d9530f903d14b5fbf1ffbc32c6e7b07`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:34.638732 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-3e096734-8065-4567-b477-88a0e51ddc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:34.754431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1348/2724] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:34.770359 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43682324-3702-4acf-a836-0cf74613285e service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:34.772439 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-43682324-3702-4acf-a836-0cf74613285e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:34.923042 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43682324-3702-4acf-a836-0cf74613285e service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:34.925929 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfc659-0553-489a-81ef-e201d9ae0018 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:34.926832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfc659-0553-489a-81ef-e201d9ae0018 service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:34.928773 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfc659-0553-489a-81ef-e201d9ae0018 service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:34.929300 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfc659-0553-489a-81ef-e201d9ae0018 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:34.939830 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfc659-0553-489a-81ef-e201d9ae0018 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:34.942422 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfc659-0553-489a-81ef-e201d9ae0018 service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:34.954915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1377/2725] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:04:35.138665 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e096734-8065-4567-b477-88a0e51ddc24 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:35.140713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-3e096734-8065-4567-b477-88a0e51ddc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:35.154987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e096734-8065-4567-b477-88a0e51ddc24 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:35.159801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd8f27-b376-4401-b41b-9cefd33f009e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:35.160758 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd8f27-b376-4401-b41b-9cefd33f009e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:35.161106 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd8f27-b376-4401-b41b-9cefd33f009e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:35.169130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd8f27-b376-4401-b41b-9cefd33f009e admin admin] PATH_INFO: `/v3/projects/5f70acc2104745e798aba0704cb0fd2a` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:35.169130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd8f27-b376-4401-b41b-9cefd33f009e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f70acc2104745e798aba0704cb0fd2a)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:35.169130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd8f27-b376-4401-b41b-9cefd33f009e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:35.351442 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9ecd8f27-b376-4401-b41b-9cefd33f009e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f70acc2104745e798aba0704cb0fd2a', 'request_id': 'req-9ecd8f27-b376-4401-b41b-9cefd33f009e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:35.366177 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9ecd8f27-b376-4401-b41b-9cefd33f009e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f70acc2104745e798aba0704cb0fd2a', 'request_id': 'req-9ecd8f27-b376-4401-b41b-9cefd33f009e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:35.375522 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9ecd8f27-b376-4401-b41b-9cefd33f009e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f70acc2104745e798aba0704cb0fd2a', 'request_id': 'req-9ecd8f27-b376-4401-b41b-9cefd33f009e'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:35.527130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9ecd8f27-b376-4401-b41b-9cefd33f009e admin admin] The token cache is being invalidate because project 5f70acc2104745e798aba0704cb0fd2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:04:35.527431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9ecd8f27-b376-4401-b41b-9cefd33f009e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:35.528108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9ecd8f27-b376-4401-b41b-9cefd33f009e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:35.529729 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1349/2726] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:04:35 2022] DELETE /identity/v3/projects/5f70acc2104745e798aba0704cb0fd2a => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:35.539045 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfc659-0553-489a-81ef-e201d9ae0018 service nova] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:35.565364 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfc659-0553-489a-81ef-e201d9ae0018 service nova] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:35.656909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135cecb-4d48-44b8-8e88-463b957c7cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:35.657915 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135cecb-4d48-44b8-8e88-463b957c7cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:35.658205 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135cecb-4d48-44b8-8e88-463b957c7cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:35.658563 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135cecb-4d48-44b8-8e88-463b957c7cc6 admin admin] PATH_INFO: `/v3/users/05580e5b3db641f8994204f972538726` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:35.660035 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135cecb-4d48-44b8-8e88-463b957c7cc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05580e5b3db641f8994204f972538726)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:35.662244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135cecb-4d48-44b8-8e88-463b957c7cc6 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:35.850335 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-0135cecb-4d48-44b8-8e88-463b957c7cc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05580e5b3db641f8994204f972538726'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:35.863580 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-0135cecb-4d48-44b8-8e88-463b957c7cc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05580e5b3db641f8994204f972538726'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:35.936077 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-0135cecb-4d48-44b8-8e88-463b957c7cc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05580e5b3db641f8994204f972538726'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:35.937061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-0135cecb-4d48-44b8-8e88-463b957c7cc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05580e5b3db641f8994204f972538726'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:35.949133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-0135cecb-4d48-44b8-8e88-463b957c7cc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05580e5b3db641f8994204f972538726'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:35.955914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1378/2727] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:04:35 2022] DELETE /identity/v3/users/05580e5b3db641f8994204f972538726 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:36.535669 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd8f27-b376-4401-b41b-9cefd33f009e admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:36.537914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-9ecd8f27-b376-4401-b41b-9cefd33f009e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:36.557965 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd8f27-b376-4401-b41b-9cefd33f009e admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:36.633778 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0004e-21ad-4311-8584-8ebbc8ca33f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:36.634667 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0004e-21ad-4311-8584-8ebbc8ca33f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:36.634959 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0004e-21ad-4311-8584-8ebbc8ca33f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:36.635238 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0004e-21ad-4311-8584-8ebbc8ca33f6 admin admin] PATH_INFO: `/v3/projects/1578a168cd6043f8b1dc45efe17e089c` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:36.636592 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0004e-21ad-4311-8584-8ebbc8ca33f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1578a168cd6043f8b1dc45efe17e089c)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:36.638670 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0004e-21ad-4311-8584-8ebbc8ca33f6 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:36.654822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:36.784218 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4ed0004e-21ad-4311-8584-8ebbc8ca33f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1578a168cd6043f8b1dc45efe17e089c', 'request_id': 'req-4ed0004e-21ad-4311-8584-8ebbc8ca33f6'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:36.806972 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4ed0004e-21ad-4311-8584-8ebbc8ca33f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1578a168cd6043f8b1dc45efe17e089c', 'request_id': 'req-4ed0004e-21ad-4311-8584-8ebbc8ca33f6'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:36.817511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4ed0004e-21ad-4311-8584-8ebbc8ca33f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1578a168cd6043f8b1dc45efe17e089c', 'request_id': 'req-4ed0004e-21ad-4311-8584-8ebbc8ca33f6'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:37.058225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4ed0004e-21ad-4311-8584-8ebbc8ca33f6 admin admin] The token cache is being invalidate because project 1578a168cd6043f8b1dc45efe17e089c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:04:37.058521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4ed0004e-21ad-4311-8584-8ebbc8ca33f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:37.059206 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-4ed0004e-21ad-4311-8584-8ebbc8ca33f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:37.060767 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1350/2728] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:04:36 2022] DELETE /identity/v3/projects/1578a168cd6043f8b1dc45efe17e089c => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:38.106793 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9454915-4581-48a0-8921-9428ae639270 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:38.107715 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9454915-4581-48a0-8921-9428ae639270 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:38.108083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9454915-4581-48a0-8921-9428ae639270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:38.114172 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:38.130474 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-c9454915-4581-48a0-8921-9428ae639270 None None] MFA Rules not processed for user `8d9530f903d14b5fbf1ffbc32c6e7b07`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:38.130474 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c9454915-4581-48a0-8921-9428ae639270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:38.189596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1379/2729] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:38.236519 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0004e-21ad-4311-8584-8ebbc8ca33f6 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:38.238192 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-4ed0004e-21ad-4311-8584-8ebbc8ca33f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:38.316446 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0004e-21ad-4311-8584-8ebbc8ca33f6 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:38.322812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53312e5-ad55-460b-9b7d-d76719a6b0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:38.323509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53312e5-ad55-460b-9b7d-d76719a6b0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:38.323798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53312e5-ad55-460b-9b7d-d76719a6b0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:38.324082 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53312e5-ad55-460b-9b7d-d76719a6b0cc admin admin] PATH_INFO: `/v3/users/81bb1b84cdf746f9955a561dd0578655` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:38.325365 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53312e5-ad55-460b-9b7d-d76719a6b0cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=81bb1b84cdf746f9955a561dd0578655)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:38.331113 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53312e5-ad55-460b-9b7d-d76719a6b0cc admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:38.579159 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d53312e5-ad55-460b-9b7d-d76719a6b0cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81bb1b84cdf746f9955a561dd0578655'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:38.595865 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d53312e5-ad55-460b-9b7d-d76719a6b0cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81bb1b84cdf746f9955a561dd0578655'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:38.669436 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d53312e5-ad55-460b-9b7d-d76719a6b0cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81bb1b84cdf746f9955a561dd0578655'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:38.670089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d53312e5-ad55-460b-9b7d-d76719a6b0cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81bb1b84cdf746f9955a561dd0578655'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:38.680137 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d53312e5-ad55-460b-9b7d-d76719a6b0cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81bb1b84cdf746f9955a561dd0578655'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:38.691933 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1351/2730] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:04:38 2022] DELETE /identity/v3/users/81bb1b84cdf746f9955a561dd0578655 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:38.693674 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc99560-701c-4a0d-a4d0-2eb1375507af None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:38.693832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc99560-701c-4a0d-a4d0-2eb1375507af None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:38.694299 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc99560-701c-4a0d-a4d0-2eb1375507af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:38.732772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-dbc99560-701c-4a0d-a4d0-2eb1375507af None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:38.734094 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-dbc99560-701c-4a0d-a4d0-2eb1375507af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:38.808405 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1380/2731] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:38.818439 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53312e5-ad55-460b-9b7d-d76719a6b0cc admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:38.819967 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d53312e5-ad55-460b-9b7d-d76719a6b0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:38.841698 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:38.886049 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53312e5-ad55-460b-9b7d-d76719a6b0cc admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:38.889709 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e559ed1-bb8a-4154-9fe3-6c489dc6a52f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:38.890393 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e559ed1-bb8a-4154-9fe3-6c489dc6a52f service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:38.890748 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e559ed1-bb8a-4154-9fe3-6c489dc6a52f service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:38.891034 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e559ed1-bb8a-4154-9fe3-6c489dc6a52f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:38.901363 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e559ed1-bb8a-4154-9fe3-6c489dc6a52f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:38.902913 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e559ed1-bb8a-4154-9fe3-6c489dc6a52f service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:38.913578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1352/2732] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:04:39.446771 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc99560-701c-4a0d-a4d0-2eb1375507af None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:39.448412 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-dbc99560-701c-4a0d-a4d0-2eb1375507af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:39.465666 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc99560-701c-4a0d-a4d0-2eb1375507af None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:39.471254 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c16f7f-afc8-4b6b-9813-a6c4193196a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:39.473333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c16f7f-afc8-4b6b-9813-a6c4193196a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:39.473978 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c16f7f-afc8-4b6b-9813-a6c4193196a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:39.474260 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c16f7f-afc8-4b6b-9813-a6c4193196a6 admin admin] PATH_INFO: `/v3/projects/fd5cfd1d93e54d9994b779a5e17a307e` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:39.476493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c16f7f-afc8-4b6b-9813-a6c4193196a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd5cfd1d93e54d9994b779a5e17a307e)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:39.478155 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c16f7f-afc8-4b6b-9813-a6c4193196a6 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:39.613933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d3c16f7f-afc8-4b6b-9813-a6c4193196a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd5cfd1d93e54d9994b779a5e17a307e', 'request_id': 'req-d3c16f7f-afc8-4b6b-9813-a6c4193196a6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:39.621755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d3c16f7f-afc8-4b6b-9813-a6c4193196a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd5cfd1d93e54d9994b779a5e17a307e', 'request_id': 'req-d3c16f7f-afc8-4b6b-9813-a6c4193196a6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:39.627254 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d3c16f7f-afc8-4b6b-9813-a6c4193196a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd5cfd1d93e54d9994b779a5e17a307e', 'request_id': 'req-d3c16f7f-afc8-4b6b-9813-a6c4193196a6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:39.724480 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d3c16f7f-afc8-4b6b-9813-a6c4193196a6 admin admin] The token cache is being invalidate because project fd5cfd1d93e54d9994b779a5e17a307e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:04:39.724844 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d3c16f7f-afc8-4b6b-9813-a6c4193196a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:39.725486 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-d3c16f7f-afc8-4b6b-9813-a6c4193196a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:39.727075 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1381/2733] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:04:39 2022] DELETE /identity/v3/projects/fd5cfd1d93e54d9994b779a5e17a307e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:39.731000 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e559ed1-bb8a-4154-9fe3-6c489dc6a52f service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:39.743147 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e559ed1-bb8a-4154-9fe3-6c489dc6a52f service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:39.800811 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f08ec-1531-4d66-a14e-4f8da2023911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:39.801717 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f08ec-1531-4d66-a14e-4f8da2023911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:39.802516 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f08ec-1531-4d66-a14e-4f8da2023911 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:39.802798 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f08ec-1531-4d66-a14e-4f8da2023911 admin admin] PATH_INFO: `/v3/users/47221c6715e84de1add2b44058bd7d50` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:39.804172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f08ec-1531-4d66-a14e-4f8da2023911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47221c6715e84de1add2b44058bd7d50)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:39.806193 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f08ec-1531-4d66-a14e-4f8da2023911 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:40.019937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e00f08ec-1531-4d66-a14e-4f8da2023911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47221c6715e84de1add2b44058bd7d50'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:40.031772 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e00f08ec-1531-4d66-a14e-4f8da2023911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47221c6715e84de1add2b44058bd7d50'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:40.092430 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e00f08ec-1531-4d66-a14e-4f8da2023911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47221c6715e84de1add2b44058bd7d50'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:40.093178 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e00f08ec-1531-4d66-a14e-4f8da2023911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47221c6715e84de1add2b44058bd7d50'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:40.101791 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e00f08ec-1531-4d66-a14e-4f8da2023911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47221c6715e84de1add2b44058bd7d50'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:40.108131 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1353/2734] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:04:39 2022] DELETE /identity/v3/users/47221c6715e84de1add2b44058bd7d50 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:40.669400 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c16f7f-afc8-4b6b-9813-a6c4193196a6 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:40.669400 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d3c16f7f-afc8-4b6b-9813-a6c4193196a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:40.685079 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c16f7f-afc8-4b6b-9813-a6c4193196a6 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:40.718122 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:40.748323 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed68f3-71cf-440a-a280-d2cf55e12706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:40.749212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed68f3-71cf-440a-a280-d2cf55e12706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:40.749502 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed68f3-71cf-440a-a280-d2cf55e12706 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:40.749783 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed68f3-71cf-440a-a280-d2cf55e12706 admin admin] PATH_INFO: `/v3/projects/ecfe22b814f8445a8c3c391c56890bdb` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:40.751075 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed68f3-71cf-440a-a280-d2cf55e12706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecfe22b814f8445a8c3c391c56890bdb)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:40.752983 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed68f3-71cf-440a-a280-d2cf55e12706 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:40.920758 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-63ed68f3-71cf-440a-a280-d2cf55e12706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecfe22b814f8445a8c3c391c56890bdb', 'request_id': 'req-63ed68f3-71cf-440a-a280-d2cf55e12706'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:40.927551 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-63ed68f3-71cf-440a-a280-d2cf55e12706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecfe22b814f8445a8c3c391c56890bdb', 'request_id': 'req-63ed68f3-71cf-440a-a280-d2cf55e12706'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:40.933578 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-63ed68f3-71cf-440a-a280-d2cf55e12706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecfe22b814f8445a8c3c391c56890bdb', 'request_id': 'req-63ed68f3-71cf-440a-a280-d2cf55e12706'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:41.106320 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-63ed68f3-71cf-440a-a280-d2cf55e12706 admin admin] The token cache is being invalidate because project ecfe22b814f8445a8c3c391c56890bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:04:41.106617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-63ed68f3-71cf-440a-a280-d2cf55e12706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:41.107249 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-63ed68f3-71cf-440a-a280-d2cf55e12706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:41.108793 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1382/2735] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:04:40 2022] DELETE /identity/v3/projects/ecfe22b814f8445a8c3c391c56890bdb => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:41.114973 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776f685-eb24-452a-a7b8-7663ce6cdeed None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:41.115486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776f685-eb24-452a-a7b8-7663ce6cdeed None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:41.115584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776f685-eb24-452a-a7b8-7663ce6cdeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:41.132868 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-c776f685-eb24-452a-a7b8-7663ce6cdeed None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:41.134139 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-c776f685-eb24-452a-a7b8-7663ce6cdeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:41.173258 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:41.211664 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1354/2736] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:41.220297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64747110-bd7f-4ca5-85f4-19027c755a43 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:41.220639 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64747110-bd7f-4ca5-85f4-19027c755a43 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:41.220927 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64747110-bd7f-4ca5-85f4-19027c755a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:41.242159 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-64747110-bd7f-4ca5-85f4-19027c755a43 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:41.245134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-64747110-bd7f-4ca5-85f4-19027c755a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:41.251548 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1383/2737] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:04:41.256080 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776f685-eb24-452a-a7b8-7663ce6cdeed None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:41.266712 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776f685-eb24-452a-a7b8-7663ce6cdeed None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:41.272364 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70c2b4-6cc0-4df2-8e5f-afe6b1a5a393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:41.273297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70c2b4-6cc0-4df2-8e5f-afe6b1a5a393 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:41.273612 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70c2b4-6cc0-4df2-8e5f-afe6b1a5a393 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:41.273861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70c2b4-6cc0-4df2-8e5f-afe6b1a5a393 admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:41.274590 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70c2b4-6cc0-4df2-8e5f-afe6b1a5a393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:04:41.274904 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70c2b4-6cc0-4df2-8e5f-afe6b1a5a393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:41.276545 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70c2b4-6cc0-4df2-8e5f-afe6b1a5a393 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:41.292056 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1355/2738] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 20:04:41.295987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64747110-bd7f-4ca5-85f4-19027c755a43 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:41.308250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64747110-bd7f-4ca5-85f4-19027c755a43 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:41.312516 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29a6f3-6f5c-49b4-a4e7-dc65cf6dc165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:41.313245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29a6f3-6f5c-49b4-a4e7-dc65cf6dc165 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:41.313533 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29a6f3-6f5c-49b4-a4e7-dc65cf6dc165 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:41.313818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29a6f3-6f5c-49b4-a4e7-dc65cf6dc165 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:41.314514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29a6f3-6f5c-49b4-a4e7-dc65cf6dc165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:41.316438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29a6f3-6f5c-49b4-a4e7-dc65cf6dc165 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:41.398381 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1384/2739] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:41 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:41.402483 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70c2b4-6cc0-4df2-8e5f-afe6b1a5a393 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:41.413322 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70c2b4-6cc0-4df2-8e5f-afe6b1a5a393 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:41.472527 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de243e1c-60f4-4d42-86d3-d96542c5f755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:41.473235 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de243e1c-60f4-4d42-86d3-d96542c5f755 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:41.473526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de243e1c-60f4-4d42-86d3-d96542c5f755 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:41.473957 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de243e1c-60f4-4d42-86d3-d96542c5f755 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:41.474656 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de243e1c-60f4-4d42-86d3-d96542c5f755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:41.477149 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de243e1c-60f4-4d42-86d3-d96542c5f755 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:41.583890 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1356/2740] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:04:41 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:41.588058 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29a6f3-6f5c-49b4-a4e7-dc65cf6dc165 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:41.599804 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29a6f3-6f5c-49b4-a4e7-dc65cf6dc165 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:41.605301 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e5261-5d50-4a8f-afc7-2a00127f351d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:41.606054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e5261-5d50-4a8f-afc7-2a00127f351d admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:41.606401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e5261-5d50-4a8f-afc7-2a00127f351d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:41.606747 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e5261-5d50-4a8f-afc7-2a00127f351d admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:41.607591 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e5261-5d50-4a8f-afc7-2a00127f351d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:41.609371 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e5261-5d50-4a8f-afc7-2a00127f351d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:41.624664 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1385/2741] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 20:04:41.626793 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de243e1c-60f4-4d42-86d3-d96542c5f755 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:41.642568 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de243e1c-60f4-4d42-86d3-d96542c5f755 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:41.655328 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddce29-7de1-42de-865e-58c105f3bb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:41.656675 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddce29-7de1-42de-865e-58c105f3bb59 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:41.656972 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddce29-7de1-42de-865e-58c105f3bb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:41.657290 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddce29-7de1-42de-865e-58c105f3bb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:41.658029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddce29-7de1-42de-865e-58c105f3bb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:41.660542 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddce29-7de1-42de-865e-58c105f3bb59 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:41.671450 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1357/2742] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:41.680568 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e5261-5d50-4a8f-afc7-2a00127f351d admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:41.693579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e5261-5d50-4a8f-afc7-2a00127f351d admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:41.698663 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160cdcd-830a-4807-8bd3-8da01972d556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:41.699559 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160cdcd-830a-4807-8bd3-8da01972d556 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:41.699842 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160cdcd-830a-4807-8bd3-8da01972d556 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:41.700119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160cdcd-830a-4807-8bd3-8da01972d556 admin admin] PATH_INFO: `/v3/projects/26dc222ad8814103ac1812fca5b0b380/users/bb8bcb11f6f24d50842c0b4c36364696/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:41.716710 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160cdcd-830a-4807-8bd3-8da01972d556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26dc222ad8814103ac1812fca5b0b380, user_id=bb8bcb11f6f24d50842c0b4c36364696, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:41.719395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160cdcd-830a-4807-8bd3-8da01972d556 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:41.788934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1386/2743] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:41 2022] PUT /identity/v3/projects/26dc222ad8814103ac1812fca5b0b380/users/bb8bcb11f6f24d50842c0b4c36364696/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:41.800791 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4300a1-69f8-4e2e-8d93-1dc7edbd1a6b None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:41.805350 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4300a1-69f8-4e2e-8d93-1dc7edbd1a6b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:41.805350 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4300a1-69f8-4e2e-8d93-1dc7edbd1a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:41.831320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-4d4300a1-69f8-4e2e-8d93-1dc7edbd1a6b None None] MFA Rules not processed for user `bb8bcb11f6f24d50842c0b4c36364696`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:41.832576 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-4d4300a1-69f8-4e2e-8d93-1dc7edbd1a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:41.907308 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1358/2744] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:41.915940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160cdcd-830a-4807-8bd3-8da01972d556 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:41.917781 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-9160cdcd-830a-4807-8bd3-8da01972d556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:41.978169 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160cdcd-830a-4807-8bd3-8da01972d556 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:41.982078 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e621d-f3ec-4e4a-9a58-6e048d604068 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f078219032be4b619119d1d9d59c499d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:41.982750 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e621d-f3ec-4e4a-9a58-6e048d604068 service glance] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:41.983022 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e621d-f3ec-4e4a-9a58-6e048d604068 service glance] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:41.983306 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e621d-f3ec-4e4a-9a58-6e048d604068 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:41.993197 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e621d-f3ec-4e4a-9a58-6e048d604068 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:41.994620 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e621d-f3ec-4e4a-9a58-6e048d604068 service glance] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:41.999838 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:42.004577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1387/2745] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:04:44.676373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4300a1-69f8-4e2e-8d93-1dc7edbd1a6b None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:44.678136 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-4d4300a1-69f8-4e2e-8d93-1dc7edbd1a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:44.723327 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:44.741037 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4300a1-69f8-4e2e-8d93-1dc7edbd1a6b None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:44.744802 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3666ee7-50dc-4361-880b-4bffb005539c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:44.745493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3666ee7-50dc-4361-880b-4bffb005539c service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:44.745779 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3666ee7-50dc-4361-880b-4bffb005539c service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:44.746174 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3666ee7-50dc-4361-880b-4bffb005539c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:44.748438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-a3666ee7-50dc-4361-880b-4bffb005539c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:44.816436 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3666ee7-50dc-4361-880b-4bffb005539c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:44.818526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3666ee7-50dc-4361-880b-4bffb005539c service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:44.828782 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1359/2746] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:44 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:04:54.824078 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=34 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:58.140749 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e621d-f3ec-4e4a-9a58-6e048d604068 service glance] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:58.206984 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e621d-f3ec-4e4a-9a58-6e048d604068 service glance] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:58.211540 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc995c-449b-427e-a04e-e561a4107f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:58.212451 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc995c-449b-427e-a04e-e561a4107f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:58.212733 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc995c-449b-427e-a04e-e561a4107f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:58.213006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc995c-449b-427e-a04e-e561a4107f1c admin admin] PATH_INFO: `/v3/users/bb8bcb11f6f24d50842c0b4c36364696` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:58.214220 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc995c-449b-427e-a04e-e561a4107f1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb8bcb11f6f24d50842c0b4c36364696)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:58.216190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc995c-449b-427e-a04e-e561a4107f1c admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:58.420106 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-04bc995c-449b-427e-a04e-e561a4107f1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb8bcb11f6f24d50842c0b4c36364696'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:58.432022 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-04bc995c-449b-427e-a04e-e561a4107f1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb8bcb11f6f24d50842c0b4c36364696'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:58.502682 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-04bc995c-449b-427e-a04e-e561a4107f1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb8bcb11f6f24d50842c0b4c36364696'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:58.503230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-04bc995c-449b-427e-a04e-e561a4107f1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb8bcb11f6f24d50842c0b4c36364696'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:58.510527 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-04bc995c-449b-427e-a04e-e561a4107f1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb8bcb11f6f24d50842c0b4c36364696'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:58.516354 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1388/2747] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:04:58 2022] DELETE /identity/v3/users/bb8bcb11f6f24d50842c0b4c36364696 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:58.521342 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4ee9f-4b9d-4b24-9504-83e7f530d5a4 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:58.524463 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4ee9f-4b9d-4b24-9504-83e7f530d5a4 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:58.524463 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4ee9f-4b9d-4b24-9504-83e7f530d5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:58.539887 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-63f4ee9f-4b9d-4b24-9504-83e7f530d5a4 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:58.541074 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-63f4ee9f-4b9d-4b24-9504-83e7f530d5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:58.600593 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1360/2748] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:58.610084 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc995c-449b-427e-a04e-e561a4107f1c admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:58.611495 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-04bc995c-449b-427e-a04e-e561a4107f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:58.673379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc995c-449b-427e-a04e-e561a4107f1c admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:58.678052 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ddbdb-a94d-468c-9d7a-f2ea77a1fec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:58.678711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ddbdb-a94d-468c-9d7a-f2ea77a1fec2 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:58.678994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ddbdb-a94d-468c-9d7a-f2ea77a1fec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:58.679274 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ddbdb-a94d-468c-9d7a-f2ea77a1fec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:58.688431 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ddbdb-a94d-468c-9d7a-f2ea77a1fec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:58.689901 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ddbdb-a94d-468c-9d7a-f2ea77a1fec2 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:58.699370 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1389/2749] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:04:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:04:59.110363 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4ee9f-4b9d-4b24-9504-83e7f530d5a4 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:59.114022 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-63f4ee9f-4b9d-4b24-9504-83e7f530d5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:59.124492 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4ee9f-4b9d-4b24-9504-83e7f530d5a4 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:59.128998 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e407f-06ad-4b16-a2ab-1d64af1716a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:59.129892 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e407f-06ad-4b16-a2ab-1d64af1716a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:59.130266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e407f-06ad-4b16-a2ab-1d64af1716a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:59.131039 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e407f-06ad-4b16-a2ab-1d64af1716a5 admin admin] PATH_INFO: `/v3/projects/26dc222ad8814103ac1812fca5b0b380` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:59.132238 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e407f-06ad-4b16-a2ab-1d64af1716a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26dc222ad8814103ac1812fca5b0b380)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:59.134184 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e407f-06ad-4b16-a2ab-1d64af1716a5 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:59.228891 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e70e407f-06ad-4b16-a2ab-1d64af1716a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26dc222ad8814103ac1812fca5b0b380', 'request_id': 'req-e70e407f-06ad-4b16-a2ab-1d64af1716a5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:59.235158 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e70e407f-06ad-4b16-a2ab-1d64af1716a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26dc222ad8814103ac1812fca5b0b380', 'request_id': 'req-e70e407f-06ad-4b16-a2ab-1d64af1716a5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:59.240792 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e70e407f-06ad-4b16-a2ab-1d64af1716a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26dc222ad8814103ac1812fca5b0b380', 'request_id': 'req-e70e407f-06ad-4b16-a2ab-1d64af1716a5'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:59.322739 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e70e407f-06ad-4b16-a2ab-1d64af1716a5 admin admin] The token cache is being invalidate because project 26dc222ad8814103ac1812fca5b0b380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:04:59.323029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e70e407f-06ad-4b16-a2ab-1d64af1716a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:59.323652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e70e407f-06ad-4b16-a2ab-1d64af1716a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:04:59.325292 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1361/2750] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:04:59 2022] DELETE /identity/v3/projects/26dc222ad8814103ac1812fca5b0b380 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:04:59.330293 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5d760-abe6-4f1d-953f-4dbfe0166b17 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:59.336512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5d760-abe6-4f1d-953f-4dbfe0166b17 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:59.336512 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5d760-abe6-4f1d-953f-4dbfe0166b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:59.348589 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-1be5d760-abe6-4f1d-953f-4dbfe0166b17 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:59.350440 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-1be5d760-abe6-4f1d-953f-4dbfe0166b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:59.366891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:04:59.410629 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1390/2751] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:59.418420 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21992b9e-3838-476d-90b0-d95ba709630d None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:59.418814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21992b9e-3838-476d-90b0-d95ba709630d None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:59.419104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21992b9e-3838-476d-90b0-d95ba709630d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:59.437611 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-21992b9e-3838-476d-90b0-d95ba709630d None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:04:59.438820 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-21992b9e-3838-476d-90b0-d95ba709630d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:04:59.447541 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1362/2752] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:04:59.451688 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5d760-abe6-4f1d-953f-4dbfe0166b17 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:59.462222 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5d760-abe6-4f1d-953f-4dbfe0166b17 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:59.467242 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e7fc0-3159-4ab3-844d-07309032e7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:59.467887 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e7fc0-3159-4ab3-844d-07309032e7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:59.468170 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e7fc0-3159-4ab3-844d-07309032e7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:59.468446 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e7fc0-3159-4ab3-844d-07309032e7f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:59.469258 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e7fc0-3159-4ab3-844d-07309032e7f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:04:59.475392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e7fc0-3159-4ab3-844d-07309032e7f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:59.475392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e7fc0-3159-4ab3-844d-07309032e7f3 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:59.483153 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1391/2753] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 20:04:59.487325 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21992b9e-3838-476d-90b0-d95ba709630d None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:59.497139 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21992b9e-3838-476d-90b0-d95ba709630d None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:59.501725 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b60cd-e22a-4e73-a3b9-77820366cece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:59.502369 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b60cd-e22a-4e73-a3b9-77820366cece admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:59.502652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b60cd-e22a-4e73-a3b9-77820366cece admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:59.502926 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b60cd-e22a-4e73-a3b9-77820366cece admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:59.503616 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b60cd-e22a-4e73-a3b9-77820366cece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:59.506731 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b60cd-e22a-4e73-a3b9-77820366cece admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:59.615629 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1363/2754] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:04:59 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:04:59.619889 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e7fc0-3159-4ab3-844d-07309032e7f3 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:59.629784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e7fc0-3159-4ab3-844d-07309032e7f3 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:59.687275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19d28a-a2f3-41a0-bae3-5899d16a7f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:59.687946 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19d28a-a2f3-41a0-bae3-5899d16a7f5d admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:59.688234 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19d28a-a2f3-41a0-bae3-5899d16a7f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:59.688514 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19d28a-a2f3-41a0-bae3-5899d16a7f5d admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:59.689227 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19d28a-a2f3-41a0-bae3-5899d16a7f5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:59.691138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19d28a-a2f3-41a0-bae3-5899d16a7f5d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:59.808763 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1392/2755] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:04:59 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:04:59.813010 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b60cd-e22a-4e73-a3b9-77820366cece admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:59.823311 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b60cd-e22a-4e73-a3b9-77820366cece admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:59.828077 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33795086-305d-432a-9106-eb3befb02d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:59.828733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33795086-305d-432a-9106-eb3befb02d61 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:59.829049 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33795086-305d-432a-9106-eb3befb02d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:59.829372 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33795086-305d-432a-9106-eb3befb02d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:59.830098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33795086-305d-432a-9106-eb3befb02d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:59.831697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33795086-305d-432a-9106-eb3befb02d61 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:59.842678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1364/2756] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:59.846503 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19d28a-a2f3-41a0-bae3-5899d16a7f5d admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:59.857424 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19d28a-a2f3-41a0-bae3-5899d16a7f5d admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:59.862027 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe635eaf-130a-4a76-962b-570db93e6396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:59.862662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe635eaf-130a-4a76-962b-570db93e6396 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:59.862948 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe635eaf-130a-4a76-962b-570db93e6396 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:59.863227 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe635eaf-130a-4a76-962b-570db93e6396 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:59.863957 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe635eaf-130a-4a76-962b-570db93e6396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:59.865707 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe635eaf-130a-4a76-962b-570db93e6396 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:59.877596 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1393/2757] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:04:59.879704 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33795086-305d-432a-9106-eb3befb02d61 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:04:59.890049 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33795086-305d-432a-9106-eb3befb02d61 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:04:59.894568 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7260fd-88e8-499c-adbf-3f7359bd9dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:04:59.895440 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7260fd-88e8-499c-adbf-3f7359bd9dab admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:04:59.896209 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7260fd-88e8-499c-adbf-3f7359bd9dab admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:04:59.896696 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7260fd-88e8-499c-adbf-3f7359bd9dab admin admin] PATH_INFO: `/v3/projects/56dfd08bdbc94800baea24f205ac1834/users/4c1dcaa5a5954bdaa2fe5f52178b61b1/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:04:59.911293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7260fd-88e8-499c-adbf-3f7359bd9dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=56dfd08bdbc94800baea24f205ac1834, user_id=4c1dcaa5a5954bdaa2fe5f52178b61b1, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:04:59.914593 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7260fd-88e8-499c-adbf-3f7359bd9dab admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:04:59.991006 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1365/2758] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:04:59 2022] PUT /identity/v3/projects/56dfd08bdbc94800baea24f205ac1834/users/4c1dcaa5a5954bdaa2fe5f52178b61b1/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:05:00.055035 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1a0cb-a4b8-427d-9ffe-6cfae9e8f28c None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:05:00.055327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1a0cb-a4b8-427d-9ffe-6cfae9e8f28c None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:05:00.055637 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1a0cb-a4b8-427d-9ffe-6cfae9e8f28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:05:00.081309 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-f6e1a0cb-a4b8-427d-9ffe-6cfae9e8f28c None None] MFA Rules not processed for user `4c1dcaa5a5954bdaa2fe5f52178b61b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:05:00.082525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f6e1a0cb-a4b8-427d-9ffe-6cfae9e8f28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:05:00.146891 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1394/2759] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:05:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:05:00.157812 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7260fd-88e8-499c-adbf-3f7359bd9dab admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:05:00.159497 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ee7260fd-88e8-499c-adbf-3f7359bd9dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:05:00.182728 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:05:00.216911 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7260fd-88e8-499c-adbf-3f7359bd9dab admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:05:00.220515 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ac003-9867-4e18-90e5-c04eadf7218b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:05:00.225078 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ac003-9867-4e18-90e5-c04eadf7218b service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:05:00.225078 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ac003-9867-4e18-90e5-c04eadf7218b service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:05:00.225078 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ac003-9867-4e18-90e5-c04eadf7218b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:05:00.230961 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ac003-9867-4e18-90e5-c04eadf7218b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:05:00.232381 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ac003-9867-4e18-90e5-c04eadf7218b service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:05:00.241880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1366/2760] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:05:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:05:10.143084 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:05:10.271285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=17 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:05:14.830885 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1a0cb-a4b8-427d-9ffe-6cfae9e8f28c None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:05:14.893455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1a0cb-a4b8-427d-9ffe-6cfae9e8f28c None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:05:14.898146 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a10aa-89e4-4b67-92f9-2d4909323def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:05:14.899049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a10aa-89e4-4b67-92f9-2d4909323def admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:05:14.899340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a10aa-89e4-4b67-92f9-2d4909323def admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:05:14.899621 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a10aa-89e4-4b67-92f9-2d4909323def admin admin] PATH_INFO: `/v3/users/4c1dcaa5a5954bdaa2fe5f52178b61b1` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:05:14.900892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a10aa-89e4-4b67-92f9-2d4909323def admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c1dcaa5a5954bdaa2fe5f52178b61b1)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:05:14.902860 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a10aa-89e4-4b67-92f9-2d4909323def admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:05:15.076637 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-a54a10aa-89e4-4b67-92f9-2d4909323def admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c1dcaa5a5954bdaa2fe5f52178b61b1'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:05:15.088742 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-a54a10aa-89e4-4b67-92f9-2d4909323def admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c1dcaa5a5954bdaa2fe5f52178b61b1'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:05:15.168572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-a54a10aa-89e4-4b67-92f9-2d4909323def admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c1dcaa5a5954bdaa2fe5f52178b61b1'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:05:15.169217 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-a54a10aa-89e4-4b67-92f9-2d4909323def admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c1dcaa5a5954bdaa2fe5f52178b61b1'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:05:15.176558 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-a54a10aa-89e4-4b67-92f9-2d4909323def admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c1dcaa5a5954bdaa2fe5f52178b61b1'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:05:15.183241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1395/2761] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:05:14 2022] DELETE /identity/v3/users/4c1dcaa5a5954bdaa2fe5f52178b61b1 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:05:15.187762 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c177223-7d02-4d93-9e7a-1cdcfe6bc69c None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:05:15.188248 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c177223-7d02-4d93-9e7a-1cdcfe6bc69c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:05:15.188370 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c177223-7d02-4d93-9e7a-1cdcfe6bc69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:05:15.205367 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-8c177223-7d02-4d93-9e7a-1cdcfe6bc69c None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:05:15.206572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-8c177223-7d02-4d93-9e7a-1cdcfe6bc69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:05:15.265429 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1367/2762] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:05:15.274882 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a10aa-89e4-4b67-92f9-2d4909323def admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:05:15.276718 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-a54a10aa-89e4-4b67-92f9-2d4909323def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:05:15.334324 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a10aa-89e4-4b67-92f9-2d4909323def admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:05:15.338084 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa7890-9869-454e-92fe-f4336f9229d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:05:15.338884 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa7890-9869-454e-92fe-f4336f9229d3 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:05:15.339173 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa7890-9869-454e-92fe-f4336f9229d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:05:15.339460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa7890-9869-454e-92fe-f4336f9229d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:05:15.348584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa7890-9869-454e-92fe-f4336f9229d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:05:15.350052 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa7890-9869-454e-92fe-f4336f9229d3 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:05:15.360398 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1396/2763] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:05:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:05:15.758408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c177223-7d02-4d93-9e7a-1cdcfe6bc69c None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:05:15.759860 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-8c177223-7d02-4d93-9e7a-1cdcfe6bc69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:05:15.775040 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c177223-7d02-4d93-9e7a-1cdcfe6bc69c None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:05:15.777538 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501119c1-efc3-4ebe-b045-3c92db112438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:05:15.778563 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501119c1-efc3-4ebe-b045-3c92db112438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:05:15.778854 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501119c1-efc3-4ebe-b045-3c92db112438 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:05:15.779140 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501119c1-efc3-4ebe-b045-3c92db112438 admin admin] PATH_INFO: `/v3/projects/56dfd08bdbc94800baea24f205ac1834` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:05:15.780352 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501119c1-efc3-4ebe-b045-3c92db112438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56dfd08bdbc94800baea24f205ac1834)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:05:15.782563 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501119c1-efc3-4ebe-b045-3c92db112438 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:05:15.926559 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-501119c1-efc3-4ebe-b045-3c92db112438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56dfd08bdbc94800baea24f205ac1834', 'request_id': 'req-501119c1-efc3-4ebe-b045-3c92db112438'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:05:15.932750 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-501119c1-efc3-4ebe-b045-3c92db112438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56dfd08bdbc94800baea24f205ac1834', 'request_id': 'req-501119c1-efc3-4ebe-b045-3c92db112438'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:05:15.938452 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-501119c1-efc3-4ebe-b045-3c92db112438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56dfd08bdbc94800baea24f205ac1834', 'request_id': 'req-501119c1-efc3-4ebe-b045-3c92db112438'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:05:16.056853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-501119c1-efc3-4ebe-b045-3c92db112438 admin admin] The token cache is being invalidate because project 56dfd08bdbc94800baea24f205ac1834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:05:16.057143 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-501119c1-efc3-4ebe-b045-3c92db112438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:05:16.057790 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-501119c1-efc3-4ebe-b045-3c92db112438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:05:16.059334 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1368/2764] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:05:15 2022] DELETE /identity/v3/projects/56dfd08bdbc94800baea24f205ac1834 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:05:16.064250 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3643cb-5b2d-477a-b33b-fb1dee564ab1 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:05:16.064740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3643cb-5b2d-477a-b33b-fb1dee564ab1 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:05:16.064853 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3643cb-5b2d-477a-b33b-fb1dee564ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:05:16.082267 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-6a3643cb-5b2d-477a-b33b-fb1dee564ab1 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:05:16.085429 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-6a3643cb-5b2d-477a-b33b-fb1dee564ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:05:16.101609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:05:16.142892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1397/2765] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:05:16.151294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2a7d5-d30a-4a4c-b29b-ae336944ce0b None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:05:16.151638 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2a7d5-d30a-4a4c-b29b-ae336944ce0b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:05:16.151875 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2a7d5-d30a-4a4c-b29b-ae336944ce0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:05:16.170728 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-41e2a7d5-d30a-4a4c-b29b-ae336944ce0b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:05:16.172288 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-41e2a7d5-d30a-4a4c-b29b-ae336944ce0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:05:16.180429 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1369/2766] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:05:16.184987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3643cb-5b2d-477a-b33b-fb1dee564ab1 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:05:16.195103 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3643cb-5b2d-477a-b33b-fb1dee564ab1 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:05:16.200322 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208fbf3-b0fd-40a1-8dcc-cb2d6d9335f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:05:16.200967 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208fbf3-b0fd-40a1-8dcc-cb2d6d9335f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:05:16.201294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208fbf3-b0fd-40a1-8dcc-cb2d6d9335f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:05:16.201577 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208fbf3-b0fd-40a1-8dcc-cb2d6d9335f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:05:16.202309 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208fbf3-b0fd-40a1-8dcc-cb2d6d9335f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:05:16.202621 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208fbf3-b0fd-40a1-8dcc-cb2d6d9335f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:05:16.204212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208fbf3-b0fd-40a1-8dcc-cb2d6d9335f8 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:05:16.216015 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1398/2767] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 20:05:16.220219 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2a7d5-d30a-4a4c-b29b-ae336944ce0b None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:05:16.230223 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2a7d5-d30a-4a4c-b29b-ae336944ce0b None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:05:16.234956 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f55a69-434e-4bc2-8588-5ce04efd6073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:05:16.235607 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f55a69-434e-4bc2-8588-5ce04efd6073 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:05:16.235896 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f55a69-434e-4bc2-8588-5ce04efd6073 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:05:16.236180 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f55a69-434e-4bc2-8588-5ce04efd6073 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:05:16.236878 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f55a69-434e-4bc2-8588-5ce04efd6073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:05:16.238848 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f55a69-434e-4bc2-8588-5ce04efd6073 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:05:16.309877 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1370/2768] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:05:16 2022] POST /identity/v3/projects => generated 399 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:05:16.316417 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208fbf3-b0fd-40a1-8dcc-cb2d6d9335f8 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:05:16.327119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208fbf3-b0fd-40a1-8dcc-cb2d6d9335f8 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:05:16.384119 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41809520-ed86-4322-b1be-99ff272aa8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:05:16.384840 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41809520-ed86-4322-b1be-99ff272aa8f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:05:16.385201 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41809520-ed86-4322-b1be-99ff272aa8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:05:16.385490 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41809520-ed86-4322-b1be-99ff272aa8f7 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:05:16.386187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41809520-ed86-4322-b1be-99ff272aa8f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:05:16.388115 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41809520-ed86-4322-b1be-99ff272aa8f7 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:05:16.488866 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1399/2769] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:05:16 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:05:16.492794 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f55a69-434e-4bc2-8588-5ce04efd6073 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:05:16.504313 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f55a69-434e-4bc2-8588-5ce04efd6073 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:05:16.508987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac313843-32e1-423e-9e0d-93ea8b6d41e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:05:16.509684 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac313843-32e1-423e-9e0d-93ea8b6d41e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:05:16.509966 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac313843-32e1-423e-9e0d-93ea8b6d41e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:05:16.510246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac313843-32e1-423e-9e0d-93ea8b6d41e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:05:16.510971 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac313843-32e1-423e-9e0d-93ea8b6d41e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:05:16.512561 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac313843-32e1-423e-9e0d-93ea8b6d41e5 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:05:16.523956 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1371/2770] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:05:16.527963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41809520-ed86-4322-b1be-99ff272aa8f7 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:05:16.537856 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41809520-ed86-4322-b1be-99ff272aa8f7 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:05:16.543171 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2690766-e9b4-451d-a333-30340cd38a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:05:16.543818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2690766-e9b4-451d-a333-30340cd38a4d admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:05:16.544102 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2690766-e9b4-451d-a333-30340cd38a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:05:16.544383 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2690766-e9b4-451d-a333-30340cd38a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:05:16.545101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2690766-e9b4-451d-a333-30340cd38a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:05:16.546717 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2690766-e9b4-451d-a333-30340cd38a4d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:05:16.556951 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1400/2771] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:05:16.560908 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac313843-32e1-423e-9e0d-93ea8b6d41e5 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:05:16.570653 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac313843-32e1-423e-9e0d-93ea8b6d41e5 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:05:16.575317 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809290c1-477a-4bc1-bffa-d3245b26aca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:05:16.576230 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809290c1-477a-4bc1-bffa-d3245b26aca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:05:16.576495 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809290c1-477a-4bc1-bffa-d3245b26aca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:05:16.576776 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809290c1-477a-4bc1-bffa-d3245b26aca3 admin admin] PATH_INFO: `/v3/projects/6dbf2bae99bb4252bd057eb32fc7d620/users/b0fcdd4ccbf74aaa91173df8ec2b95fb/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:05:16.591670 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809290c1-477a-4bc1-bffa-d3245b26aca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dbf2bae99bb4252bd057eb32fc7d620, user_id=b0fcdd4ccbf74aaa91173df8ec2b95fb, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:05:16.594318 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809290c1-477a-4bc1-bffa-d3245b26aca3 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:05:16.663065 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1372/2772] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:05:16 2022] PUT /identity/v3/projects/6dbf2bae99bb4252bd057eb32fc7d620/users/b0fcdd4ccbf74aaa91173df8ec2b95fb/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:05:16.674076 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc1fdf-2464-408a-80e4-f5b55367280d None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:05:16.674369 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc1fdf-2464-408a-80e4-f5b55367280d None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:05:16.674649 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc1fdf-2464-408a-80e4-f5b55367280d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:05:16.700534 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-37dc1fdf-2464-408a-80e4-f5b55367280d None None] MFA Rules not processed for user `b0fcdd4ccbf74aaa91173df8ec2b95fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:05:16.701860 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-37dc1fdf-2464-408a-80e4-f5b55367280d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:05:16.765200 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1401/2773] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:05:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:05:16.776850 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809290c1-477a-4bc1-bffa-d3245b26aca3 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:05:16.778688 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-809290c1-477a-4bc1-bffa-d3245b26aca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:05:16.801874 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:05:16.838002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809290c1-477a-4bc1-bffa-d3245b26aca3 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:05:16.841861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1368ed-e622-470b-8a84-aff6d7c0c1eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:05:16.842546 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1368ed-e622-470b-8a84-aff6d7c0c1eb service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:05:16.842835 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1368ed-e622-470b-8a84-aff6d7c0c1eb service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:05:16.843116 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1368ed-e622-470b-8a84-aff6d7c0c1eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:05:16.851751 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1368ed-e622-470b-8a84-aff6d7c0c1eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:05:16.853952 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1368ed-e622-470b-8a84-aff6d7c0c1eb service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:05:16.863064 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1373/2774] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:05:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:05:22.761395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc1fdf-2464-408a-80e4-f5b55367280d None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:05:22.781876 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:05:22.826756 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc1fdf-2464-408a-80e4-f5b55367280d None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:05:22.831247 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d4e1f-0bbe-4d88-a7c5-474dee7f3081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:05:22.832122 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d4e1f-0bbe-4d88-a7c5-474dee7f3081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:05:22.832405 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d4e1f-0bbe-4d88-a7c5-474dee7f3081 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:05:22.832678 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d4e1f-0bbe-4d88-a7c5-474dee7f3081 admin admin] PATH_INFO: `/v3/users/b0fcdd4ccbf74aaa91173df8ec2b95fb` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:05:22.833860 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d4e1f-0bbe-4d88-a7c5-474dee7f3081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0fcdd4ccbf74aaa91173df8ec2b95fb)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:05:22.835804 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d4e1f-0bbe-4d88-a7c5-474dee7f3081 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:05:23.156220 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f76d4e1f-0bbe-4d88-a7c5-474dee7f3081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0fcdd4ccbf74aaa91173df8ec2b95fb'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:05:23.169292 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f76d4e1f-0bbe-4d88-a7c5-474dee7f3081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0fcdd4ccbf74aaa91173df8ec2b95fb'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:05:23.242685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f76d4e1f-0bbe-4d88-a7c5-474dee7f3081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0fcdd4ccbf74aaa91173df8ec2b95fb'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:05:23.243300 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f76d4e1f-0bbe-4d88-a7c5-474dee7f3081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0fcdd4ccbf74aaa91173df8ec2b95fb'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:05:23.250720 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f76d4e1f-0bbe-4d88-a7c5-474dee7f3081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0fcdd4ccbf74aaa91173df8ec2b95fb'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:05:23.256677 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1402/2775] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:05:22 2022] DELETE /identity/v3/users/b0fcdd4ccbf74aaa91173df8ec2b95fb => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:05:23.261460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d753a45-1531-4040-93b4-be353904c2d4 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:05:23.261943 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d753a45-1531-4040-93b4-be353904c2d4 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:05:23.262042 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d753a45-1531-4040-93b4-be353904c2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:05:23.279395 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-2d753a45-1531-4040-93b4-be353904c2d4 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:05:23.280598 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-2d753a45-1531-4040-93b4-be353904c2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:05:23.340609 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1374/2776] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:05:23.351297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d4e1f-0bbe-4d88-a7c5-474dee7f3081 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:05:23.352740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f76d4e1f-0bbe-4d88-a7c5-474dee7f3081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:05:23.410117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d4e1f-0bbe-4d88-a7c5-474dee7f3081 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:05:23.413544 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af6878-3d15-4052-a348-d45e3ce2358d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:05:23.414181 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af6878-3d15-4052-a348-d45e3ce2358d service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:05:23.414463 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af6878-3d15-4052-a348-d45e3ce2358d service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:05:23.414740 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af6878-3d15-4052-a348-d45e3ce2358d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:05:23.424152 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af6878-3d15-4052-a348-d45e3ce2358d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:05:23.425612 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af6878-3d15-4052-a348-d45e3ce2358d service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:05:23.435084 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1403/2777] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:05:23.918384 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d753a45-1531-4040-93b4-be353904c2d4 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:05:23.920410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-2d753a45-1531-4040-93b4-be353904c2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:05:23.933039 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d753a45-1531-4040-93b4-be353904c2d4 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:05:23.938276 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cb035-8119-4bac-a18e-75c0d529ee3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:05:23.939373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cb035-8119-4bac-a18e-75c0d529ee3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:05:23.939660 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cb035-8119-4bac-a18e-75c0d529ee3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:05:23.939937 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cb035-8119-4bac-a18e-75c0d529ee3a admin admin] PATH_INFO: `/v3/projects/6dbf2bae99bb4252bd057eb32fc7d620` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:05:23.941134 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cb035-8119-4bac-a18e-75c0d529ee3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dbf2bae99bb4252bd057eb32fc7d620)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:05:23.943119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cb035-8119-4bac-a18e-75c0d529ee3a admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:05:24.066285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9f1cb035-8119-4bac-a18e-75c0d529ee3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dbf2bae99bb4252bd057eb32fc7d620', 'request_id': 'req-9f1cb035-8119-4bac-a18e-75c0d529ee3a'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:05:24.072492 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9f1cb035-8119-4bac-a18e-75c0d529ee3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dbf2bae99bb4252bd057eb32fc7d620', 'request_id': 'req-9f1cb035-8119-4bac-a18e-75c0d529ee3a'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:05:24.078958 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9f1cb035-8119-4bac-a18e-75c0d529ee3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dbf2bae99bb4252bd057eb32fc7d620', 'request_id': 'req-9f1cb035-8119-4bac-a18e-75c0d529ee3a'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:05:24.174377 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9f1cb035-8119-4bac-a18e-75c0d529ee3a admin admin] The token cache is being invalidate because project 6dbf2bae99bb4252bd057eb32fc7d620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:05:24.174578 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9f1cb035-8119-4bac-a18e-75c0d529ee3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:05:24.175197 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9f1cb035-8119-4bac-a18e-75c0d529ee3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:05:24.176775 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1375/2778] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:05:23 2022] DELETE /identity/v3/projects/6dbf2bae99bb4252bd057eb32fc7d620 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:05:33.430900 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:05:34.171674 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:06:27.451716 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af6878-3d15-4052-a348-d45e3ce2358d service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:06:27.453935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e9af6878-3d15-4052-a348-d45e3ce2358d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:06:27.525754 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af6878-3d15-4052-a348-d45e3ce2358d service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:06:27.586376 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cee606-d031-41d2-9623-5709d99edc44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9ba6d33e8640ec8dcda9971f59c5dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:06:27.587034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cee606-d031-41d2-9623-5709d99edc44 service placement] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:06:27.587397 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cee606-d031-41d2-9623-5709d99edc44 service placement] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:06:27.587752 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cee606-d031-41d2-9623-5709d99edc44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:06:27.589683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-60cee606-d031-41d2-9623-5709d99edc44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:06:27.601890 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cee606-d031-41d2-9623-5709d99edc44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:06:27.603462 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cee606-d031-41d2-9623-5709d99edc44 service placement] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:06:27.614136 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1404/2779] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:06:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:06:37.609115 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=58 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:06:59.545968 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed7245-c439-4c87-9023-b435a746a42c None None] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:06:59.551936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed7245-c439-4c87-9023-b435a746a42c None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:06:59.551936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed7245-c439-4c87-9023-b435a746a42c None None] PATH_INFO: `/` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:06:59.551936 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1376/2780] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 20:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 20:06:59.554476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecb4f7-f1df-4b26-87c5-c868dc236ce4 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:06:59.554963 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecb4f7-f1df-4b26-87c5-c868dc236ce4 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:06:59.555071 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecb4f7-f1df-4b26-87c5-c868dc236ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:06:59.572941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-feecb4f7-f1df-4b26-87c5-c868dc236ce4 None None] MFA Rules not processed for user `24bb6f31e87045f5b17f561b42edca6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:06:59.574192 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-feecb4f7-f1df-4b26-87c5-c868dc236ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:06:59.627648 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1405/2781] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 20:06:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:06:59.640251 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed7245-c439-4c87-9023-b435a746a42c None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:06:59.642011 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-19ed7245-c439-4c87-9023-b435a746a42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:06:59.657103 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed7245-c439-4c87-9023-b435a746a42c None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:06:59.660708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48188e9-8b5b-4225-9916-a28ae2e09507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:06:59.661383 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48188e9-8b5b-4225-9916-a28ae2e09507 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:06:59.661668 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48188e9-8b5b-4225-9916-a28ae2e09507 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:06:59.661950 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48188e9-8b5b-4225-9916-a28ae2e09507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:06:59.669036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48188e9-8b5b-4225-9916-a28ae2e09507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:06:59.670497 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48188e9-8b5b-4225-9916-a28ae2e09507 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:06:59.679160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1377/2782] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:06:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:07:00.770519 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea5fce-0809-47c1-af6b-67220aafd3b4 None None] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:07:00.775453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea5fce-0809-47c1-af6b-67220aafd3b4 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:07:00.775453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea5fce-0809-47c1-af6b-67220aafd3b4 None None] PATH_INFO: `/` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:07:00.775453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1406/2783] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 20:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 20:07:00.777767 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c55ac-5e85-41b5-9eb7-15effc51f021 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:07:00.778199 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c55ac-5e85-41b5-9eb7-15effc51f021 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:07:00.778341 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c55ac-5e85-41b5-9eb7-15effc51f021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:07:00.796843 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-3f4c55ac-5e85-41b5-9eb7-15effc51f021 None None] MFA Rules not processed for user `83bff5cd7782423eaa0bc5b29b208ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:07:00.798172 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-3f4c55ac-5e85-41b5-9eb7-15effc51f021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:07:00.864364 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1378/2784] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 20:07:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:07:00.875630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea5fce-0809-47c1-af6b-67220aafd3b4 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:07:00.877413 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f1ea5fce-0809-47c1-af6b-67220aafd3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:07:00.890745 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea5fce-0809-47c1-af6b-67220aafd3b4 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:07:00.894199 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c692b5a-c5f0-4342-bdff-9ceb76c283d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:07:00.894855 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c692b5a-c5f0-4342-bdff-9ceb76c283d2 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:07:00.895140 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c692b5a-c5f0-4342-bdff-9ceb76c283d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:07:00.895420 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c692b5a-c5f0-4342-bdff-9ceb76c283d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:07:00.906046 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c692b5a-c5f0-4342-bdff-9ceb76c283d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:07:00.907575 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c692b5a-c5f0-4342-bdff-9ceb76c283d2 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:07:00.918401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1407/2785] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:07:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:07:10.854376 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=37 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:10.913756 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=29 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:27.116453 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffa526-31d6-4c59-9901-29b75304bae6 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:07:27.116982 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffa526-31d6-4c59-9901-29b75304bae6 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:07:27.117114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffa526-31d6-4c59-9901-29b75304bae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:07:27.135007 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-74ffa526-31d6-4c59-9901-29b75304bae6 None None] MFA Rules not processed for user `8d9530f903d14b5fbf1ffbc32c6e7b07`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:07:27.136215 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-74ffa526-31d6-4c59-9901-29b75304bae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:07:27.191460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1379/2786] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:07:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:07:27.229286 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c692b5a-c5f0-4342-bdff-9ceb76c283d2 service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:07:27.230674 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-7c692b5a-c5f0-4342-bdff-9ceb76c283d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:07:27.288211 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c692b5a-c5f0-4342-bdff-9ceb76c283d2 service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:07:27.291848 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf9567-e62c-4d11-9eed-59d56d0c5ea2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f078219032be4b619119d1d9d59c499d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:07:27.296715 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf9567-e62c-4d11-9eed-59d56d0c5ea2 service glance] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:07:27.296715 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf9567-e62c-4d11-9eed-59d56d0c5ea2 service glance] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:07:27.296715 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf9567-e62c-4d11-9eed-59d56d0c5ea2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:07:27.296715 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ebdf9567-e62c-4d11-9eed-59d56d0c5ea2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:07:27.308800 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf9567-e62c-4d11-9eed-59d56d0c5ea2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:07:27.310255 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf9567-e62c-4d11-9eed-59d56d0c5ea2 service glance] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:07:27.321278 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1408/2787] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:07:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:07:29.003150 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffa526-31d6-4c59-9901-29b75304bae6 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:07:29.014079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffa526-31d6-4c59-9901-29b75304bae6 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:07:29.017669 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6910b-b2f5-473b-b2c9-8898673f829a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:07:29.024614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6910b-b2f5-473b-b2c9-8898673f829a service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:07:29.024614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6910b-b2f5-473b-b2c9-8898673f829a service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:07:29.024614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6910b-b2f5-473b-b2c9-8898673f829a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:07:29.024614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-b7e6910b-b2f5-473b-b2c9-8898673f829a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:07:29.035146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6910b-b2f5-473b-b2c9-8898673f829a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:07:29.036587 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6910b-b2f5-473b-b2c9-8898673f829a service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:07:29.048526 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1380/2788] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:07:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:07:37.316401 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=26 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:39.042848 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=31 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:31.212779 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf9567-e62c-4d11-9eed-59d56d0c5ea2 service glance] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:31.214453 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ebdf9567-e62c-4d11-9eed-59d56d0c5ea2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:31.230755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf9567-e62c-4d11-9eed-59d56d0c5ea2 service glance] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:31.242134 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86969a80-dfd7-4214-853a-fa102431ec38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:31.242840 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86969a80-dfd7-4214-853a-fa102431ec38 service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:31.243163 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86969a80-dfd7-4214-853a-fa102431ec38 service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:31.243368 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86969a80-dfd7-4214-853a-fa102431ec38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:31.245745 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-86969a80-dfd7-4214-853a-fa102431ec38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:31.259710 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86969a80-dfd7-4214-853a-fa102431ec38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:31.261540 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86969a80-dfd7-4214-853a-fa102431ec38 service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:31.275314 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1409/2789] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:08:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:08:31.370351 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6910b-b2f5-473b-b2c9-8898673f829a service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:31.380667 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6910b-b2f5-473b-b2c9-8898673f829a service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:31.384486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7862889-d1d4-4338-aa11-49a7e257e122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:31.385139 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7862889-d1d4-4338-aa11-49a7e257e122 service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:31.385457 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7862889-d1d4-4338-aa11-49a7e257e122 service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:31.385739 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7862889-d1d4-4338-aa11-49a7e257e122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:31.387859 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d7862889-d1d4-4338-aa11-49a7e257e122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:31.398876 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7862889-d1d4-4338-aa11-49a7e257e122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:31.400535 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7862889-d1d4-4338-aa11-49a7e257e122 service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:31.409762 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1381/2790] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:08:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:08:36.037071 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86969a80-dfd7-4214-853a-fa102431ec38 service nova] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:36.049274 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86969a80-dfd7-4214-853a-fa102431ec38 service nova] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:36.054977 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1eec44-848c-4dda-9338-6872816405bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:36.055658 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1eec44-848c-4dda-9338-6872816405bb service nova] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:36.055947 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1eec44-848c-4dda-9338-6872816405bb service nova] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:36.056225 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1eec44-848c-4dda-9338-6872816405bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:36.058164 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-1f1eec44-848c-4dda-9338-6872816405bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:36.074083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1eec44-848c-4dda-9338-6872816405bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:36.076458 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1eec44-848c-4dda-9338-6872816405bb service nova] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:36.109215 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1410/2791] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:08:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:08:41.405613 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=6 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:42.532697 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7862889-d1d4-4338-aa11-49a7e257e122 service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:42.534144 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d7862889-d1d4-4338-aa11-49a7e257e122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:42.548623 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7862889-d1d4-4338-aa11-49a7e257e122 service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:42.553789 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402ecee-5bfd-44fc-a251-8b0655fbc1e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9ba6d33e8640ec8dcda9971f59c5dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:42.555832 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402ecee-5bfd-44fc-a251-8b0655fbc1e6 service placement] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:42.555832 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402ecee-5bfd-44fc-a251-8b0655fbc1e6 service placement] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:42.555832 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402ecee-5bfd-44fc-a251-8b0655fbc1e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:42.557166 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-5402ecee-5bfd-44fc-a251-8b0655fbc1e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:42.568887 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402ecee-5bfd-44fc-a251-8b0655fbc1e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:42.570505 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402ecee-5bfd-44fc-a251-8b0655fbc1e6 service placement] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:42.581652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1382/2792] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:08:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 20:08:46.084905 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=12 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:48.382998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1eec44-848c-4dda-9338-6872816405bb service nova] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:48.384525 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-1f1eec44-848c-4dda-9338-6872816405bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:48.454653 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1eec44-848c-4dda-9338-6872816405bb service nova] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:48.459234 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575cf39-8207-4115-88cc-8f5be6166a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:48.460110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575cf39-8207-4115-88cc-8f5be6166a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:48.460391 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575cf39-8207-4115-88cc-8f5be6166a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:48.460668 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575cf39-8207-4115-88cc-8f5be6166a25 admin admin] PATH_INFO: `/v3/users/842655da97c74216bd2288d598fa321c` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:48.461877 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575cf39-8207-4115-88cc-8f5be6166a25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=842655da97c74216bd2288d598fa321c)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:48.463800 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575cf39-8207-4115-88cc-8f5be6166a25 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:48.701651 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-a575cf39-8207-4115-88cc-8f5be6166a25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '842655da97c74216bd2288d598fa321c'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:48.716272 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-a575cf39-8207-4115-88cc-8f5be6166a25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '842655da97c74216bd2288d598fa321c'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:48.815992 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-a575cf39-8207-4115-88cc-8f5be6166a25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '842655da97c74216bd2288d598fa321c'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:48.816697 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-a575cf39-8207-4115-88cc-8f5be6166a25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '842655da97c74216bd2288d598fa321c'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:48.824214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-a575cf39-8207-4115-88cc-8f5be6166a25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '842655da97c74216bd2288d598fa321c'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:48.830392 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1411/2793] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:08:48 2022] DELETE /identity/v3/users/842655da97c74216bd2288d598fa321c => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:08:49.146887 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402ecee-5bfd-44fc-a251-8b0655fbc1e6 service placement] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:49.158588 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402ecee-5bfd-44fc-a251-8b0655fbc1e6 service placement] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:49.221122 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbd3e9-401d-41dd-a09c-a67c6e66d8fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9ba6d33e8640ec8dcda9971f59c5dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:49.221825 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbd3e9-401d-41dd-a09c-a67c6e66d8fe service placement] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:49.222109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbd3e9-401d-41dd-a09c-a67c6e66d8fe service placement] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:49.222391 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbd3e9-401d-41dd-a09c-a67c6e66d8fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:49.224154 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-b1bbd3e9-401d-41dd-a09c-a67c6e66d8fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:49.236512 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bbd3e9-401d-41dd-a09c-a67c6e66d8fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:49.238164 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bbd3e9-401d-41dd-a09c-a67c6e66d8fe service placement] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:49.248090 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1383/2794] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:08:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:08:49.287248 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575cf39-8207-4115-88cc-8f5be6166a25 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:49.289625 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-a575cf39-8207-4115-88cc-8f5be6166a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:49.298475 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbd3e9-401d-41dd-a09c-a67c6e66d8fe service placement] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:49.300318 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-b1bbd3e9-401d-41dd-a09c-a67c6e66d8fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:49.372428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575cf39-8207-4115-88cc-8f5be6166a25 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:49.376065 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbd3e9-401d-41dd-a09c-a67c6e66d8fe service placement] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:49.377761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2819bb8-f061-48cf-8215-44284c66323e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:49.378832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2819bb8-f061-48cf-8215-44284c66323e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:49.379054 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2819bb8-f061-48cf-8215-44284c66323e admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:49.379330 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2819bb8-f061-48cf-8215-44284c66323e admin admin] PATH_INFO: `/v3/projects/5f5eb13e3140478eb348b08b11f18c3b` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:49.380493 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2819bb8-f061-48cf-8215-44284c66323e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f5eb13e3140478eb348b08b11f18c3b)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:49.381566 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420296f-1212-4328-843c-8ab80021d5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:49.382436 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2819bb8-f061-48cf-8215-44284c66323e admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:49.382572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420296f-1212-4328-843c-8ab80021d5a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:49.382768 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420296f-1212-4328-843c-8ab80021d5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:49.383049 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420296f-1212-4328-843c-8ab80021d5a1 admin admin] PATH_INFO: `/v3/users/8d9530f903d14b5fbf1ffbc32c6e7b07` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:49.384309 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420296f-1212-4328-843c-8ab80021d5a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d9530f903d14b5fbf1ffbc32c6e7b07)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:49.386310 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420296f-1212-4328-843c-8ab80021d5a1 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:49.407155 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:49.497278 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e2819bb8-f061-48cf-8215-44284c66323e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f5eb13e3140478eb348b08b11f18c3b', 'request_id': 'req-e2819bb8-f061-48cf-8215-44284c66323e'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:49.503705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e2819bb8-f061-48cf-8215-44284c66323e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f5eb13e3140478eb348b08b11f18c3b', 'request_id': 'req-e2819bb8-f061-48cf-8215-44284c66323e'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:49.511622 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e2819bb8-f061-48cf-8215-44284c66323e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f5eb13e3140478eb348b08b11f18c3b', 'request_id': 'req-e2819bb8-f061-48cf-8215-44284c66323e'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:49.658636 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e420296f-1212-4328-843c-8ab80021d5a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d9530f903d14b5fbf1ffbc32c6e7b07'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:49.671213 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e420296f-1212-4328-843c-8ab80021d5a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d9530f903d14b5fbf1ffbc32c6e7b07'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:49.678365 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e2819bb8-f061-48cf-8215-44284c66323e admin admin] The token cache is being invalidate because project 5f5eb13e3140478eb348b08b11f18c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:08:49.678658 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e2819bb8-f061-48cf-8215-44284c66323e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:49.679291 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e2819bb8-f061-48cf-8215-44284c66323e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:49.680896 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1412/2795] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:08:49 2022] DELETE /identity/v3/projects/5f5eb13e3140478eb348b08b11f18c3b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:08:49.684711 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2819bb8-f061-48cf-8215-44284c66323e admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:49.686339 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e2819bb8-f061-48cf-8215-44284c66323e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:49.749549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2819bb8-f061-48cf-8215-44284c66323e admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:49.754194 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30561e-0f20-4a68-8884-f6e064f33024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:49.755056 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30561e-0f20-4a68-8884-f6e064f33024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:49.755345 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30561e-0f20-4a68-8884-f6e064f33024 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:49.755628 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30561e-0f20-4a68-8884-f6e064f33024 admin admin] PATH_INFO: `/v3/users/9e006eaff9d5412d98b4a1e511d3a3da` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:49.756837 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30561e-0f20-4a68-8884-f6e064f33024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e006eaff9d5412d98b4a1e511d3a3da)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:49.758859 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30561e-0f20-4a68-8884-f6e064f33024 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:49.775787 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e420296f-1212-4328-843c-8ab80021d5a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d9530f903d14b5fbf1ffbc32c6e7b07'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:49.776489 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e420296f-1212-4328-843c-8ab80021d5a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d9530f903d14b5fbf1ffbc32c6e7b07'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:49.782844 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:49.784973 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e420296f-1212-4328-843c-8ab80021d5a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d9530f903d14b5fbf1ffbc32c6e7b07'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:49.791403 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1384/2796] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:08:49 2022] DELETE /identity/v3/users/8d9530f903d14b5fbf1ffbc32c6e7b07 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:08:49.973955 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-fe30561e-0f20-4a68-8884-f6e064f33024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e006eaff9d5412d98b4a1e511d3a3da'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:49.986800 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-fe30561e-0f20-4a68-8884-f6e064f33024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e006eaff9d5412d98b4a1e511d3a3da'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:50.063555 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420296f-1212-4328-843c-8ab80021d5a1 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:50.065081 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-e420296f-1212-4328-843c-8ab80021d5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:50.096729 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-fe30561e-0f20-4a68-8884-f6e064f33024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e006eaff9d5412d98b4a1e511d3a3da'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:50.097439 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-fe30561e-0f20-4a68-8884-f6e064f33024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e006eaff9d5412d98b4a1e511d3a3da'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:50.105755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-fe30561e-0f20-4a68-8884-f6e064f33024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e006eaff9d5412d98b4a1e511d3a3da'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:50.111764 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1413/2797] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:08:49 2022] DELETE /identity/v3/users/9e006eaff9d5412d98b4a1e511d3a3da => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:08:50.138297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420296f-1212-4328-843c-8ab80021d5a1 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:50.197779 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de859492-b61c-4635-8ea2-1441d894d889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:50.198658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de859492-b61c-4635-8ea2-1441d894d889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:50.198945 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de859492-b61c-4635-8ea2-1441d894d889 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:50.199225 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de859492-b61c-4635-8ea2-1441d894d889 admin admin] PATH_INFO: `/v3/projects/2a94c2bc051848fbbb59be2d314991d2` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:50.200416 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de859492-b61c-4635-8ea2-1441d894d889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a94c2bc051848fbbb59be2d314991d2)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:50.203093 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de859492-b61c-4635-8ea2-1441d894d889 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:50.359212 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-de859492-b61c-4635-8ea2-1441d894d889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a94c2bc051848fbbb59be2d314991d2', 'request_id': 'req-de859492-b61c-4635-8ea2-1441d894d889'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:50.365255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-de859492-b61c-4635-8ea2-1441d894d889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a94c2bc051848fbbb59be2d314991d2', 'request_id': 'req-de859492-b61c-4635-8ea2-1441d894d889'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:50.370628 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-de859492-b61c-4635-8ea2-1441d894d889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a94c2bc051848fbbb59be2d314991d2', 'request_id': 'req-de859492-b61c-4635-8ea2-1441d894d889'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:50.396138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30561e-0f20-4a68-8884-f6e064f33024 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:50.397685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-fe30561e-0f20-4a68-8884-f6e064f33024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:50.411265 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30561e-0f20-4a68-8884-f6e064f33024 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:50.438792 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:50.461415 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-de859492-b61c-4635-8ea2-1441d894d889 admin admin] The token cache is being invalidate because project 2a94c2bc051848fbbb59be2d314991d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:08:50.461928 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-de859492-b61c-4635-8ea2-1441d894d889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:50.462563 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-de859492-b61c-4635-8ea2-1441d894d889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:50.464274 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1385/2798] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:08:50 2022] DELETE /identity/v3/projects/2a94c2bc051848fbbb59be2d314991d2 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:08:50.469392 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62704471-04a2-41a2-9ab0-7ca758f3313f None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:50.469793 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62704471-04a2-41a2-9ab0-7ca758f3313f None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:50.470123 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62704471-04a2-41a2-9ab0-7ca758f3313f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:50.478896 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03689369-e777-4c5f-895e-89943f7cff58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:50.478896 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03689369-e777-4c5f-895e-89943f7cff58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:50.478896 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03689369-e777-4c5f-895e-89943f7cff58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:50.478896 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03689369-e777-4c5f-895e-89943f7cff58 admin admin] PATH_INFO: `/v3/projects/d41b3b376d5f48d7872a582c7dfba910` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:50.479362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03689369-e777-4c5f-895e-89943f7cff58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d41b3b376d5f48d7872a582c7dfba910)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:50.479362 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03689369-e777-4c5f-895e-89943f7cff58 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:50.488927 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-62704471-04a2-41a2-9ab0-7ca758f3313f None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:08:50.490142 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-62704471-04a2-41a2-9ab0-7ca758f3313f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:50.499037 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1386/2799] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:08:50.514449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bb6ba-7a49-40da-b00c-00e604f3853b None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:50.514747 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bb6ba-7a49-40da-b00c-00e604f3853b None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:50.515034 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bb6ba-7a49-40da-b00c-00e604f3853b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:50.533764 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-916bb6ba-7a49-40da-b00c-00e604f3853b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:08:50.535042 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-916bb6ba-7a49-40da-b00c-00e604f3853b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:50.543238 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1387/2800] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:08:50.547930 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bb6ba-7a49-40da-b00c-00e604f3853b None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:50.557497 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bb6ba-7a49-40da-b00c-00e604f3853b None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:50.562294 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4572b1-170e-4f50-a664-043627713920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:50.562986 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4572b1-170e-4f50-a664-043627713920 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:50.563277 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4572b1-170e-4f50-a664-043627713920 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:50.563584 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4572b1-170e-4f50-a664-043627713920 admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:50.564316 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4572b1-170e-4f50-a664-043627713920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:08:50.564652 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4572b1-170e-4f50-a664-043627713920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:50.566284 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4572b1-170e-4f50-a664-043627713920 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:50.578745 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1388/2801] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 20:08:50.583015 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4572b1-170e-4f50-a664-043627713920 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:50.593516 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4572b1-170e-4f50-a664-043627713920 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:50.597120 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:50.601395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-03689369-e777-4c5f-895e-89943f7cff58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd41b3b376d5f48d7872a582c7dfba910', 'request_id': 'req-03689369-e777-4c5f-895e-89943f7cff58'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:50.607748 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-03689369-e777-4c5f-895e-89943f7cff58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd41b3b376d5f48d7872a582c7dfba910', 'request_id': 'req-03689369-e777-4c5f-895e-89943f7cff58'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:50.613199 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-03689369-e777-4c5f-895e-89943f7cff58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd41b3b376d5f48d7872a582c7dfba910', 'request_id': 'req-03689369-e777-4c5f-895e-89943f7cff58'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:50.649668 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3334a-08d0-4088-80e6-59220612c3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:50.650332 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3334a-08d0-4088-80e6-59220612c3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:50.650620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3334a-08d0-4088-80e6-59220612c3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:50.650972 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3334a-08d0-4088-80e6-59220612c3d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:50.651675 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3334a-08d0-4088-80e6-59220612c3d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:50.653615 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3334a-08d0-4088-80e6-59220612c3d4 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:50.712476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-03689369-e777-4c5f-895e-89943f7cff58 admin admin] The token cache is being invalidate because project d41b3b376d5f48d7872a582c7dfba910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:08:50.712765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-03689369-e777-4c5f-895e-89943f7cff58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:50.713413 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-03689369-e777-4c5f-895e-89943f7cff58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:50.714961 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1414/2802] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:08:50 2022] DELETE /identity/v3/projects/d41b3b376d5f48d7872a582c7dfba910 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:08:50.805283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1389/2803] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:08:50 2022] POST /identity/v3/projects => generated 373 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:08:50.806518 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03689369-e777-4c5f-895e-89943f7cff58 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:50.807964 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-03689369-e777-4c5f-895e-89943f7cff58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:50.821876 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03689369-e777-4c5f-895e-89943f7cff58 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:50.883823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed3898-db56-4a49-8953-b1aca6557142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:50.884529 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed3898-db56-4a49-8953-b1aca6557142 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:50.884823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed3898-db56-4a49-8953-b1aca6557142 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:50.885110 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed3898-db56-4a49-8953-b1aca6557142 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:50.885851 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed3898-db56-4a49-8953-b1aca6557142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:50.887853 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed3898-db56-4a49-8953-b1aca6557142 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:51.005576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1415/2804] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:08:50 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:08:51.009699 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3334a-08d0-4088-80e6-59220612c3d4 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:51.020203 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3334a-08d0-4088-80e6-59220612c3d4 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:51.024770 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead34f7-86db-4cdf-acda-917402d2d692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:51.025449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead34f7-86db-4cdf-acda-917402d2d692 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:51.025740 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead34f7-86db-4cdf-acda-917402d2d692 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:51.026024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead34f7-86db-4cdf-acda-917402d2d692 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:51.026743 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead34f7-86db-4cdf-acda-917402d2d692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:51.028346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead34f7-86db-4cdf-acda-917402d2d692 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:51.039400 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1390/2805] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:08:51.047810 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed3898-db56-4a49-8953-b1aca6557142 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:51.058161 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed3898-db56-4a49-8953-b1aca6557142 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:51.062932 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2236275-e334-4022-bff9-08cae3500da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:51.063586 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2236275-e334-4022-bff9-08cae3500da5 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:51.063875 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2236275-e334-4022-bff9-08cae3500da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:51.064156 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2236275-e334-4022-bff9-08cae3500da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:51.064881 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2236275-e334-4022-bff9-08cae3500da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:51.066578 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2236275-e334-4022-bff9-08cae3500da5 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:51.076492 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1416/2806] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:08:51.094122 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead34f7-86db-4cdf-acda-917402d2d692 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:51.104345 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead34f7-86db-4cdf-acda-917402d2d692 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:51.109658 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d4e53-b180-46dd-b86d-11bfd9fbb7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:51.110559 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d4e53-b180-46dd-b86d-11bfd9fbb7a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:51.110838 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d4e53-b180-46dd-b86d-11bfd9fbb7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:51.111114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d4e53-b180-46dd-b86d-11bfd9fbb7a1 admin admin] PATH_INFO: `/v3/projects/22f3409fb1f74749bb2bc58ea3a87175/users/6c0a9cdce8d54cc5ac39726f5717fb1e/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:51.126374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d4e53-b180-46dd-b86d-11bfd9fbb7a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f3409fb1f74749bb2bc58ea3a87175, user_id=6c0a9cdce8d54cc5ac39726f5717fb1e, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:51.136098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d4e53-b180-46dd-b86d-11bfd9fbb7a1 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:51.359766 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1391/2807] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:08:51 2022] PUT /identity/v3/projects/22f3409fb1f74749bb2bc58ea3a87175/users/6c0a9cdce8d54cc5ac39726f5717fb1e/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:08:51.369749 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b3e6e-cc6d-4916-9874-afab441db1c5 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:51.370041 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b3e6e-cc6d-4916-9874-afab441db1c5 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:51.370322 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b3e6e-cc6d-4916-9874-afab441db1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:51.397303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-d85b3e6e-cc6d-4916-9874-afab441db1c5 None None] MFA Rules not processed for user `6c0a9cdce8d54cc5ac39726f5717fb1e`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:08:51.398501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-d85b3e6e-cc6d-4916-9874-afab441db1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:51.424528 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:51.461953 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1417/2808] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:08:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:08:51.473352 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d4e53-b180-46dd-b86d-11bfd9fbb7a1 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:51.475083 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-be1d4e53-b180-46dd-b86d-11bfd9fbb7a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:51.549797 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d4e53-b180-46dd-b86d-11bfd9fbb7a1 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:51.555387 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7951f-3927-4d58-a3e8-4a801dae98ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bff5cd7782423eaa0bc5b29b208ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:51.556037 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7951f-3927-4d58-a3e8-4a801dae98ef service nova] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:51.556324 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7951f-3927-4d58-a3e8-4a801dae98ef service nova] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:51.556606 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7951f-3927-4d58-a3e8-4a801dae98ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:51.566328 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7951f-3927-4d58-a3e8-4a801dae98ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:51.570802 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7951f-3927-4d58-a3e8-4a801dae98ef service nova] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:51.577281 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1392/2809] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:08:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:08:51.798607 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b3e6e-cc6d-4916-9874-afab441db1c5 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:51.861523 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b3e6e-cc6d-4916-9874-afab441db1c5 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:51.867304 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4e195-5908-4d00-8aa7-e856bef713e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:51.868122 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4e195-5908-4d00-8aa7-e856bef713e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:51.868414 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4e195-5908-4d00-8aa7-e856bef713e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:51.868698 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4e195-5908-4d00-8aa7-e856bef713e5 admin admin] PATH_INFO: `/v3/users/6c0a9cdce8d54cc5ac39726f5717fb1e` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:51.869994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4e195-5908-4d00-8aa7-e856bef713e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c0a9cdce8d54cc5ac39726f5717fb1e)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:51.875935 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4e195-5908-4d00-8aa7-e856bef713e5 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:52.109634 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-eaf4e195-5908-4d00-8aa7-e856bef713e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c0a9cdce8d54cc5ac39726f5717fb1e'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:52.121595 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-eaf4e195-5908-4d00-8aa7-e856bef713e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c0a9cdce8d54cc5ac39726f5717fb1e'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:52.170241 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-eaf4e195-5908-4d00-8aa7-e856bef713e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c0a9cdce8d54cc5ac39726f5717fb1e'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:52.170922 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-eaf4e195-5908-4d00-8aa7-e856bef713e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c0a9cdce8d54cc5ac39726f5717fb1e'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:52.178011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-eaf4e195-5908-4d00-8aa7-e856bef713e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c0a9cdce8d54cc5ac39726f5717fb1e'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:52.183857 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1418/2810] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:08:51 2022] DELETE /identity/v3/users/6c0a9cdce8d54cc5ac39726f5717fb1e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:08:52.188310 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a29377-42eb-4408-99fb-658b4f4845ec None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:52.188609 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a29377-42eb-4408-99fb-658b4f4845ec None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:52.188897 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a29377-42eb-4408-99fb-658b4f4845ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:52.206163 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-a0a29377-42eb-4408-99fb-658b4f4845ec None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:08:52.207394 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-a0a29377-42eb-4408-99fb-658b4f4845ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:52.245967 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:52.266675 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1393/2811] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:08:52.276382 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4e195-5908-4d00-8aa7-e856bef713e5 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:52.277813 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-eaf4e195-5908-4d00-8aa7-e856bef713e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:52.330033 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:52.335097 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4e195-5908-4d00-8aa7-e856bef713e5 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:52.338661 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb0c7e-bff7-498c-b4c8-79994389c06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:52.339302 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb0c7e-bff7-498c-b4c8-79994389c06c service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:52.339590 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb0c7e-bff7-498c-b4c8-79994389c06c service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:52.339871 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb0c7e-bff7-498c-b4c8-79994389c06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:52.349298 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb0c7e-bff7-498c-b4c8-79994389c06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:52.350998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb0c7e-bff7-498c-b4c8-79994389c06c service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:52.360393 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1419/2812] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:08:52.788796 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a29377-42eb-4408-99fb-658b4f4845ec None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:52.790261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-a0a29377-42eb-4408-99fb-658b4f4845ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:52.802803 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a29377-42eb-4408-99fb-658b4f4845ec None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:52.808760 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8403d21-7d9f-4204-a11f-0f2612df4ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:52.814107 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8403d21-7d9f-4204-a11f-0f2612df4ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:52.814107 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8403d21-7d9f-4204-a11f-0f2612df4ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:52.814107 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8403d21-7d9f-4204-a11f-0f2612df4ae6 admin admin] PATH_INFO: `/v3/projects/22f3409fb1f74749bb2bc58ea3a87175` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:52.814107 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8403d21-7d9f-4204-a11f-0f2612df4ae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f3409fb1f74749bb2bc58ea3a87175)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:52.814887 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8403d21-7d9f-4204-a11f-0f2612df4ae6 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:52.931366 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d8403d21-7d9f-4204-a11f-0f2612df4ae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f3409fb1f74749bb2bc58ea3a87175', 'request_id': 'req-d8403d21-7d9f-4204-a11f-0f2612df4ae6'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:52.938348 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d8403d21-7d9f-4204-a11f-0f2612df4ae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f3409fb1f74749bb2bc58ea3a87175', 'request_id': 'req-d8403d21-7d9f-4204-a11f-0f2612df4ae6'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:52.943961 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d8403d21-7d9f-4204-a11f-0f2612df4ae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f3409fb1f74749bb2bc58ea3a87175', 'request_id': 'req-d8403d21-7d9f-4204-a11f-0f2612df4ae6'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:53.068030 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d8403d21-7d9f-4204-a11f-0f2612df4ae6 admin admin] The token cache is being invalidate because project 22f3409fb1f74749bb2bc58ea3a87175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:08:53.068320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d8403d21-7d9f-4204-a11f-0f2612df4ae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:53.068930 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-d8403d21-7d9f-4204-a11f-0f2612df4ae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:53.070572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1394/2813] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:08:52 2022] DELETE /identity/v3/projects/22f3409fb1f74749bb2bc58ea3a87175 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:08:53.075516 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e9266-0e97-41a4-afae-b05cb4e61ce8 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:53.076000 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e9266-0e97-41a4-afae-b05cb4e61ce8 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:53.076099 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e9266-0e97-41a4-afae-b05cb4e61ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:53.093544 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-c15e9266-0e97-41a4-afae-b05cb4e61ce8 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:08:53.094780 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c15e9266-0e97-41a4-afae-b05cb4e61ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:53.153275 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1420/2814] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:08:53.161544 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f040e4-371e-41c4-a748-12fb681c4e4e None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:53.161822 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f040e4-371e-41c4-a748-12fb681c4e4e None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:53.162108 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f040e4-371e-41c4-a748-12fb681c4e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:53.180966 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-44f040e4-371e-41c4-a748-12fb681c4e4e None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:08:53.182207 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-44f040e4-371e-41c4-a748-12fb681c4e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:53.190349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1395/2815] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:08:53.194530 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e9266-0e97-41a4-afae-b05cb4e61ce8 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:53.204278 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e9266-0e97-41a4-afae-b05cb4e61ce8 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:53.208877 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47dc7e-6a92-459b-bc33-278aec231568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:53.209561 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47dc7e-6a92-459b-bc33-278aec231568 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:53.209853 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47dc7e-6a92-459b-bc33-278aec231568 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:53.210133 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47dc7e-6a92-459b-bc33-278aec231568 admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:53.210862 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47dc7e-6a92-459b-bc33-278aec231568 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:08:53.211169 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47dc7e-6a92-459b-bc33-278aec231568 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:53.212801 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47dc7e-6a92-459b-bc33-278aec231568 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:53.224709 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1421/2816] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 20:08:53.229111 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f040e4-371e-41c4-a748-12fb681c4e4e None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:53.239285 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f040e4-371e-41c4-a748-12fb681c4e4e None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:53.243972 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721f79d-91cb-44cd-b11a-684815faea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:53.244618 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721f79d-91cb-44cd-b11a-684815faea6f admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:53.244898 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721f79d-91cb-44cd-b11a-684815faea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:53.245266 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721f79d-91cb-44cd-b11a-684815faea6f admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:53.245967 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721f79d-91cb-44cd-b11a-684815faea6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:53.247914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721f79d-91cb-44cd-b11a-684815faea6f admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:53.360914 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1396/2817] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:08:53 2022] POST /identity/v3/projects => generated 403 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 20:08:53.364820 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47dc7e-6a92-459b-bc33-278aec231568 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:53.375469 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47dc7e-6a92-459b-bc33-278aec231568 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:53.433185 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d881ed3-01c1-4a61-822f-4bd76b5d914e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:53.433792 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d881ed3-01c1-4a61-822f-4bd76b5d914e admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:53.434091 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d881ed3-01c1-4a61-822f-4bd76b5d914e admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:53.434456 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d881ed3-01c1-4a61-822f-4bd76b5d914e admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:53.435179 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d881ed3-01c1-4a61-822f-4bd76b5d914e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:53.437136 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d881ed3-01c1-4a61-822f-4bd76b5d914e admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:53.536914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1422/2818] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:08:53 2022] POST /identity/v3/users => generated 302 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:08:53.541095 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721f79d-91cb-44cd-b11a-684815faea6f admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:53.552681 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721f79d-91cb-44cd-b11a-684815faea6f admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:53.557401 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5a5c3-8d02-4520-b2e1-b6f71df857d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:53.558053 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5a5c3-8d02-4520-b2e1-b6f71df857d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:53.558338 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5a5c3-8d02-4520-b2e1-b6f71df857d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:53.558613 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5a5c3-8d02-4520-b2e1-b6f71df857d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:53.559363 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5a5c3-8d02-4520-b2e1-b6f71df857d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:53.561374 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5a5c3-8d02-4520-b2e1-b6f71df857d1 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:53.572634 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1397/2819] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:08:53.577226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d881ed3-01c1-4a61-822f-4bd76b5d914e admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:53.587466 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d881ed3-01c1-4a61-822f-4bd76b5d914e admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:53.592861 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64637c04-a90b-4875-9a7f-c90c4dd86901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:53.593599 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64637c04-a90b-4875-9a7f-c90c4dd86901 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:53.593928 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64637c04-a90b-4875-9a7f-c90c4dd86901 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:53.594212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64637c04-a90b-4875-9a7f-c90c4dd86901 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:53.594952 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64637c04-a90b-4875-9a7f-c90c4dd86901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:53.596587 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64637c04-a90b-4875-9a7f-c90c4dd86901 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:53.606835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1423/2820] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:08:53.610811 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5a5c3-8d02-4520-b2e1-b6f71df857d1 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:53.620823 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5a5c3-8d02-4520-b2e1-b6f71df857d1 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:53.625573 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd062033-69e1-42df-b280-9d10184be715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:53.626446 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd062033-69e1-42df-b280-9d10184be715 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:53.626729 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd062033-69e1-42df-b280-9d10184be715 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:53.627003 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd062033-69e1-42df-b280-9d10184be715 admin admin] PATH_INFO: `/v3/projects/db3007c9712f45d6870fe15302964f83/users/ff903c99d5c44dd0a629f03bb66c46ed/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:53.642340 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd062033-69e1-42df-b280-9d10184be715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3007c9712f45d6870fe15302964f83, user_id=ff903c99d5c44dd0a629f03bb66c46ed, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:53.644949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd062033-69e1-42df-b280-9d10184be715 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:53.736756 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1398/2821] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:08:53 2022] PUT /identity/v3/projects/db3007c9712f45d6870fe15302964f83/users/ff903c99d5c44dd0a629f03bb66c46ed/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:08:53.758462 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856fdd4-a6fd-4435-af6d-fb1e2461edfa None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:53.758759 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856fdd4-a6fd-4435-af6d-fb1e2461edfa None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:53.759043 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856fdd4-a6fd-4435-af6d-fb1e2461edfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:53.786351 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-a856fdd4-a6fd-4435-af6d-fb1e2461edfa None None] MFA Rules not processed for user `ff903c99d5c44dd0a629f03bb66c46ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:08:53.787571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-a856fdd4-a6fd-4435-af6d-fb1e2461edfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:53.832169 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:53.853544 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1424/2822] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:08:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:08:53.858246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd062033-69e1-42df-b280-9d10184be715 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:53.920815 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd062033-69e1-42df-b280-9d10184be715 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:53.925531 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bbea1-92dc-4cd2-b5b0-1cc71c8907c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:53.926188 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bbea1-92dc-4cd2-b5b0-1cc71c8907c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:53.926477 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bbea1-92dc-4cd2-b5b0-1cc71c8907c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:53.926757 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bbea1-92dc-4cd2-b5b0-1cc71c8907c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:53.927456 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bbea1-92dc-4cd2-b5b0-1cc71c8907c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:53.929399 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bbea1-92dc-4cd2-b5b0-1cc71c8907c8 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:53.933350 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:54.045471 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1399/2823] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:08:53 2022] POST /identity/v3/projects => generated 403 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:08:54.053353 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856fdd4-a6fd-4435-af6d-fb1e2461edfa None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:54.065022 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856fdd4-a6fd-4435-af6d-fb1e2461edfa None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:54.120252 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb9943-7185-4d97-b21e-51ff920f6205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:54.120924 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb9943-7185-4d97-b21e-51ff920f6205 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:54.121221 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb9943-7185-4d97-b21e-51ff920f6205 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:54.121508 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb9943-7185-4d97-b21e-51ff920f6205 admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:54.122209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb9943-7185-4d97-b21e-51ff920f6205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:54.124700 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb9943-7185-4d97-b21e-51ff920f6205 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:54.238637 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1425/2824] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:08:54 2022] POST /identity/v3/users => generated 308 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:08:54.242722 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bbea1-92dc-4cd2-b5b0-1cc71c8907c8 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:54.254265 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bbea1-92dc-4cd2-b5b0-1cc71c8907c8 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:54.258947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80578fba-ac54-46b8-980c-79a478f21bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:54.259616 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80578fba-ac54-46b8-980c-79a478f21bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:54.259902 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80578fba-ac54-46b8-980c-79a478f21bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:54.260186 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80578fba-ac54-46b8-980c-79a478f21bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:54.260918 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80578fba-ac54-46b8-980c-79a478f21bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:54.262570 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80578fba-ac54-46b8-980c-79a478f21bd8 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:54.274101 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1400/2825] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:08:54.278251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb9943-7185-4d97-b21e-51ff920f6205 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:54.288394 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb9943-7185-4d97-b21e-51ff920f6205 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:54.292927 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40147157-d0e3-4bc1-a1ca-58d4dcbdf997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:54.293823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40147157-d0e3-4bc1-a1ca-58d4dcbdf997 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:54.294109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40147157-d0e3-4bc1-a1ca-58d4dcbdf997 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:54.294389 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40147157-d0e3-4bc1-a1ca-58d4dcbdf997 admin admin] PATH_INFO: `/v3/projects/053c413a2e6149d08ed327ec881a4b0c/users/bffbcdd2b9e541a680c4fd3617ba170d/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:54.310037 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40147157-d0e3-4bc1-a1ca-58d4dcbdf997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=053c413a2e6149d08ed327ec881a4b0c, user_id=bffbcdd2b9e541a680c4fd3617ba170d, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:54.313455 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40147157-d0e3-4bc1-a1ca-58d4dcbdf997 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:54.404859 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1426/2826] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:08:54 2022] PUT /identity/v3/projects/053c413a2e6149d08ed327ec881a4b0c/users/bffbcdd2b9e541a680c4fd3617ba170d/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:08:54.408885 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80578fba-ac54-46b8-980c-79a478f21bd8 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:54.418777 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80578fba-ac54-46b8-980c-79a478f21bd8 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:54.474840 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaae48e-e7a2-453d-aa07-b97eec5f26ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:54.475510 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaae48e-e7a2-453d-aa07-b97eec5f26ed admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:54.476099 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaae48e-e7a2-453d-aa07-b97eec5f26ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:54.476378 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaae48e-e7a2-453d-aa07-b97eec5f26ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:54.477125 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaae48e-e7a2-453d-aa07-b97eec5f26ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:54.478780 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaae48e-e7a2-453d-aa07-b97eec5f26ed admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:54.488933 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1401/2827] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:08:54.493021 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40147157-d0e3-4bc1-a1ca-58d4dcbdf997 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:54.503789 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40147157-d0e3-4bc1-a1ca-58d4dcbdf997 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:54.508421 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efefe9-dfb6-4f3e-a069-4a8695e68d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:54.509310 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efefe9-dfb6-4f3e-a069-4a8695e68d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:54.509598 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efefe9-dfb6-4f3e-a069-4a8695e68d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:54.509875 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efefe9-dfb6-4f3e-a069-4a8695e68d3f admin admin] PATH_INFO: `/v3/projects/053c413a2e6149d08ed327ec881a4b0c/users/bffbcdd2b9e541a680c4fd3617ba170d/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:54.511796 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efefe9-dfb6-4f3e-a069-4a8695e68d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=053c413a2e6149d08ed327ec881a4b0c, user_id=bffbcdd2b9e541a680c4fd3617ba170d, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:54.514502 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efefe9-dfb6-4f3e-a069-4a8695e68d3f admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:54.524342 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1427/2828] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:08:54 2022] PUT /identity/v3/projects/053c413a2e6149d08ed327ec881a4b0c/users/bffbcdd2b9e541a680c4fd3617ba170d/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:08:54.535451 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c44929-fd1e-4c80-872a-dff2091af791 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:54.535745 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c44929-fd1e-4c80-872a-dff2091af791 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:54.536030 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c44929-fd1e-4c80-872a-dff2091af791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:54.563283 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-a5c44929-fd1e-4c80-872a-dff2091af791 None None] MFA Rules not processed for user `bffbcdd2b9e541a680c4fd3617ba170d`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:08:54.564418 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-a5c44929-fd1e-4c80-872a-dff2091af791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:54.633223 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1402/2829] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:08:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:08:54.643977 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efefe9-dfb6-4f3e-a069-4a8695e68d3f admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:54.645721 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-30efefe9-dfb6-4f3e-a069-4a8695e68d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:54.701513 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efefe9-dfb6-4f3e-a069-4a8695e68d3f admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:54.705130 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065ff46-fd2b-4f18-986d-4af8bde4185d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:54.705799 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065ff46-fd2b-4f18-986d-4af8bde4185d service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:54.706085 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065ff46-fd2b-4f18-986d-4af8bde4185d service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:54.706364 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065ff46-fd2b-4f18-986d-4af8bde4185d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:54.715308 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065ff46-fd2b-4f18-986d-4af8bde4185d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:54.716743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065ff46-fd2b-4f18-986d-4af8bde4185d service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:54.726970 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1428/2830] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:08:54 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:08:54.867673 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c44929-fd1e-4c80-872a-dff2091af791 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:54.925893 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:54.929837 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c44929-fd1e-4c80-872a-dff2091af791 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:54.934362 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44ad04-f971-4afe-b782-8f62ecfba6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:54.935232 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44ad04-f971-4afe-b782-8f62ecfba6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:54.935520 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44ad04-f971-4afe-b782-8f62ecfba6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:54.935832 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44ad04-f971-4afe-b782-8f62ecfba6bf admin admin] PATH_INFO: `/v3/users/ff903c99d5c44dd0a629f03bb66c46ed` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:54.937128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44ad04-f971-4afe-b782-8f62ecfba6bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff903c99d5c44dd0a629f03bb66c46ed)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:54.939072 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44ad04-f971-4afe-b782-8f62ecfba6bf admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:55.207787 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6d44ad04-f971-4afe-b782-8f62ecfba6bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff903c99d5c44dd0a629f03bb66c46ed'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:55.220282 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6d44ad04-f971-4afe-b782-8f62ecfba6bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff903c99d5c44dd0a629f03bb66c46ed'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:55.313106 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6d44ad04-f971-4afe-b782-8f62ecfba6bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff903c99d5c44dd0a629f03bb66c46ed'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:55.313757 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6d44ad04-f971-4afe-b782-8f62ecfba6bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff903c99d5c44dd0a629f03bb66c46ed'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:55.321262 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-6d44ad04-f971-4afe-b782-8f62ecfba6bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff903c99d5c44dd0a629f03bb66c46ed'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:55.327705 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1403/2831] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:08:54 2022] DELETE /identity/v3/users/ff903c99d5c44dd0a629f03bb66c46ed => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:08:55.332256 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d2d5c-a5ba-4d3e-930a-d8833a3e8681 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:55.332772 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d2d5c-a5ba-4d3e-930a-d8833a3e8681 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:55.332874 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d2d5c-a5ba-4d3e-930a-d8833a3e8681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:55.351101 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-bd9d2d5c-a5ba-4d3e-930a-d8833a3e8681 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:08:55.352318 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-bd9d2d5c-a5ba-4d3e-930a-d8833a3e8681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:55.384954 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:55.410282 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1429/2832] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:08:55.419947 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44ad04-f971-4afe-b782-8f62ecfba6bf admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:55.421744 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-6d44ad04-f971-4afe-b782-8f62ecfba6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:55.479690 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44ad04-f971-4afe-b782-8f62ecfba6bf admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:55.483973 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc731e0-92cf-42b6-89c5-a883f4c6605d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:55.484810 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc731e0-92cf-42b6-89c5-a883f4c6605d service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:55.485141 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc731e0-92cf-42b6-89c5-a883f4c6605d service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:55.485504 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc731e0-92cf-42b6-89c5-a883f4c6605d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:55.494687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc731e0-92cf-42b6-89c5-a883f4c6605d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:55.496161 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc731e0-92cf-42b6-89c5-a883f4c6605d service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:55.506210 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1404/2833] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:08:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:08:55.920741 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d2d5c-a5ba-4d3e-930a-d8833a3e8681 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:55.923048 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-bd9d2d5c-a5ba-4d3e-930a-d8833a3e8681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:55.936823 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d2d5c-a5ba-4d3e-930a-d8833a3e8681 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:55.941732 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1321a87-cdc0-4c60-8316-27149ccd417a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:55.942629 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1321a87-cdc0-4c60-8316-27149ccd417a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:55.942914 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1321a87-cdc0-4c60-8316-27149ccd417a admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:55.943196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1321a87-cdc0-4c60-8316-27149ccd417a admin admin] PATH_INFO: `/v3/projects/db3007c9712f45d6870fe15302964f83` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:55.944391 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1321a87-cdc0-4c60-8316-27149ccd417a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db3007c9712f45d6870fe15302964f83)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:55.946333 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1321a87-cdc0-4c60-8316-27149ccd417a admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:56.068017 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f1321a87-cdc0-4c60-8316-27149ccd417a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db3007c9712f45d6870fe15302964f83', 'request_id': 'req-f1321a87-cdc0-4c60-8316-27149ccd417a'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:56.073975 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f1321a87-cdc0-4c60-8316-27149ccd417a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db3007c9712f45d6870fe15302964f83', 'request_id': 'req-f1321a87-cdc0-4c60-8316-27149ccd417a'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:56.080090 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f1321a87-cdc0-4c60-8316-27149ccd417a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db3007c9712f45d6870fe15302964f83', 'request_id': 'req-f1321a87-cdc0-4c60-8316-27149ccd417a'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:56.180810 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f1321a87-cdc0-4c60-8316-27149ccd417a admin admin] The token cache is being invalidate because project db3007c9712f45d6870fe15302964f83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:08:56.181106 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f1321a87-cdc0-4c60-8316-27149ccd417a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:56.181758 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-f1321a87-cdc0-4c60-8316-27149ccd417a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:56.183312 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1430/2834] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:08:55 2022] DELETE /identity/v3/projects/db3007c9712f45d6870fe15302964f83 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:08:56.195033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc731e0-92cf-42b6-89c5-a883f4c6605d service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:56.205360 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc731e0-92cf-42b6-89c5-a883f4c6605d service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:56.262073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b39dfe-563a-49e7-80f8-e4674181bb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:56.262939 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b39dfe-563a-49e7-80f8-e4674181bb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:56.263227 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b39dfe-563a-49e7-80f8-e4674181bb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:56.263506 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b39dfe-563a-49e7-80f8-e4674181bb96 admin admin] PATH_INFO: `/v3/users/bffbcdd2b9e541a680c4fd3617ba170d` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:56.264831 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b39dfe-563a-49e7-80f8-e4674181bb96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bffbcdd2b9e541a680c4fd3617ba170d)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:56.266820 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b39dfe-563a-49e7-80f8-e4674181bb96 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:56.288236 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:56.566212 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e9b39dfe-563a-49e7-80f8-e4674181bb96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bffbcdd2b9e541a680c4fd3617ba170d'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:56.578654 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e9b39dfe-563a-49e7-80f8-e4674181bb96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bffbcdd2b9e541a680c4fd3617ba170d'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:56.644297 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e9b39dfe-563a-49e7-80f8-e4674181bb96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bffbcdd2b9e541a680c4fd3617ba170d'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:56.644922 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e9b39dfe-563a-49e7-80f8-e4674181bb96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bffbcdd2b9e541a680c4fd3617ba170d'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:56.652076 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-e9b39dfe-563a-49e7-80f8-e4674181bb96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bffbcdd2b9e541a680c4fd3617ba170d'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:56.658696 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1405/2835] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:08:56 2022] DELETE /identity/v3/users/bffbcdd2b9e541a680c4fd3617ba170d => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:08:57.097088 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1321a87-cdc0-4c60-8316-27149ccd417a admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:57.098568 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-f1321a87-cdc0-4c60-8316-27149ccd417a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:57.112317 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1321a87-cdc0-4c60-8316-27149ccd417a admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:57.171323 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba0bbe-5925-4fab-9430-c6e8c8d3cc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:57.172765 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba0bbe-5925-4fab-9430-c6e8c8d3cc2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:57.173044 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba0bbe-5925-4fab-9430-c6e8c8d3cc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:57.173348 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba0bbe-5925-4fab-9430-c6e8c8d3cc2d admin admin] PATH_INFO: `/v3/projects/053c413a2e6149d08ed327ec881a4b0c` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:57.174543 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba0bbe-5925-4fab-9430-c6e8c8d3cc2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=053c413a2e6149d08ed327ec881a4b0c)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:57.176447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba0bbe-5925-4fab-9430-c6e8c8d3cc2d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:57.330618 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-77ba0bbe-5925-4fab-9430-c6e8c8d3cc2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '053c413a2e6149d08ed327ec881a4b0c', 'request_id': 'req-77ba0bbe-5925-4fab-9430-c6e8c8d3cc2d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:57.336719 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-77ba0bbe-5925-4fab-9430-c6e8c8d3cc2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '053c413a2e6149d08ed327ec881a4b0c', 'request_id': 'req-77ba0bbe-5925-4fab-9430-c6e8c8d3cc2d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:57.342289 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-77ba0bbe-5925-4fab-9430-c6e8c8d3cc2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '053c413a2e6149d08ed327ec881a4b0c', 'request_id': 'req-77ba0bbe-5925-4fab-9430-c6e8c8d3cc2d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:57.346000 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:57.512451 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-77ba0bbe-5925-4fab-9430-c6e8c8d3cc2d admin admin] The token cache is being invalidate because project 053c413a2e6149d08ed327ec881a4b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:08:57.512747 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-77ba0bbe-5925-4fab-9430-c6e8c8d3cc2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:57.513416 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-77ba0bbe-5925-4fab-9430-c6e8c8d3cc2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:08:57.514956 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1431/2836] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:08:57 2022] DELETE /identity/v3/projects/053c413a2e6149d08ed327ec881a4b0c => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:08:57.520495 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05665f27-9463-4e1c-be95-0c1c4890f7a8 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:57.520987 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05665f27-9463-4e1c-be95-0c1c4890f7a8 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:57.521109 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05665f27-9463-4e1c-be95-0c1c4890f7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:57.541025 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-05665f27-9463-4e1c-be95-0c1c4890f7a8 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:08:57.542260 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-05665f27-9463-4e1c-be95-0c1c4890f7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:57.602152 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1406/2837] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:08:57.609908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420e5d0-4e07-4626-8ca9-0cde8c710ab5 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:57.610227 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420e5d0-4e07-4626-8ca9-0cde8c710ab5 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:57.610509 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420e5d0-4e07-4626-8ca9-0cde8c710ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:57.629239 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-8420e5d0-4e07-4626-8ca9-0cde8c710ab5 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:08:57.630389 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-8420e5d0-4e07-4626-8ca9-0cde8c710ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:57.638205 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1432/2838] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:08:57.643185 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05665f27-9463-4e1c-be95-0c1c4890f7a8 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:57.652988 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05665f27-9463-4e1c-be95-0c1c4890f7a8 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:57.658373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da428e9-b89c-48ad-acca-22faaf203ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:57.659023 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da428e9-b89c-48ad-acca-22faaf203ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:57.659313 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da428e9-b89c-48ad-acca-22faaf203ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:57.659591 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da428e9-b89c-48ad-acca-22faaf203ff1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:57.660364 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da428e9-b89c-48ad-acca-22faaf203ff1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:08:57.660686 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da428e9-b89c-48ad-acca-22faaf203ff1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:57.662385 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da428e9-b89c-48ad-acca-22faaf203ff1 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:57.674462 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1407/2839] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 20:08:57.678594 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420e5d0-4e07-4626-8ca9-0cde8c710ab5 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:57.687701 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420e5d0-4e07-4626-8ca9-0cde8c710ab5 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:57.693366 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec05d0-4569-407e-98f2-8c19b2f91ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:57.694019 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec05d0-4569-407e-98f2-8c19b2f91ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:57.694310 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec05d0-4569-407e-98f2-8c19b2f91ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:57.694593 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec05d0-4569-407e-98f2-8c19b2f91ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:57.695282 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec05d0-4569-407e-98f2-8c19b2f91ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:57.697189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec05d0-4569-407e-98f2-8c19b2f91ff0 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:57.806209 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1433/2840] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:08:57 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:08:57.810353 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da428e9-b89c-48ad-acca-22faaf203ff1 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:57.820457 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da428e9-b89c-48ad-acca-22faaf203ff1 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:57.877490 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3245d-3b42-4065-8d49-8d2d67b8516e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:57.878081 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3245d-3b42-4065-8d49-8d2d67b8516e admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:57.878370 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3245d-3b42-4065-8d49-8d2d67b8516e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:57.878653 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3245d-3b42-4065-8d49-8d2d67b8516e admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:57.879339 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3245d-3b42-4065-8d49-8d2d67b8516e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:57.881322 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3245d-3b42-4065-8d49-8d2d67b8516e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:57.959160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1408/2841] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:08:57 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:08:57.963236 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec05d0-4569-407e-98f2-8c19b2f91ff0 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:57.974182 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec05d0-4569-407e-98f2-8c19b2f91ff0 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:57.979048 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557ef35-f3ed-43c7-83dc-c59ee0da0150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:57.979699 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557ef35-f3ed-43c7-83dc-c59ee0da0150 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:57.979987 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557ef35-f3ed-43c7-83dc-c59ee0da0150 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:57.980382 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557ef35-f3ed-43c7-83dc-c59ee0da0150 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:57.981112 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557ef35-f3ed-43c7-83dc-c59ee0da0150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:57.982732 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557ef35-f3ed-43c7-83dc-c59ee0da0150 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:57.995266 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1434/2842] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:08:57.999273 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3245d-3b42-4065-8d49-8d2d67b8516e admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:58.009703 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3245d-3b42-4065-8d49-8d2d67b8516e admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:58.014408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf00872-f3d7-47c1-aee4-176b2ee1445b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:58.015061 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf00872-f3d7-47c1-aee4-176b2ee1445b admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:58.015346 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf00872-f3d7-47c1-aee4-176b2ee1445b admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:58.015624 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf00872-f3d7-47c1-aee4-176b2ee1445b admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:58.016347 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf00872-f3d7-47c1-aee4-176b2ee1445b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:58.018792 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf00872-f3d7-47c1-aee4-176b2ee1445b admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:58.028676 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1409/2843] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:08:58.033476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557ef35-f3ed-43c7-83dc-c59ee0da0150 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:58.043371 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557ef35-f3ed-43c7-83dc-c59ee0da0150 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:58.048117 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851c328-8b50-44b5-baf4-53f03491e078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:58.048994 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851c328-8b50-44b5-baf4-53f03491e078 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:58.049319 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851c328-8b50-44b5-baf4-53f03491e078 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:58.049597 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851c328-8b50-44b5-baf4-53f03491e078 admin admin] PATH_INFO: `/v3/projects/98b2f74c6ec94ecca06f3d016454723f/users/f6a64487a62242a0a5f5381455c6ce0c/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:58.063799 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851c328-8b50-44b5-baf4-53f03491e078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b2f74c6ec94ecca06f3d016454723f, user_id=f6a64487a62242a0a5f5381455c6ce0c, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:58.066457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851c328-8b50-44b5-baf4-53f03491e078 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:58.147666 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1435/2844] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:08:58 2022] PUT /identity/v3/projects/98b2f74c6ec94ecca06f3d016454723f/users/f6a64487a62242a0a5f5381455c6ce0c/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:08:58.159734 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ccf8c-accc-4193-960e-6bc00c791aa8 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:58.160028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ccf8c-accc-4193-960e-6bc00c791aa8 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:58.160307 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ccf8c-accc-4193-960e-6bc00c791aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:58.167040 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:58.186327 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-085ccf8c-accc-4193-960e-6bc00c791aa8 None None] MFA Rules not processed for user `f6a64487a62242a0a5f5381455c6ce0c`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:08:58.187543 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-085ccf8c-accc-4193-960e-6bc00c791aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:58.252119 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1410/2845] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:08:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:08:58.256820 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851c328-8b50-44b5-baf4-53f03491e078 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:58.319427 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851c328-8b50-44b5-baf4-53f03491e078 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:58.324095 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05825d5-c289-47d3-9831-2976bcc037f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:58.324749 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05825d5-c289-47d3-9831-2976bcc037f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:58.325034 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05825d5-c289-47d3-9831-2976bcc037f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:58.325340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05825d5-c289-47d3-9831-2976bcc037f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:58.326039 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05825d5-c289-47d3-9831-2976bcc037f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:58.327941 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05825d5-c289-47d3-9831-2976bcc037f0 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:58.411615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1436/2846] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:08:58 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:08:58.420175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ccf8c-accc-4193-960e-6bc00c791aa8 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:58.430872 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ccf8c-accc-4193-960e-6bc00c791aa8 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:58.487410 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c11c2d-c22d-4f0a-8f3a-c4cc412d5db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:58.488081 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c11c2d-c22d-4f0a-8f3a-c4cc412d5db4 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:58.488370 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c11c2d-c22d-4f0a-8f3a-c4cc412d5db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:58.488651 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c11c2d-c22d-4f0a-8f3a-c4cc412d5db4 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:58.489378 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c11c2d-c22d-4f0a-8f3a-c4cc412d5db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:58.491293 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c11c2d-c22d-4f0a-8f3a-c4cc412d5db4 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:58.587337 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1411/2847] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:08:58 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:08:58.591584 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05825d5-c289-47d3-9831-2976bcc037f0 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:58.602675 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05825d5-c289-47d3-9831-2976bcc037f0 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:58.607326 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa3ebc-ebbd-4aee-900f-5a1c093825cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:58.607980 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa3ebc-ebbd-4aee-900f-5a1c093825cc admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:58.608296 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa3ebc-ebbd-4aee-900f-5a1c093825cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:58.608586 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa3ebc-ebbd-4aee-900f-5a1c093825cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:58.609415 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa3ebc-ebbd-4aee-900f-5a1c093825cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:58.611177 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa3ebc-ebbd-4aee-900f-5a1c093825cc admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:58.621810 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1437/2848] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 20:08:58.625737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c11c2d-c22d-4f0a-8f3a-c4cc412d5db4 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:58.636828 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c11c2d-c22d-4f0a-8f3a-c4cc412d5db4 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:58.642498 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db0312-c2e6-4d3d-b685-9a1698cb623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:58.643156 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db0312-c2e6-4d3d-b685-9a1698cb623e admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:58.643443 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db0312-c2e6-4d3d-b685-9a1698cb623e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:58.643731 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db0312-c2e6-4d3d-b685-9a1698cb623e admin admin] PATH_INFO: `/v3/projects/e7524ce18237466c8a5c09ef6f7cd742/users/7f3b1fd96bb64b79bb996e57b3dcb834/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:58.658993 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db0312-c2e6-4d3d-b685-9a1698cb623e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7524ce18237466c8a5c09ef6f7cd742, user_id=7f3b1fd96bb64b79bb996e57b3dcb834, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:58.661738 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db0312-c2e6-4d3d-b685-9a1698cb623e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:58.764705 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1412/2849] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:08:58 2022] PUT /identity/v3/projects/e7524ce18237466c8a5c09ef6f7cd742/users/7f3b1fd96bb64b79bb996e57b3dcb834/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:08:58.769470 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa3ebc-ebbd-4aee-900f-5a1c093825cc admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:58.779566 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa3ebc-ebbd-4aee-900f-5a1c093825cc admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:58.835890 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa76fda-b263-451b-9e38-a66092d471e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:58.836552 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa76fda-b263-451b-9e38-a66092d471e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:58.836833 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa76fda-b263-451b-9e38-a66092d471e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:58.837109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa76fda-b263-451b-9e38-a66092d471e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:58.837861 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa76fda-b263-451b-9e38-a66092d471e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:58.839450 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa76fda-b263-451b-9e38-a66092d471e0 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:58.844289 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:58.850226 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1438/2850] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:08:58.854753 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db0312-c2e6-4d3d-b685-9a1698cb623e admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:58.865247 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db0312-c2e6-4d3d-b685-9a1698cb623e admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:58.869833 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da31f2-d69b-480c-87c8-71562d2a4a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:58.870702 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da31f2-d69b-480c-87c8-71562d2a4a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:58.870986 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da31f2-d69b-480c-87c8-71562d2a4a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:58.871261 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da31f2-d69b-480c-87c8-71562d2a4a13 admin admin] PATH_INFO: `/v3/projects/e7524ce18237466c8a5c09ef6f7cd742/users/7f3b1fd96bb64b79bb996e57b3dcb834/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:58.873424 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da31f2-d69b-480c-87c8-71562d2a4a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7524ce18237466c8a5c09ef6f7cd742, user_id=7f3b1fd96bb64b79bb996e57b3dcb834, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:58.876178 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da31f2-d69b-480c-87c8-71562d2a4a13 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:58.886904 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1413/2851] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:08:58 2022] PUT /identity/v3/projects/e7524ce18237466c8a5c09ef6f7cd742/users/7f3b1fd96bb64b79bb996e57b3dcb834/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:08:58.897600 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba83642-006b-4ce5-88b7-0593c5378097 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:58.897892 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba83642-006b-4ce5-88b7-0593c5378097 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:58.898173 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba83642-006b-4ce5-88b7-0593c5378097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:58.925189 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-aba83642-006b-4ce5-88b7-0593c5378097 None None] MFA Rules not processed for user `7f3b1fd96bb64b79bb996e57b3dcb834`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:08:58.926352 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-aba83642-006b-4ce5-88b7-0593c5378097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:58.997089 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1439/2852] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:08:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:08:59.007837 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da31f2-d69b-480c-87c8-71562d2a4a13 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:08:59.009594 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-91da31f2-d69b-480c-87c8-71562d2a4a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:08:59.062016 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:59.067239 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da31f2-d69b-480c-87c8-71562d2a4a13 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:08:59.070944 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c21fd-4bcd-4f13-a920-52dca6a8a901 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:08:59.071582 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c21fd-4bcd-4f13-a920-52dca6a8a901 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:08:59.071865 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c21fd-4bcd-4f13-a920-52dca6a8a901 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:08:59.072141 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c21fd-4bcd-4f13-a920-52dca6a8a901 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:08:59.130158 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c21fd-4bcd-4f13-a920-52dca6a8a901 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:08:59.131998 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c21fd-4bcd-4f13-a920-52dca6a8a901 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:08:59.141033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1414/2853] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:08:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:09:02.522936 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba83642-006b-4ce5-88b7-0593c5378097 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:02.533270 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba83642-006b-4ce5-88b7-0593c5378097 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:02.536832 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b646491-fa3a-4308-84da-d8e56d6b5c66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:02.537501 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b646491-fa3a-4308-84da-d8e56d6b5c66 service cinder] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:02.537788 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b646491-fa3a-4308-84da-d8e56d6b5c66 service cinder] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:02.538067 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b646491-fa3a-4308-84da-d8e56d6b5c66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:02.547060 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b646491-fa3a-4308-84da-d8e56d6b5c66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:02.548999 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b646491-fa3a-4308-84da-d8e56d6b5c66 service cinder] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:02.558591 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1440/2854] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:09:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:09:09.137022 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=27 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:12.554351 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=40 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:17.632643 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c21fd-4bcd-4f13-a920-52dca6a8a901 service cinder] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:17.695058 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c21fd-4bcd-4f13-a920-52dca6a8a901 service cinder] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:17.699545 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5bc4d-4d18-44e1-9c4b-63e95ef95af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:17.700413 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5bc4d-4d18-44e1-9c4b-63e95ef95af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:17.700783 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5bc4d-4d18-44e1-9c4b-63e95ef95af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:17.701012 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5bc4d-4d18-44e1-9c4b-63e95ef95af4 admin admin] PATH_INFO: `/v3/users/f6a64487a62242a0a5f5381455c6ce0c` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:17.702248 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5bc4d-4d18-44e1-9c4b-63e95ef95af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6a64487a62242a0a5f5381455c6ce0c)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:17.704175 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5bc4d-4d18-44e1-9c4b-63e95ef95af4 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:17.869139 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-0fb5bc4d-4d18-44e1-9c4b-63e95ef95af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6a64487a62242a0a5f5381455c6ce0c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:17.881053 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-0fb5bc4d-4d18-44e1-9c4b-63e95ef95af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6a64487a62242a0a5f5381455c6ce0c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:17.941295 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-0fb5bc4d-4d18-44e1-9c4b-63e95ef95af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6a64487a62242a0a5f5381455c6ce0c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:17.941921 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-0fb5bc4d-4d18-44e1-9c4b-63e95ef95af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6a64487a62242a0a5f5381455c6ce0c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:17.949521 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-0fb5bc4d-4d18-44e1-9c4b-63e95ef95af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6a64487a62242a0a5f5381455c6ce0c'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:17.956581 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1415/2855] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:09:17 2022] DELETE /identity/v3/users/f6a64487a62242a0a5f5381455c6ce0c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:09:17.960980 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2f95e-7084-4d39-b5b2-685426dce2c0 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:17.961485 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2f95e-7084-4d39-b5b2-685426dce2c0 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:17.961583 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2f95e-7084-4d39-b5b2-685426dce2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:17.979997 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-6bd2f95e-7084-4d39-b5b2-685426dce2c0 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:09:17.981222 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-6bd2f95e-7084-4d39-b5b2-685426dce2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:18.040006 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1441/2856] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:09:18.050026 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5bc4d-4d18-44e1-9c4b-63e95ef95af4 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:18.051443 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-0fb5bc4d-4d18-44e1-9c4b-63e95ef95af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:18.109104 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5bc4d-4d18-44e1-9c4b-63e95ef95af4 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:18.113253 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2f524-2cd3-4866-9b57-2b88a559717b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:18.118071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2f524-2cd3-4866-9b57-2b88a559717b service neutron] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:18.118071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2f524-2cd3-4866-9b57-2b88a559717b service neutron] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:18.118071 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2f524-2cd3-4866-9b57-2b88a559717b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:18.123537 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2f524-2cd3-4866-9b57-2b88a559717b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:18.124951 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2f524-2cd3-4866-9b57-2b88a559717b service neutron] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:18.135018 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1416/2857] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:09:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:09:18.542878 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2f95e-7084-4d39-b5b2-685426dce2c0 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:18.544326 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-6bd2f95e-7084-4d39-b5b2-685426dce2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:18.556825 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2f95e-7084-4d39-b5b2-685426dce2c0 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:18.561868 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8af0c1-9211-47a5-a1fb-4504d5ddb55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:18.562729 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8af0c1-9211-47a5-a1fb-4504d5ddb55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:18.563015 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8af0c1-9211-47a5-a1fb-4504d5ddb55d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:18.563294 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8af0c1-9211-47a5-a1fb-4504d5ddb55d admin admin] PATH_INFO: `/v3/projects/98b2f74c6ec94ecca06f3d016454723f` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:18.565228 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8af0c1-9211-47a5-a1fb-4504d5ddb55d admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b2f74c6ec94ecca06f3d016454723f)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:18.571028 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8af0c1-9211-47a5-a1fb-4504d5ddb55d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:18.702061 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-aa8af0c1-9211-47a5-a1fb-4504d5ddb55d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b2f74c6ec94ecca06f3d016454723f', 'request_id': 'req-aa8af0c1-9211-47a5-a1fb-4504d5ddb55d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:18.708379 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-aa8af0c1-9211-47a5-a1fb-4504d5ddb55d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b2f74c6ec94ecca06f3d016454723f', 'request_id': 'req-aa8af0c1-9211-47a5-a1fb-4504d5ddb55d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:18.713775 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-aa8af0c1-9211-47a5-a1fb-4504d5ddb55d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b2f74c6ec94ecca06f3d016454723f', 'request_id': 'req-aa8af0c1-9211-47a5-a1fb-4504d5ddb55d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:18.786438 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-aa8af0c1-9211-47a5-a1fb-4504d5ddb55d admin admin] The token cache is being invalidate because project 98b2f74c6ec94ecca06f3d016454723f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:09:18.786690 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-aa8af0c1-9211-47a5-a1fb-4504d5ddb55d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:18.787277 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-aa8af0c1-9211-47a5-a1fb-4504d5ddb55d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:18.788805 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1442/2858] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:09:18 2022] DELETE /identity/v3/projects/98b2f74c6ec94ecca06f3d016454723f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:09:18.792873 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2f524-2cd3-4866-9b57-2b88a559717b service neutron] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:18.803712 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2f524-2cd3-4866-9b57-2b88a559717b service neutron] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:18.822581 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:18.862807 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa9003-4f1e-4df9-95fa-98d6cd73da78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:18.863678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa9003-4f1e-4df9-95fa-98d6cd73da78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:18.863968 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa9003-4f1e-4df9-95fa-98d6cd73da78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:18.864247 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa9003-4f1e-4df9-95fa-98d6cd73da78 admin admin] PATH_INFO: `/v3/users/7f3b1fd96bb64b79bb996e57b3dcb834` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:18.865500 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa9003-4f1e-4df9-95fa-98d6cd73da78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f3b1fd96bb64b79bb996e57b3dcb834)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:18.867488 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa9003-4f1e-4df9-95fa-98d6cd73da78 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:19.086241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-19aa9003-4f1e-4df9-95fa-98d6cd73da78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f3b1fd96bb64b79bb996e57b3dcb834'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:19.098438 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-19aa9003-4f1e-4df9-95fa-98d6cd73da78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f3b1fd96bb64b79bb996e57b3dcb834'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:19.192259 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-19aa9003-4f1e-4df9-95fa-98d6cd73da78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f3b1fd96bb64b79bb996e57b3dcb834'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:19.192880 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-19aa9003-4f1e-4df9-95fa-98d6cd73da78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f3b1fd96bb64b79bb996e57b3dcb834'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:19.200735 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-19aa9003-4f1e-4df9-95fa-98d6cd73da78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f3b1fd96bb64b79bb996e57b3dcb834'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:19.207098 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1417/2859] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:09:18 2022] DELETE /identity/v3/users/7f3b1fd96bb64b79bb996e57b3dcb834 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:09:19.675018 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8af0c1-9211-47a5-a1fb-4504d5ddb55d admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:19.689317 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-aa8af0c1-9211-47a5-a1fb-4504d5ddb55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:19.690459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8af0c1-9211-47a5-a1fb-4504d5ddb55d admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:19.749017 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc012e46-0393-4cc5-96ab-04944dd5981d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:19.749902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc012e46-0393-4cc5-96ab-04944dd5981d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:19.750187 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc012e46-0393-4cc5-96ab-04944dd5981d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:19.750466 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc012e46-0393-4cc5-96ab-04944dd5981d admin admin] PATH_INFO: `/v3/projects/e7524ce18237466c8a5c09ef6f7cd742` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:19.752674 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc012e46-0393-4cc5-96ab-04944dd5981d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7524ce18237466c8a5c09ef6f7cd742)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:19.754615 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc012e46-0393-4cc5-96ab-04944dd5981d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:19.828549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:19.845515 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-fc012e46-0393-4cc5-96ab-04944dd5981d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7524ce18237466c8a5c09ef6f7cd742', 'request_id': 'req-fc012e46-0393-4cc5-96ab-04944dd5981d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:19.851761 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-fc012e46-0393-4cc5-96ab-04944dd5981d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7524ce18237466c8a5c09ef6f7cd742', 'request_id': 'req-fc012e46-0393-4cc5-96ab-04944dd5981d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:19.857038 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-fc012e46-0393-4cc5-96ab-04944dd5981d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7524ce18237466c8a5c09ef6f7cd742', 'request_id': 'req-fc012e46-0393-4cc5-96ab-04944dd5981d'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:19.929212 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-fc012e46-0393-4cc5-96ab-04944dd5981d admin admin] The token cache is being invalidate because project e7524ce18237466c8a5c09ef6f7cd742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91965) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:09:19.929459 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-fc012e46-0393-4cc5-96ab-04944dd5981d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:19.930107 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-fc012e46-0393-4cc5-96ab-04944dd5981d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:19.931616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1443/2860] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:09:19 2022] DELETE /identity/v3/projects/e7524ce18237466c8a5c09ef6f7cd742 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:09:19.936530 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af26a8-2ae8-49db-8764-54dd7ff1a022 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:19.937007 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af26a8-2ae8-49db-8764-54dd7ff1a022 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:19.937137 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af26a8-2ae8-49db-8764-54dd7ff1a022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:19.956460 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-80af26a8-2ae8-49db-8764-54dd7ff1a022 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:09:19.957708 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-80af26a8-2ae8-49db-8764-54dd7ff1a022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:20.016362 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1418/2861] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:09:20.025677 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc82d62-8cb5-49b3-afc0-c79983d460f7 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:20.025998 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc82d62-8cb5-49b3-afc0-c79983d460f7 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:20.026279 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc82d62-8cb5-49b3-afc0-c79983d460f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:20.046008 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-dbc82d62-8cb5-49b3-afc0-c79983d460f7 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:09:20.047285 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-dbc82d62-8cb5-49b3-afc0-c79983d460f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:20.055618 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1444/2862] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:09:20.059768 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af26a8-2ae8-49db-8764-54dd7ff1a022 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:20.069996 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af26a8-2ae8-49db-8764-54dd7ff1a022 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:20.074754 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2b53f-1138-4b74-9d42-8e3e73364227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:20.080029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2b53f-1138-4b74-9d42-8e3e73364227 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:20.080029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2b53f-1138-4b74-9d42-8e3e73364227 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:20.080029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2b53f-1138-4b74-9d42-8e3e73364227 admin admin] PATH_INFO: `/v3/domains` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:20.080029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2b53f-1138-4b74-9d42-8e3e73364227 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91966) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:09:20.080029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2b53f-1138-4b74-9d42-8e3e73364227 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:20.080029 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2b53f-1138-4b74-9d42-8e3e73364227 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:20.091160 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1419/2863] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 20:09:20.095595 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc82d62-8cb5-49b3-afc0-c79983d460f7 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:20.105058 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc82d62-8cb5-49b3-afc0-c79983d460f7 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:20.109680 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30162cc4-107b-4f58-8935-0660fc0cce26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:20.110375 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30162cc4-107b-4f58-8935-0660fc0cce26 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:20.112660 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30162cc4-107b-4f58-8935-0660fc0cce26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:20.112660 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30162cc4-107b-4f58-8935-0660fc0cce26 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:20.112660 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30162cc4-107b-4f58-8935-0660fc0cce26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:20.114299 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30162cc4-107b-4f58-8935-0660fc0cce26 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:20.205609 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1445/2864] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:09:20 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:09:20.209618 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2b53f-1138-4b74-9d42-8e3e73364227 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:20.219660 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2b53f-1138-4b74-9d42-8e3e73364227 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:20.245867 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:20.275713 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87758c0a-8db8-4ef0-b7d4-12ea0fb0af57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:20.276373 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87758c0a-8db8-4ef0-b7d4-12ea0fb0af57 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:20.276661 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87758c0a-8db8-4ef0-b7d4-12ea0fb0af57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:20.276941 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87758c0a-8db8-4ef0-b7d4-12ea0fb0af57 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:20.277687 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87758c0a-8db8-4ef0-b7d4-12ea0fb0af57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:20.279935 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87758c0a-8db8-4ef0-b7d4-12ea0fb0af57 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:20.375613 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1420/2865] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:09:20 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:09:20.380790 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30162cc4-107b-4f58-8935-0660fc0cce26 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:20.391377 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30162cc4-107b-4f58-8935-0660fc0cce26 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:20.396503 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe01287-1c5a-46ec-ae33-8ee6a943fe8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:20.397267 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe01287-1c5a-46ec-ae33-8ee6a943fe8f admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:20.400340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe01287-1c5a-46ec-ae33-8ee6a943fe8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:20.400340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe01287-1c5a-46ec-ae33-8ee6a943fe8f admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:20.400340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe01287-1c5a-46ec-ae33-8ee6a943fe8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:20.400340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe01287-1c5a-46ec-ae33-8ee6a943fe8f admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:20.410908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1446/2866] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 20:09:20.414801 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87758c0a-8db8-4ef0-b7d4-12ea0fb0af57 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:20.425254 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87758c0a-8db8-4ef0-b7d4-12ea0fb0af57 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:20.429876 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b61c0-3820-4716-8400-f5acac3e8852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:20.430529 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b61c0-3820-4716-8400-f5acac3e8852 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:20.430818 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b61c0-3820-4716-8400-f5acac3e8852 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:20.431101 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b61c0-3820-4716-8400-f5acac3e8852 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:20.431823 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b61c0-3820-4716-8400-f5acac3e8852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:20.433454 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b61c0-3820-4716-8400-f5acac3e8852 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:20.444786 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1421/2867] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 20:09:20.448617 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe01287-1c5a-46ec-ae33-8ee6a943fe8f admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:20.459180 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe01287-1c5a-46ec-ae33-8ee6a943fe8f admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:20.463743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0beb6-1d5f-4bcc-a772-7c71d45f6fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:20.464598 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0beb6-1d5f-4bcc-a772-7c71d45f6fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:20.464879 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0beb6-1d5f-4bcc-a772-7c71d45f6fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:20.465185 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0beb6-1d5f-4bcc-a772-7c71d45f6fc4 admin admin] PATH_INFO: `/v3/projects/e56823d4d6c94209a69de3f5cab0e161/users/4dbac00a72c444b9b73729c9fb4ac7ab/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:20.481819 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0beb6-1d5f-4bcc-a772-7c71d45f6fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56823d4d6c94209a69de3f5cab0e161, user_id=4dbac00a72c444b9b73729c9fb4ac7ab, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:20.484466 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0beb6-1d5f-4bcc-a772-7c71d45f6fc4 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:20.587251 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1447/2868] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:09:20 2022] PUT /identity/v3/projects/e56823d4d6c94209a69de3f5cab0e161/users/4dbac00a72c444b9b73729c9fb4ac7ab/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:09:20.598481 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0961b-156f-4aaa-97cd-57778dd847e4 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:20.598780 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0961b-156f-4aaa-97cd-57778dd847e4 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:20.599073 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0961b-156f-4aaa-97cd-57778dd847e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:20.627212 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-d3c0961b-156f-4aaa-97cd-57778dd847e4 None None] MFA Rules not processed for user `4dbac00a72c444b9b73729c9fb4ac7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:09:20.628408 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-d3c0961b-156f-4aaa-97cd-57778dd847e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:20.691517 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1422/2869] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:09:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:09:20.696011 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0beb6-1d5f-4bcc-a772-7c71d45f6fc4 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:20.756929 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0beb6-1d5f-4bcc-a772-7c71d45f6fc4 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:20.761628 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88581d5a-0b64-4a00-80ea-6750e5f52015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:20.762287 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88581d5a-0b64-4a00-80ea-6750e5f52015 admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:20.762579 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88581d5a-0b64-4a00-80ea-6750e5f52015 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:20.762897 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88581d5a-0b64-4a00-80ea-6750e5f52015 admin admin] PATH_INFO: `/v3/projects` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:20.763581 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88581d5a-0b64-4a00-80ea-6750e5f52015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:20.765662 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88581d5a-0b64-4a00-80ea-6750e5f52015 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:20.851477 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1448/2870] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:09:20 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:09:20.855459 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0961b-156f-4aaa-97cd-57778dd847e4 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:20.866772 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0961b-156f-4aaa-97cd-57778dd847e4 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:20.923305 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44ffb3-f76d-4ee0-a952-eaaad83cf162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:20.924158 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44ffb3-f76d-4ee0-a952-eaaad83cf162 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:20.924447 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44ffb3-f76d-4ee0-a952-eaaad83cf162 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:20.924733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44ffb3-f76d-4ee0-a952-eaaad83cf162 admin admin] PATH_INFO: `/v3/users` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:20.925474 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44ffb3-f76d-4ee0-a952-eaaad83cf162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:20.927397 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44ffb3-f76d-4ee0-a952-eaaad83cf162 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:20.998151 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1423/2871] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:09:20 2022] POST /identity/v3/users => generated 300 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:09:21.002080 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88581d5a-0b64-4a00-80ea-6750e5f52015 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:21.012676 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88581d5a-0b64-4a00-80ea-6750e5f52015 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:21.017839 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7f9bc-38f1-4bf9-a922-df32b5ab08d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:21.018487 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7f9bc-38f1-4bf9-a922-df32b5ab08d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:21.018805 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7f9bc-38f1-4bf9-a922-df32b5ab08d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:21.019083 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7f9bc-38f1-4bf9-a922-df32b5ab08d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:21.019803 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7f9bc-38f1-4bf9-a922-df32b5ab08d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:21.021505 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7f9bc-38f1-4bf9-a922-df32b5ab08d2 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:21.033683 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1449/2872] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:09:21.037365 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44ffb3-f76d-4ee0-a952-eaaad83cf162 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:21.047646 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44ffb3-f76d-4ee0-a952-eaaad83cf162 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:21.052548 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90e7cd-be9e-4de7-8cc1-0b9407b8d48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:21.053459 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90e7cd-be9e-4de7-8cc1-0b9407b8d48e admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:21.053742 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90e7cd-be9e-4de7-8cc1-0b9407b8d48e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:21.054094 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90e7cd-be9e-4de7-8cc1-0b9407b8d48e admin admin] PATH_INFO: `/v3/projects/7a65ff79c3304c6fa1d9b52496977f28/users/8f538d34a6fd427da311192945fdb11e/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:21.069421 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90e7cd-be9e-4de7-8cc1-0b9407b8d48e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a65ff79c3304c6fa1d9b52496977f28, user_id=8f538d34a6fd427da311192945fdb11e, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:21.072133 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90e7cd-be9e-4de7-8cc1-0b9407b8d48e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:21.152846 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1424/2873] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:09:21 2022] PUT /identity/v3/projects/7a65ff79c3304c6fa1d9b52496977f28/users/8f538d34a6fd427da311192945fdb11e/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:09:21.156845 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7f9bc-38f1-4bf9-a922-df32b5ab08d2 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:21.167347 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7f9bc-38f1-4bf9-a922-df32b5ab08d2 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:21.187616 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:21.224481 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbda4f7-9541-44ab-a104-3455e4a54903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:21.225173 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbda4f7-9541-44ab-a104-3455e4a54903 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:21.238317 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbda4f7-9541-44ab-a104-3455e4a54903 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:21.238317 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbda4f7-9541-44ab-a104-3455e4a54903 admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:21.238317 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbda4f7-9541-44ab-a104-3455e4a54903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:21.238317 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbda4f7-9541-44ab-a104-3455e4a54903 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:21.238317 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1450/2874] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:09:21.242141 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90e7cd-be9e-4de7-8cc1-0b9407b8d48e admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:21.247620 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:21.253447 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90e7cd-be9e-4de7-8cc1-0b9407b8d48e admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:21.258114 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd2807-85ed-43ac-87fd-4141aa83792a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:21.258998 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd2807-85ed-43ac-87fd-4141aa83792a admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:21.259288 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd2807-85ed-43ac-87fd-4141aa83792a admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:21.259579 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd2807-85ed-43ac-87fd-4141aa83792a admin admin] PATH_INFO: `/v3/projects/7a65ff79c3304c6fa1d9b52496977f28/users/8f538d34a6fd427da311192945fdb11e/roles/76bd0cf7bf094e4fa3db121b96215004` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:21.261667 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd2807-85ed-43ac-87fd-4141aa83792a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a65ff79c3304c6fa1d9b52496977f28, user_id=8f538d34a6fd427da311192945fdb11e, role_id=76bd0cf7bf094e4fa3db121b96215004)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:21.264381 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd2807-85ed-43ac-87fd-4141aa83792a admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:21.275176 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1425/2875] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:09:21 2022] PUT /identity/v3/projects/7a65ff79c3304c6fa1d9b52496977f28/users/8f538d34a6fd427da311192945fdb11e/roles/76bd0cf7bf094e4fa3db121b96215004 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:09:21.287332 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012456e4-db25-4896-979f-cce356883e8a None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:21.287624 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012456e4-db25-4896-979f-cce356883e8a None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:21.287904 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012456e4-db25-4896-979f-cce356883e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:21.314363 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-012456e4-db25-4896-979f-cce356883e8a None None] MFA Rules not processed for user `8f538d34a6fd427da311192945fdb11e`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:09:21.315560 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-012456e4-db25-4896-979f-cce356883e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:21.382718 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1451/2876] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:09:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:09:21.395099 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd2807-85ed-43ac-87fd-4141aa83792a admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:21.396855 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-05dd2807-85ed-43ac-87fd-4141aa83792a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:21.455099 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd2807-85ed-43ac-87fd-4141aa83792a admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:21.458777 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37c86b-82b1-45ad-ac9b-7e068f5c11f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:21.459421 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37c86b-82b1-45ad-ac9b-7e068f5c11f3 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:21.459737 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37c86b-82b1-45ad-ac9b-7e068f5c11f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:21.460034 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37c86b-82b1-45ad-ac9b-7e068f5c11f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:21.470300 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37c86b-82b1-45ad-ac9b-7e068f5c11f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:21.471813 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37c86b-82b1-45ad-ac9b-7e068f5c11f3 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:21.481487 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1426/2877] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:09:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:09:21.546977 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012456e4-db25-4896-979f-cce356883e8a None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:21.611733 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012456e4-db25-4896-979f-cce356883e8a None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:21.616328 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9144d-e604-4fca-bdb2-3f3467d3db79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:21.617230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9144d-e604-4fca-bdb2-3f3467d3db79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:21.617524 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9144d-e604-4fca-bdb2-3f3467d3db79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:21.617810 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9144d-e604-4fca-bdb2-3f3467d3db79 admin admin] PATH_INFO: `/v3/users/4dbac00a72c444b9b73729c9fb4ac7ab` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:21.619010 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9144d-e604-4fca-bdb2-3f3467d3db79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dbac00a72c444b9b73729c9fb4ac7ab)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:21.620940 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9144d-e604-4fca-bdb2-3f3467d3db79 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:21.811743 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e9a9144d-e604-4fca-bdb2-3f3467d3db79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dbac00a72c444b9b73729c9fb4ac7ab'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:21.812847 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:21.824476 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e9a9144d-e604-4fca-bdb2-3f3467d3db79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dbac00a72c444b9b73729c9fb4ac7ab'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:21.895182 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e9a9144d-e604-4fca-bdb2-3f3467d3db79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dbac00a72c444b9b73729c9fb4ac7ab'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:21.895818 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e9a9144d-e604-4fca-bdb2-3f3467d3db79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dbac00a72c444b9b73729c9fb4ac7ab'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:21.903452 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-e9a9144d-e604-4fca-bdb2-3f3467d3db79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dbac00a72c444b9b73729c9fb4ac7ab'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:21.909699 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1452/2878] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:09:21 2022] DELETE /identity/v3/users/4dbac00a72c444b9b73729c9fb4ac7ab => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:09:21.914264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c3102-c732-4460-bc0a-9d152eefb2a4 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:21.914556 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c3102-c732-4460-bc0a-9d152eefb2a4 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:21.914837 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c3102-c732-4460-bc0a-9d152eefb2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:21.933759 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-660c3102-c732-4460-bc0a-9d152eefb2a4 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:09:21.935043 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-660c3102-c732-4460-bc0a-9d152eefb2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:21.994096 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1427/2879] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:09:22.003874 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9144d-e604-4fca-bdb2-3f3467d3db79 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:22.005316 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-e9a9144d-e604-4fca-bdb2-3f3467d3db79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:22.062118 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9144d-e604-4fca-bdb2-3f3467d3db79 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:22.065700 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac495497-dc6c-4044-bcfb-c758ccd03967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:22.066343 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac495497-dc6c-4044-bcfb-c758ccd03967 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:22.066630 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac495497-dc6c-4044-bcfb-c758ccd03967 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:22.066909 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac495497-dc6c-4044-bcfb-c758ccd03967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:22.075931 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac495497-dc6c-4044-bcfb-c758ccd03967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:22.077427 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac495497-dc6c-4044-bcfb-c758ccd03967 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:22.086833 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1453/2880] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:09:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:09:22.514130 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c3102-c732-4460-bc0a-9d152eefb2a4 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:22.518773 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-660c3102-c732-4460-bc0a-9d152eefb2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:22.530428 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c3102-c732-4460-bc0a-9d152eefb2a4 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:22.536610 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17dc0c-2482-4ebd-adc7-ff91e2cacf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:22.537509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17dc0c-2482-4ebd-adc7-ff91e2cacf72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:22.537791 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17dc0c-2482-4ebd-adc7-ff91e2cacf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:22.538124 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17dc0c-2482-4ebd-adc7-ff91e2cacf72 admin admin] PATH_INFO: `/v3/projects/e56823d4d6c94209a69de3f5cab0e161` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:22.539268 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17dc0c-2482-4ebd-adc7-ff91e2cacf72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e56823d4d6c94209a69de3f5cab0e161)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:22.541149 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17dc0c-2482-4ebd-adc7-ff91e2cacf72 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:22.650246 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8d17dc0c-2482-4ebd-adc7-ff91e2cacf72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e56823d4d6c94209a69de3f5cab0e161', 'request_id': 'req-8d17dc0c-2482-4ebd-adc7-ff91e2cacf72'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:22.656485 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8d17dc0c-2482-4ebd-adc7-ff91e2cacf72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e56823d4d6c94209a69de3f5cab0e161', 'request_id': 'req-8d17dc0c-2482-4ebd-adc7-ff91e2cacf72'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:22.662792 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8d17dc0c-2482-4ebd-adc7-ff91e2cacf72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e56823d4d6c94209a69de3f5cab0e161', 'request_id': 'req-8d17dc0c-2482-4ebd-adc7-ff91e2cacf72'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:22.729275 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8d17dc0c-2482-4ebd-adc7-ff91e2cacf72 admin admin] The token cache is being invalidate because project e56823d4d6c94209a69de3f5cab0e161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:09:22.729571 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8d17dc0c-2482-4ebd-adc7-ff91e2cacf72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:22.730196 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-8d17dc0c-2482-4ebd-adc7-ff91e2cacf72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:22.731808 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1428/2881] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:09:22 2022] DELETE /identity/v3/projects/e56823d4d6c94209a69de3f5cab0e161 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:09:22.736372 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac495497-dc6c-4044-bcfb-c758ccd03967 service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:22.746303 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac495497-dc6c-4044-bcfb-c758ccd03967 service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:22.804199 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9479523-08b9-4399-8f15-fcbabcc1e268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:22.805075 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9479523-08b9-4399-8f15-fcbabcc1e268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:22.805399 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9479523-08b9-4399-8f15-fcbabcc1e268 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:22.805685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9479523-08b9-4399-8f15-fcbabcc1e268 admin admin] PATH_INFO: `/v3/users/8f538d34a6fd427da311192945fdb11e` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:22.806902 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9479523-08b9-4399-8f15-fcbabcc1e268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f538d34a6fd427da311192945fdb11e)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:22.808896 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9479523-08b9-4399-8f15-fcbabcc1e268 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:23.000428 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-b9479523-08b9-4399-8f15-fcbabcc1e268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f538d34a6fd427da311192945fdb11e'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:23.012308 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-b9479523-08b9-4399-8f15-fcbabcc1e268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f538d34a6fd427da311192945fdb11e'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:23.015873 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:23.089883 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-b9479523-08b9-4399-8f15-fcbabcc1e268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f538d34a6fd427da311192945fdb11e'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:23.090494 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-b9479523-08b9-4399-8f15-fcbabcc1e268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f538d34a6fd427da311192945fdb11e'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:23.098716 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-b9479523-08b9-4399-8f15-fcbabcc1e268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f538d34a6fd427da311192945fdb11e'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:23.105024 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1454/2882] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:09:22 2022] DELETE /identity/v3/users/8f538d34a6fd427da311192945fdb11e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:09:23.513949 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17dc0c-2482-4ebd-adc7-ff91e2cacf72 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:23.515428 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-8d17dc0c-2482-4ebd-adc7-ff91e2cacf72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:23.531486 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17dc0c-2482-4ebd-adc7-ff91e2cacf72 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:23.545510 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:23.592162 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60540b3f-4513-4947-bfa8-b6710231d03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:23.593024 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60540b3f-4513-4947-bfa8-b6710231d03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:23.593336 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60540b3f-4513-4947-bfa8-b6710231d03d admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:23.593614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60540b3f-4513-4947-bfa8-b6710231d03d admin admin] PATH_INFO: `/v3/projects/7a65ff79c3304c6fa1d9b52496977f28` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:23.594787 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60540b3f-4513-4947-bfa8-b6710231d03d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a65ff79c3304c6fa1d9b52496977f28)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:23.596967 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60540b3f-4513-4947-bfa8-b6710231d03d admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:23.702012 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-60540b3f-4513-4947-bfa8-b6710231d03d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a65ff79c3304c6fa1d9b52496977f28', 'request_id': 'req-60540b3f-4513-4947-bfa8-b6710231d03d'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:23.709286 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-60540b3f-4513-4947-bfa8-b6710231d03d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a65ff79c3304c6fa1d9b52496977f28', 'request_id': 'req-60540b3f-4513-4947-bfa8-b6710231d03d'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:23.714672 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-60540b3f-4513-4947-bfa8-b6710231d03d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a65ff79c3304c6fa1d9b52496977f28', 'request_id': 'req-60540b3f-4513-4947-bfa8-b6710231d03d'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:23.770093 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-60540b3f-4513-4947-bfa8-b6710231d03d admin admin] The token cache is being invalidate because project 7a65ff79c3304c6fa1d9b52496977f28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:09:23.770493 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-60540b3f-4513-4947-bfa8-b6710231d03d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:23.771177 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-60540b3f-4513-4947-bfa8-b6710231d03d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:23.772853 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1429/2883] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:09:23 2022] DELETE /identity/v3/projects/7a65ff79c3304c6fa1d9b52496977f28 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:09:23.778745 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71048199-3db3-490d-8de0-ba0309cbea4b None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:23.779087 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71048199-3db3-490d-8de0-ba0309cbea4b None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:23.779396 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71048199-3db3-490d-8de0-ba0309cbea4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:23.797460 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-71048199-3db3-490d-8de0-ba0309cbea4b None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:09:23.798874 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-71048199-3db3-490d-8de0-ba0309cbea4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:23.857853 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1455/2884] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:09:23.867255 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300f39d-56e8-4094-b76c-9b1a55633f95 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:23.867575 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300f39d-56e8-4094-b76c-9b1a55633f95 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:23.867861 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300f39d-56e8-4094-b76c-9b1a55633f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:23.886854 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-7300f39d-56e8-4094-b76c-9b1a55633f95 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:09:23.888074 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-7300f39d-56e8-4094-b76c-9b1a55633f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:23.896169 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1430/2885] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:09:23.901547 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71048199-3db3-490d-8de0-ba0309cbea4b None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:23.911426 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71048199-3db3-490d-8de0-ba0309cbea4b None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:23.915934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17878e9-77ca-4f01-94ba-99612b148cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:23.916592 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17878e9-77ca-4f01-94ba-99612b148cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:23.916880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17878e9-77ca-4f01-94ba-99612b148cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:23.917185 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17878e9-77ca-4f01-94ba-99612b148cc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:23.917958 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17878e9-77ca-4f01-94ba-99612b148cc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:09:23.918269 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17878e9-77ca-4f01-94ba-99612b148cc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:23.919877 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17878e9-77ca-4f01-94ba-99612b148cc2 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:23.931933 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1456/2886] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 20:09:23.936264 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300f39d-56e8-4094-b76c-9b1a55633f95 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:23.946128 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300f39d-56e8-4094-b76c-9b1a55633f95 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:23.950778 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40853736-4da7-4c0e-ae6e-96385e6593f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:23.951431 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40853736-4da7-4c0e-ae6e-96385e6593f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:23.951716 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40853736-4da7-4c0e-ae6e-96385e6593f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:23.951995 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40853736-4da7-4c0e-ae6e-96385e6593f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:23.952677 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40853736-4da7-4c0e-ae6e-96385e6593f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:23.954647 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40853736-4da7-4c0e-ae6e-96385e6593f0 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:24.040002 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1431/2887] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:09:23 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:09:24.044141 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17878e9-77ca-4f01-94ba-99612b148cc2 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:24.055109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17878e9-77ca-4f01-94ba-99612b148cc2 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:24.112268 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc500f-e6d9-4e53-801f-7bd6b760100d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:24.112934 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc500f-e6d9-4e53-801f-7bd6b760100d admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:24.113245 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc500f-e6d9-4e53-801f-7bd6b760100d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:24.113524 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc500f-e6d9-4e53-801f-7bd6b760100d admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:24.114205 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc500f-e6d9-4e53-801f-7bd6b760100d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:24.116138 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc500f-e6d9-4e53-801f-7bd6b760100d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:24.181312 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1457/2888] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:09:24 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:09:24.185349 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40853736-4da7-4c0e-ae6e-96385e6593f0 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:24.197360 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40853736-4da7-4c0e-ae6e-96385e6593f0 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:24.202089 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad00f9-a337-4761-9e6a-ebb7749927f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:24.202743 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad00f9-a337-4761-9e6a-ebb7749927f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:24.203028 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad00f9-a337-4761-9e6a-ebb7749927f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:24.203304 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad00f9-a337-4761-9e6a-ebb7749927f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:24.204052 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad00f9-a337-4761-9e6a-ebb7749927f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:24.206205 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad00f9-a337-4761-9e6a-ebb7749927f5 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:24.216721 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1432/2889] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:09:24.220899 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc500f-e6d9-4e53-801f-7bd6b760100d admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:24.231244 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc500f-e6d9-4e53-801f-7bd6b760100d admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:24.236581 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81db042-fe1b-4cf0-a9a6-cdd2ebfebfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:24.237261 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81db042-fe1b-4cf0-a9a6-cdd2ebfebfcb admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:24.237549 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81db042-fe1b-4cf0-a9a6-cdd2ebfebfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:24.237829 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81db042-fe1b-4cf0-a9a6-cdd2ebfebfcb admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:24.238555 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81db042-fe1b-4cf0-a9a6-cdd2ebfebfcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:24.240157 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81db042-fe1b-4cf0-a9a6-cdd2ebfebfcb admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:24.250078 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1458/2890] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:09:24.254470 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad00f9-a337-4761-9e6a-ebb7749927f5 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:24.264554 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad00f9-a337-4761-9e6a-ebb7749927f5 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:24.269701 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7506e-ff4b-46c8-a0fe-c3c1e5174f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:24.270608 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7506e-ff4b-46c8-a0fe-c3c1e5174f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:24.270887 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7506e-ff4b-46c8-a0fe-c3c1e5174f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:24.271163 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7506e-ff4b-46c8-a0fe-c3c1e5174f8f admin admin] PATH_INFO: `/v3/projects/fcf4a8156e1b4c7aaef21341fa36c1d9/users/850a365797bc4b19854068fc04e075fc/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:24.286519 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7506e-ff4b-46c8-a0fe-c3c1e5174f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf4a8156e1b4c7aaef21341fa36c1d9, user_id=850a365797bc4b19854068fc04e075fc, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:24.289146 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7506e-ff4b-46c8-a0fe-c3c1e5174f8f admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:24.358956 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1433/2891] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:09:24 2022] PUT /identity/v3/projects/fcf4a8156e1b4c7aaef21341fa36c1d9/users/850a365797bc4b19854068fc04e075fc/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:09:24.370084 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b222ce5-11ba-4d65-803c-2f63a07001d5 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:24.370382 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b222ce5-11ba-4d65-803c-2f63a07001d5 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:24.370666 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b222ce5-11ba-4d65-803c-2f63a07001d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:24.396791 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-8b222ce5-11ba-4d65-803c-2f63a07001d5 None None] MFA Rules not processed for user `850a365797bc4b19854068fc04e075fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:09:24.398074 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-8b222ce5-11ba-4d65-803c-2f63a07001d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:24.439962 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:24.461965 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1459/2892] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:09:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:09:24.473746 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7506e-ff4b-46c8-a0fe-c3c1e5174f8f admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:24.475449 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-b9a7506e-ff4b-46c8-a0fe-c3c1e5174f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:24.520996 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:24.532945 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7506e-ff4b-46c8-a0fe-c3c1e5174f8f admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:24.536968 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b266ab3-83a8-4877-97b6-8e94b000b0d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:24.537638 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b266ab3-83a8-4877-97b6-8e94b000b0d4 service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:24.537930 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b266ab3-83a8-4877-97b6-8e94b000b0d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:24.538214 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b266ab3-83a8-4877-97b6-8e94b000b0d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:24.546715 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b266ab3-83a8-4877-97b6-8e94b000b0d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:24.549244 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b266ab3-83a8-4877-97b6-8e94b000b0d4 service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:24.558596 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1434/2893] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:09:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:09:27.568755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b222ce5-11ba-4d65-803c-2f63a07001d5 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:27.631481 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b222ce5-11ba-4d65-803c-2f63a07001d5 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:27.635980 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb6a9b-3237-4b3b-962f-682150d347d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:27.636854 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb6a9b-3237-4b3b-962f-682150d347d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:27.637142 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb6a9b-3237-4b3b-962f-682150d347d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:27.637449 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb6a9b-3237-4b3b-962f-682150d347d3 admin admin] PATH_INFO: `/v3/users/850a365797bc4b19854068fc04e075fc` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:27.638633 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb6a9b-3237-4b3b-962f-682150d347d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=850a365797bc4b19854068fc04e075fc)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:27.640552 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb6a9b-3237-4b3b-962f-682150d347d3 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:27.886597 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-b1fb6a9b-3237-4b3b-962f-682150d347d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '850a365797bc4b19854068fc04e075fc'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:27.899562 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-b1fb6a9b-3237-4b3b-962f-682150d347d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '850a365797bc4b19854068fc04e075fc'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:27.993109 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-b1fb6a9b-3237-4b3b-962f-682150d347d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '850a365797bc4b19854068fc04e075fc'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:27.993757 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-b1fb6a9b-3237-4b3b-962f-682150d347d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '850a365797bc4b19854068fc04e075fc'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:28.001826 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-b1fb6a9b-3237-4b3b-962f-682150d347d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '850a365797bc4b19854068fc04e075fc'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:28.007755 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1460/2894] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:09:27 2022] DELETE /identity/v3/users/850a365797bc4b19854068fc04e075fc => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:09:28.017992 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf44a9-276f-4965-9cd4-4dcbb3ee27b0 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:28.018484 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf44a9-276f-4965-9cd4-4dcbb3ee27b0 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:28.018586 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf44a9-276f-4965-9cd4-4dcbb3ee27b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:28.045424 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-f2cf44a9-276f-4965-9cd4-4dcbb3ee27b0 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:09:28.046614 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f2cf44a9-276f-4965-9cd4-4dcbb3ee27b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:28.129733 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1435/2895] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 20:09:28.139358 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb6a9b-3237-4b3b-962f-682150d347d3 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:28.140732 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-b1fb6a9b-3237-4b3b-962f-682150d347d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:28.210262 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:28.218427 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb6a9b-3237-4b3b-962f-682150d347d3 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:28.222371 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f1d0f-72c9-4197-b5cd-7c2fd6438316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:28.223012 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f1d0f-72c9-4197-b5cd-7c2fd6438316 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:28.223297 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f1d0f-72c9-4197-b5cd-7c2fd6438316 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:28.223572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f1d0f-72c9-4197-b5cd-7c2fd6438316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:28.232830 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f1d0f-72c9-4197-b5cd-7c2fd6438316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:28.237364 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f1d0f-72c9-4197-b5cd-7c2fd6438316 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:28.244049 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1461/2896] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:09:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:09:28.711648 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf44a9-276f-4965-9cd4-4dcbb3ee27b0 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:28.713202 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-f2cf44a9-276f-4965-9cd4-4dcbb3ee27b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:28.733755 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf44a9-276f-4965-9cd4-4dcbb3ee27b0 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:28.739080 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671477e-1f1e-406a-9666-9b2812c9b945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:28.739945 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671477e-1f1e-406a-9666-9b2812c9b945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:28.740229 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671477e-1f1e-406a-9666-9b2812c9b945 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:28.740513 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671477e-1f1e-406a-9666-9b2812c9b945 admin admin] PATH_INFO: `/v3/projects/fcf4a8156e1b4c7aaef21341fa36c1d9` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:28.741751 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671477e-1f1e-406a-9666-9b2812c9b945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcf4a8156e1b4c7aaef21341fa36c1d9)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:28.743662 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671477e-1f1e-406a-9666-9b2812c9b945 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:28.863033 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9671477e-1f1e-406a-9666-9b2812c9b945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcf4a8156e1b4c7aaef21341fa36c1d9', 'request_id': 'req-9671477e-1f1e-406a-9666-9b2812c9b945'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:28.869858 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9671477e-1f1e-406a-9666-9b2812c9b945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcf4a8156e1b4c7aaef21341fa36c1d9', 'request_id': 'req-9671477e-1f1e-406a-9666-9b2812c9b945'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:28.875487 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9671477e-1f1e-406a-9666-9b2812c9b945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcf4a8156e1b4c7aaef21341fa36c1d9', 'request_id': 'req-9671477e-1f1e-406a-9666-9b2812c9b945'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:28.957678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9671477e-1f1e-406a-9666-9b2812c9b945 admin admin] The token cache is being invalidate because project fcf4a8156e1b4c7aaef21341fa36c1d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:09:28.957928 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9671477e-1f1e-406a-9666-9b2812c9b945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:28.958579 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-9671477e-1f1e-406a-9666-9b2812c9b945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:28.960141 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1436/2897] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:09:28 2022] DELETE /identity/v3/projects/fcf4a8156e1b4c7aaef21341fa36c1d9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:09:28.964969 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff254b7b-22d7-4843-bfe7-0586c526dbe5 None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:28.965472 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff254b7b-22d7-4843-bfe7-0586c526dbe5 None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:28.965572 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff254b7b-22d7-4843-bfe7-0586c526dbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:28.984675 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-ff254b7b-22d7-4843-bfe7-0586c526dbe5 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:09:28.986705 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-ff254b7b-22d7-4843-bfe7-0586c526dbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:29.043782 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1462/2898] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:09:29.052572 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef080dc2-72d6-4a1d-a34b-0b11f300dc2f None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:29.053050 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef080dc2-72d6-4a1d-a34b-0b11f300dc2f None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:29.053182 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef080dc2-72d6-4a1d-a34b-0b11f300dc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:29.071079 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-ef080dc2-72d6-4a1d-a34b-0b11f300dc2f None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:09:29.072288 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-ef080dc2-72d6-4a1d-a34b-0b11f300dc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:29.080241 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1437/2899] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:09:29.084364 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff254b7b-22d7-4843-bfe7-0586c526dbe5 None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:29.093955 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff254b7b-22d7-4843-bfe7-0586c526dbe5 None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:29.099116 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa168b-3afd-42e5-be41-e9e41c8a6c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:29.099766 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa168b-3afd-42e5-be41-e9e41c8a6c0a admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:29.100070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa168b-3afd-42e5-be41-e9e41c8a6c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:29.100339 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa168b-3afd-42e5-be41-e9e41c8a6c0a admin admin] PATH_INFO: `/v3/domains` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:29.101070 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa168b-3afd-42e5-be41-e9e41c8a6c0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91965) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 20:09:29.101830 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa168b-3afd-42e5-be41-e9e41c8a6c0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:29.103318 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa168b-3afd-42e5-be41-e9e41c8a6c0a admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:29.115474 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1463/2900] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 20:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 20:09:29.119630 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef080dc2-72d6-4a1d-a34b-0b11f300dc2f None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:29.128997 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef080dc2-72d6-4a1d-a34b-0b11f300dc2f None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:29.133832 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c26d29-20d0-433d-848f-313ddf3ead33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:29.134485 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c26d29-20d0-433d-848f-313ddf3ead33 admin admin] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:29.134771 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c26d29-20d0-433d-848f-313ddf3ead33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:29.135053 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c26d29-20d0-433d-848f-313ddf3ead33 admin admin] PATH_INFO: `/v3/projects` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:29.135739 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c26d29-20d0-433d-848f-313ddf3ead33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:29.137678 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c26d29-20d0-433d-848f-313ddf3ead33 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:29.222369 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1438/2901] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 20:09:29 2022] POST /identity/v3/projects => generated 391 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:09:29.226700 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa168b-3afd-42e5-be41-e9e41c8a6c0a admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:29.237466 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa168b-3afd-42e5-be41-e9e41c8a6c0a admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:29.295214 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124570ed-978b-4b09-9faf-4aa21e36649d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:29.295884 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124570ed-978b-4b09-9faf-4aa21e36649d admin admin] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:29.296175 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124570ed-978b-4b09-9faf-4aa21e36649d admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:29.296457 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124570ed-978b-4b09-9faf-4aa21e36649d admin admin] PATH_INFO: `/v3/users` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:29.297200 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124570ed-978b-4b09-9faf-4aa21e36649d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:29.299856 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124570ed-978b-4b09-9faf-4aa21e36649d admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:29.405062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1464/2902] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 20:09:29 2022] POST /identity/v3/users => generated 296 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 20:09:29.409496 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c26d29-20d0-433d-848f-313ddf3ead33 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:29.419757 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c26d29-20d0-433d-848f-313ddf3ead33 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:29.425036 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ae46-b414-4549-b43e-b48ee59f2d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:29.425724 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ae46-b414-4549-b43e-b48ee59f2d3e admin admin] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:29.426014 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ae46-b414-4549-b43e-b48ee59f2d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:29.426323 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ae46-b414-4549-b43e-b48ee59f2d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:29.427053 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593ae46-b414-4549-b43e-b48ee59f2d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:29.428685 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593ae46-b414-4549-b43e-b48ee59f2d3e admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:29.429964 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:29.439641 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1439/2903] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:09:29.443447 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124570ed-978b-4b09-9faf-4aa21e36649d admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:29.453327 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124570ed-978b-4b09-9faf-4aa21e36649d admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:29.458259 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dbbc3-01fc-4daa-8dd4-ba40e1887e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:29.458908 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dbbc3-01fc-4daa-8dd4-ba40e1887e8a admin admin] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:29.459190 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dbbc3-01fc-4daa-8dd4-ba40e1887e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:29.459463 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dbbc3-01fc-4daa-8dd4-ba40e1887e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:29.460340 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dbbc3-01fc-4daa-8dd4-ba40e1887e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:29.461979 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dbbc3-01fc-4daa-8dd4-ba40e1887e8a admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:29.472113 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1465/2904] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 20:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 20:09:29.476509 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ae46-b414-4549-b43e-b48ee59f2d3e admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:29.487694 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ae46-b414-4549-b43e-b48ee59f2d3e admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:29.492597 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cc55e-5766-42ee-8f8d-595bf1a0e7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:29.493511 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cc55e-5766-42ee-8f8d-595bf1a0e7a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:29.493802 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cc55e-5766-42ee-8f8d-595bf1a0e7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:29.494087 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cc55e-5766-42ee-8f8d-595bf1a0e7a3 admin admin] PATH_INFO: `/v3/projects/29c7d6ccc8cc443a91cc2cc4ebe7255e/users/f7e5fc50e18540679e19ff4d70fd15c6/roles/61895d866a7c44de8924486b8e5ec6e8` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:29.509560 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cc55e-5766-42ee-8f8d-595bf1a0e7a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c7d6ccc8cc443a91cc2cc4ebe7255e, user_id=f7e5fc50e18540679e19ff4d70fd15c6, role_id=61895d866a7c44de8924486b8e5ec6e8)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:29.512204 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cc55e-5766-42ee-8f8d-595bf1a0e7a3 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:29.587445 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1440/2905] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 20:09:29 2022] PUT /identity/v3/projects/29c7d6ccc8cc443a91cc2cc4ebe7255e/users/f7e5fc50e18540679e19ff4d70fd15c6/roles/61895d866a7c44de8924486b8e5ec6e8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 20:09:29.649692 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39ba50-7bf6-49d4-b12c-19538ab2c10d None None] REQUEST_METHOD: `POST` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:29.650005 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39ba50-7bf6-49d4-b12c-19538ab2c10d None None] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:29.650286 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39ba50-7bf6-49d4-b12c-19538ab2c10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:29.676876 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.auth.core [None req-fa39ba50-7bf6-49d4-b12c-19538ab2c10d None None] MFA Rules not processed for user `f7e5fc50e18540679e19ff4d70fd15c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91965) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:09:29.678104 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-fa39ba50-7bf6-49d4-b12c-19538ab2c10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:29.706958 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:29.742972 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1466/2906] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:09:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:09:29.753818 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cc55e-5766-42ee-8f8d-595bf1a0e7a3 admin admin] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:29.755494 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-325cc55e-5766-42ee-8f8d-595bf1a0e7a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:29.814826 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cc55e-5766-42ee-8f8d-595bf1a0e7a3 admin admin] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:29.818459 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891f21a-355a-4667-9bc9-45e0e044431a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab2b3700cdf48f08a049fbb76ee189c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:29.819102 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891f21a-355a-4667-9bc9-45e0e044431a service cinder] REQUEST_METHOD: `GET` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:29.819389 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891f21a-355a-4667-9bc9-45e0e044431a service cinder] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:29.819665 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891f21a-355a-4667-9bc9-45e0e044431a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:29.827786 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891f21a-355a-4667-9bc9-45e0e044431a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:29.829705 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891f21a-355a-4667-9bc9-45e0e044431a service cinder] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:29.838320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1441/2907] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:09:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:09:39.769880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=14 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:39.834388 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:41.892230 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39ba50-7bf6-49d4-b12c-19538ab2c10d None None] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:41.974003 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39ba50-7bf6-49d4-b12c-19538ab2c10d None None] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:41.978880 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a5d04-ab41-4f1f-b19b-c567ab187a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:41.979784 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a5d04-ab41-4f1f-b19b-c567ab187a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:41.980069 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a5d04-ab41-4f1f-b19b-c567ab187a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:41.980348 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a5d04-ab41-4f1f-b19b-c567ab187a96 admin admin] PATH_INFO: `/v3/users/f7e5fc50e18540679e19ff4d70fd15c6` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:41.981641 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a5d04-ab41-4f1f-b19b-c567ab187a96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e5fc50e18540679e19ff4d70fd15c6)` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:41.983643 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a5d04-ab41-4f1f-b19b-c567ab187a96 admin admin] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:42.188220 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-c04a5d04-ab41-4f1f-b19b-c567ab187a96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e5fc50e18540679e19ff4d70fd15c6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:42.200499 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-c04a5d04-ab41-4f1f-b19b-c567ab187a96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e5fc50e18540679e19ff4d70fd15c6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:42.266877 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-c04a5d04-ab41-4f1f-b19b-c567ab187a96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e5fc50e18540679e19ff4d70fd15c6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:42.267504 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-c04a5d04-ab41-4f1f-b19b-c567ab187a96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e5fc50e18540679e19ff4d70fd15c6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:42.274571 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.notifications [None req-c04a5d04-ab41-4f1f-b19b-c567ab187a96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e5fc50e18540679e19ff4d70fd15c6'} {{(pid=91965) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:42.280491 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1467/2908] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 20:09:41 2022] DELETE /identity/v3/users/f7e5fc50e18540679e19ff4d70fd15c6 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:09:42.301236 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e50444-09e2-40aa-bc83-8fc237ddb030 None None] REQUEST_METHOD: `POST` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:42.301236 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e50444-09e2-40aa-bc83-8fc237ddb030 None None] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:42.301236 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e50444-09e2-40aa-bc83-8fc237ddb030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:42.312194 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.auth.core [None req-74e50444-09e2-40aa-bc83-8fc237ddb030 None None] MFA Rules not processed for user `d83e81b5c7054c4491fc17ac780d3cea`. Rule list: `[]` (Enabled: `True`). {{(pid=91966) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 20:09:42.313446 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-74e50444-09e2-40aa-bc83-8fc237ddb030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:42.371619 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1442/2909] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 20:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 20:09:42.381196 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a5d04-ab41-4f1f-b19b-c567ab187a96 admin admin] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:42.382619 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-c04a5d04-ab41-4f1f-b19b-c567ab187a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:42.451308 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:42.460576 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a5d04-ab41-4f1f-b19b-c567ab187a96 admin admin] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:42.464282 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2e035-9466-4f16-87d5-9a4fe3e41395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bb6f31e87045f5b17f561b42edca6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:42.467152 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2e035-9466-4f16-87d5-9a4fe3e41395 service neutron] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:42.467152 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2e035-9466-4f16-87d5-9a4fe3e41395 service neutron] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:42.467152 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2e035-9466-4f16-87d5-9a4fe3e41395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:42.475029 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2e035-9466-4f16-87d5-9a4fe3e41395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:42.476452 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2e035-9466-4f16-87d5-9a4fe3e41395 service neutron] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:42.486730 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1468/2910] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:09:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:09:42.885485 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e50444-09e2-40aa-bc83-8fc237ddb030 None None] Authenticating user token {{(pid=91966) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:09:42.887074 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.fernet_utils [None req-74e50444-09e2-40aa-bc83-8fc237ddb030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91966) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:09:42.899929 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e50444-09e2-40aa-bc83-8fc237ddb030 None None] Validating token access rules against request {{(pid=91966) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:09:42.904653 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dde0f-e294-4290-9bcb-1f2e502ab9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83e81b5c7054c4491fc17ac780d3cea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50703062c6ac410a8cc7e1c87c4ecbac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91966) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:09:42.906320 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dde0f-e294-4290-9bcb-1f2e502ab9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:09:42.906609 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dde0f-e294-4290-9bcb-1f2e502ab9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:09:42.908224 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dde0f-e294-4290-9bcb-1f2e502ab9c3 admin admin] PATH_INFO: `/v3/projects/29c7d6ccc8cc443a91cc2cc4ebe7255e` {{(pid=91966) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:09:42.909745 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7dde0f-e294-4290-9bcb-1f2e502ab9c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29c7d6ccc8cc443a91cc2cc4ebe7255e)` {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:09:42.912467 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7dde0f-e294-4290-9bcb-1f2e502ab9c3 admin admin] RBAC: Authorization granted {{(pid=91966) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:09:43.021120 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-cc7dde0f-e294-4290-9bcb-1f2e502ab9c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c7d6ccc8cc443a91cc2cc4ebe7255e', 'request_id': 'req-cc7dde0f-e294-4290-9bcb-1f2e502ab9c3'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:43.027259 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-cc7dde0f-e294-4290-9bcb-1f2e502ab9c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c7d6ccc8cc443a91cc2cc4ebe7255e', 'request_id': 'req-cc7dde0f-e294-4290-9bcb-1f2e502ab9c3'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:43.033814 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-cc7dde0f-e294-4290-9bcb-1f2e502ab9c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c7d6ccc8cc443a91cc2cc4ebe7255e', 'request_id': 'req-cc7dde0f-e294-4290-9bcb-1f2e502ab9c3'} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:43.128825 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-cc7dde0f-e294-4290-9bcb-1f2e502ab9c3 admin admin] The token cache is being invalidate because project 29c7d6ccc8cc443a91cc2cc4ebe7255e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91966) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 20:09:43.129113 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-cc7dde0f-e294-4290-9bcb-1f2e502ab9c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:43.129796 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG keystone.notifications [None req-cc7dde0f-e294-4290-9bcb-1f2e502ab9c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91966) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 20:09:43.131380 dv-cinder-847274-2-smb devstack@keystone.service[91966]: [pid: 91966|app: 0|req: 1443/2911] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 20:09:42 2022] DELETE /identity/v3/projects/29c7d6ccc8cc443a91cc2cc4ebe7255e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 20:09:52.581062 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=7 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:53.125518 dv-cinder-847274-2-smb devstack@keystone.service[91966]: DEBUG dbcounter [-] [91966] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:11:30.155685 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2e035-9466-4f16-87d5-9a4fe3e41395 service neutron] Authenticating user token {{(pid=91965) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 20:11:30.157009 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-a1e2e035-9466-4f16-87d5-9a4fe3e41395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:11:30.244838 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2e035-9466-4f16-87d5-9a4fe3e41395 service neutron] Validating token access rules against request {{(pid=91965) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 20:11:30.301395 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc04653-020e-41f2-86c6-90b67a2c1c24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9ba6d33e8640ec8dcda9971f59c5dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368f41dc1ae64e199b604ee72545c88e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91965) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 20:11:30.302037 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc04653-020e-41f2-86c6-90b67a2c1c24 service placement] REQUEST_METHOD: `GET` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 20:11:30.302317 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc04653-020e-41f2-86c6-90b67a2c1c24 service placement] SCRIPT_NAME: `/identity` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 20:11:30.302591 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc04653-020e-41f2-86c6-90b67a2c1c24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91965) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 20:11:30.304336 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.fernet_utils [None req-2fc04653-020e-41f2-86c6-90b67a2c1c24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91965) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 20:11:30.315835 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc04653-020e-41f2-86c6-90b67a2c1c24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 20:11:30.317446 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc04653-020e-41f2-86c6-90b67a2c1c24 service placement] RBAC: Authorization granted {{(pid=91965) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 20:11:30.327846 dv-cinder-847274-2-smb devstack@keystone.service[91965]: [pid: 91965|app: 0|req: 1469/2912] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 20:11:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 20:11:40.323688 dv-cinder-847274-2-smb devstack@keystone.service[91965]: DEBUG dbcounter [-] [91965] Writing DB stats keystone:SELECT=67 {{(pid=91965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}